Repository navigation
Commit 0b6add8
Add GPTQ quantization to executorch (not tested) (#2274)
Summary:
Pull Request resolved: #2274
will test in OSS and fix issues in a separate PR
bypass-github-export-checks
bypass-github-pytorch-ci-checks
bypass-github-executorch-ci-checks
Reviewed By: digantdesai
Differential Revision: D54569842
fbshipit-source-id: 7c3e60833d8e144cb5842842b4f640138dfa93821 parent daaecb1 commit 0b6add8
5 files changed
Lines changed: 887 additions & 30 deletions
File tree
- backends/vulkan/serialization
- examples/models/llama2
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
16 | 15 | | |
17 | 16 | | |
18 | 17 | | |
| |||
35 | 34 | | |
36 | 35 | | |
37 | 36 | | |
38 | | - | |
39 | 37 | | |
40 | 38 | | |
41 | 39 | | |
| |||
0 commit comments