Skip to content

Conversation

@ZX-ModelCloud
Copy link
Collaborator

No description provided.

@ZX-ModelCloud ZX-ModelCloud changed the title [REFACTOR] add SUPPORT_DEVICES [REFACTOR] add SUPPORTED_DEVICES Jul 5, 2024
@ZX-ModelCloud ZX-ModelCloud changed the title [REFACTOR] add SUPPORTED_DEVICES [FEATURE] BaseQuantLinear add SUPPORTED_DEVICES Jul 5, 2024
@Qubitium Qubitium merged commit 6c35fd8 into ModelCloud:main Jul 5, 2024
DeJoker pushed a commit to DeJoker/GPTQModel that referenced this pull request Jul 19, 2024
* Check QuantLinear Device

* cleanup

* REFRACTOR check_cuda by introducing SUPPORTED_DEVICE into BaseQuantLinear

* make device type cuda/cpu an enum

* cleanup

* cleanup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants