Skip to content

[BUG] lm-eval should be optional #664

@Qubitium

Description

@Qubitium

@CSY-ModelCloud Fix this:

Traceback (most recent call last):
  File "/root/GPTQModel-LRL/examples/benchmark/ipex.py", line 6, in <module>
    from gptqmodel import GPTQModel, BACKEND
  File "/root/miniconda3/lib/python3.11/site-packages/gptqmodel/__init__.py", line 1, in <module>
    from .models import GPTQModel
  File "/root/miniconda3/lib/python3.11/site-packages/gptqmodel/models/__init__.py", line 1, in <module>
    from .auto import MODEL_MAP, GPTQModel
  File "/root/miniconda3/lib/python3.11/site-packages/gptqmodel/models/auto.py", line 14, in <module>
    from .base import BaseGPTQModel, QuantizeConfig
  File "/root/miniconda3/lib/python3.11/site-packages/gptqmodel/models/base.py", line 8, in <module>
    import lm_eval

Metadata

Metadata

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions