AttributeError: module 'transformers_modules.pplx_hyphen_embed_hyphen_v1_hyphen_0_dot_6b.654137389e247d9f.st_quantize' has no attribute 'FlexibleQuantizer'

#12
by conceptofmind - opened

Hi all,

When trying to use this model, I get the error:

Traceback (most recent call last):
  File "/e/project1/reformo/enrico/slurm-st/train.py", line 230, in <module>
    main()
  File "/e/project1/reformo/enrico/slurm-st/train.py", line 113, in main
    model = SentenceTransformer(base_model_path, trust_remote_code=True)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/util/decorators.py", line 41, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/sentence_transformer/model.py", line 183, in __init__
    super().__init__(
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 198, in __init__
    modules, self.module_kwargs = self._load_modules(
                                  ^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 974, in _load_modules
    return self._load_config_modules(model_name_or_path, **load_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 1095, in _load_config_modules
    module_class: Module = self._load_module_class_from_ref(
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 1309, in _load_module_class_from_ref
    return get_class_from_dynamic_module(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 627, in get_class_from_dynamic_module
    return get_class_in_module(class_name, final_module, force_reload=force_download)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 311, in get_class_in_module
    return getattr(module, class_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'transformers_modules.pplx_hyphen_embed_hyphen_v1_hyphen_0_dot_6b.654137389e247d9f.st_quantize' has no attribute 'FlexibleQuantizer'

Version info:

    "accelerate>=1.13.0",
    "datasets>=4.8.5",
    "sentence-transformers>=5.4.1",
    "torch>=2.11.0",
    "transformers>=5.8.0",

Any help would be appreciated.

Thank you,

Enrico

Sign up or log in to comment