Feature Extraction
sentence-transformers
ONNX
Safetensors
multilingual
bidirectional_pplx_qwen3
sentence-similarity
mteb
custom_code
text-embeddings-inference
Instructions to use perplexity-ai/pplx-embed-v1-0.6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use perplexity-ai/pplx-embed-v1-0.6b with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("perplexity-ai/pplx-embed-v1-0.6b", trust_remote_code=True) sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
AttributeError: module 'transformers_modules.pplx_hyphen_embed_hyphen_v1_hyphen_0_dot_6b.654137389e247d9f.st_quantize' has no attribute 'FlexibleQuantizer'
#12
by conceptofmind - opened
Hi all,
When trying to use this model, I get the error:
Traceback (most recent call last):
File "/e/project1/reformo/enrico/slurm-st/train.py", line 230, in <module>
main()
File "/e/project1/reformo/enrico/slurm-st/train.py", line 113, in main
model = SentenceTransformer(base_model_path, trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/util/decorators.py", line 41, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/sentence_transformer/model.py", line 183, in __init__
super().__init__(
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 198, in __init__
modules, self.module_kwargs = self._load_modules(
^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 974, in _load_modules
return self._load_config_modules(model_name_or_path, **load_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 1095, in _load_config_modules
module_class: Module = self._load_module_class_from_ref(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/sentence_transformers/base/model.py", line 1309, in _load_module_class_from_ref
return get_class_from_dynamic_module(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 627, in get_class_from_dynamic_module
return get_class_in_module(class_name, final_module, force_reload=force_download)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/e/project1/reformo/enrico/slurm-st/.venv/lib/python3.12/site-packages/transformers/dynamic_module_utils.py", line 311, in get_class_in_module
return getattr(module, class_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'transformers_modules.pplx_hyphen_embed_hyphen_v1_hyphen_0_dot_6b.654137389e247d9f.st_quantize' has no attribute 'FlexibleQuantizer'
Version info:
"accelerate>=1.13.0",
"datasets>=4.8.5",
"sentence-transformers>=5.4.1",
"torch>=2.11.0",
"transformers>=5.8.0",
Any help would be appreciated.
Thank you,
Enrico