software-mansion/react-native-executorch-lfm2.5-colbert-350m

lfm2.5-colbert-350m

This repository hosts the lfm2.5-colbert-350m models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Upstream model: LFM2.5-ColBERT-350M

Variants

Path	Backend	Precision
mlx/lfm_2_5_colbert_350m_mlx_int4.pte	mlx	int4
xnnpack/lfm_2_5_colbert_350m_xnnpack_8da4w.pte	xnnpack	8da4w

Unshipped backends

A backend directory carrying a NOTES.md and no .pte was exported and not published. Its note records what went wrong.

• coreml (why)

Repository structure

config.json                                     41 B
coreml/NOTES.md                                 1.6 kB
mlx/config.json                                 1.2 kB
mlx/lfm_2_5_colbert_350m_mlx_int4.pte           179 MB
tokenizer.json                                  4.5 MB
tokenizer_config.json                           90.2 kB
xnnpack/config.json                             1.2 kB
xnnpack/lfm_2_5_colbert_350m_xnnpack_8da4w.pte  406 MB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.