Introduction

This repository hosts the LFM2.5-VL-1.6B vision-language model for the React Native ExecuTorch library. It includes a quantized version in .pte format, ready for use in the ExecuTorch runtime.

If you'd like to run these models in your own ExecuTorch runtime, refer to the official documentation for setup instructions.

Compatibility

If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the ExecuTorch version used to export the .pte files. For more details, see the compatibility note in the ExecuTorch GitHub repository. If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with the runtime used behind the scenes.

Repository Structure

The repository is organized as follows:

  • The .pte file should be passed to the modelSource parameter.
  • The tokenizer files are available in the repo root: tokenizer.json and tokenizer_config.json should be passed to tokenizerSource and tokenizerConfigSource respectively.
Downloads last month
87
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including software-mansion/react-native-executorch-lfm2.5-VL-1.6B