multi-qa-mpnet-base-dot-v1

This repository hosts the multi-qa-mpnet-base-dot-v1 models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Upstream model: multi-qa-mpnet-base-dot-v1

Variants

Path Backend Precision
vulkan/multi_qa_mpnet_base_dot_v1_vulkan_fp16.pte vulkan fp16
vulkan/multi_qa_mpnet_base_dot_v1_vulkan_int8.pte vulkan int8
xnnpack/multi_qa_mpnet_base_dot_v1_xnnpack_fp32.pte xnnpack fp32

Repository structure

config.json                                          48 B
tokenizer.json                                       694 kB
tokenizer_config.json                                363 B
vulkan/config.json                                   1.6 kB
vulkan/multi_qa_mpnet_base_dot_v1_vulkan_fp16.pte    208 MB
vulkan/multi_qa_mpnet_base_dot_v1_vulkan_int8.pte    127 MB
xnnpack/config.json                                  951 B
xnnpack/multi_qa_mpnet_base_dot_v1_xnnpack_fp32.pte  416 MB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.

Downloads last month
297
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including software-mansion/react-native-executorch-multi-qa-mpnet-base-dot-v1