Image-Text-to-Text
Transformers.js
ONNX
florence2
vision
text-generation
text2text-generation
image-to-text
Instructions to use onnx-community/Florence-2-large-ft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/Florence-2-large-ft with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('image-text-to-text', 'onnx-community/Florence-2-large-ft');
decoder_model_merged invalid model error for FP16 and Q4F16
#7
by selimarikan - opened
Hi, thanks for providing tons of quants and models here, much appreciated!
For fp32 everything is working great.
However, when I try to load decoder_model_merged_fp16 or decoder_model_merged_q4f16 I am getting the following error:
[ONNXRuntimeError] : 1 : FAIL : Load model from .. failed:/onnxruntime_src/onnxruntime/core/graph/graph.cc:1489 void onnxruntime::Graph::InitializeStateFromModelFileGraphProto()
This is an invalid model. Subgraph output (logits) is an outer scope value being returned directly.
Please update the model to add an Identity node between the outer scope value and the subgraph output.