Ming

DarrenChen's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in lihongjie007/Qwen3-VL-Embedding-2B-GPTQ-Int4 5 months ago

How do I use this embedding model?

#1 opened 6 months ago by

DarrenChen

New activity in Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice 6 months ago

Slow inference speed

👍 1

#25 opened 6 months ago by

DarrenChen

New activity in MiniMaxAI/MiniMax-M2.1 6 months ago

Loading weigts error when running MiniMax-2.1 with sglang using pipeline parallelism

4

#18 opened 6 months ago by

tuo02

New activity in onnx-community/MobileLLM-R1-140M-ONNX 10 months ago

GroupQueryAttention operation is not supported

1

#1 opened 10 months ago by

DarrenChen

New activity in facebook/MobileLLM-R1-140M 10 months ago

ONNX on mobile

#1 opened 10 months ago by

DarrenChen

New activity in Tiiny/SmallThinker-21BA3B-Instruct 10 months ago

Are there any other frameworks tested besides transformers that can be deployed?

3

#5 opened 12 months ago by

DarrenChen

New activity in fastllm/DeepSeek-R1-0528-INT4MIX about 1 year ago

How did you do it?May I ask what quantization method is being used?

#1 opened about 1 year ago by

DarrenChen

New activity in fastllm/Qwen3-235B-A22B-INT4MIX about 1 year ago

How was this made? Quant configuration? Have you deployed this with SGLANG or vllm ?

1

#1 opened about 1 year ago by

chriswritescode