OpenSourceRonin's picture

27 4 9

OpenSourceRonin

OpenSourceRonin

·

AI & ML interests

None yet

Organizations

New activity in VPTQ-community/README 6 months ago

using VPTQ for my own models

#3 opened 6 months ago by

New activity in deepseek-ai/DeepSeek-V3-0324 10 months ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened 10 months ago by

New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft 10 months ago

Use aphrodite-engine to infer this model error

#2 opened 10 months ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256_mp4 10 months ago

Create README.md

#1 opened 10 months ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256 10 months ago

Create README.md

#1 opened 10 months ago by

New activity in VPTQ-community/deepseek-r1_v8_k_65536_mp4 10 months ago

Create README.md

#1 opened 10 months ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_mixed_mp4 10 months ago

Create README.md

#1 opened 10 months ago by

New activity in VPTQ-community/deepseek-r1_v_8_k_65536 10 months ago

Create README.md

#1 opened 10 months ago by

New activity in VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-32768-woft 11 months ago

not run

#1 opened about 1 year ago by

New activity in opensourcerelease/DeepSeek-V3-bf16 12 months ago

Please do R1

#7 opened about 1 year ago by

New activity in OpenSourceRonin/VPTQ_demo about 1 year ago

ghg

#1 opened about 1 year ago by

New activity in opensourcerelease/DeepSeek-V3-bf16 about 1 year ago

Remove quantization from config.json

#4 opened about 1 year ago by

AdjectiveAllison

Tokenizer config?

#2 opened about 1 year ago by

some configs is miss

#1 opened about 1 year ago by

New activity in deepseek-ai/DeepSeek-V3 about 1 year ago

Bug in fp8_cast_bf16.py

#4 opened about 1 year ago by

New activity in opensourcerelease/DeepSeek-V3-Base-bf16 about 1 year ago

Files?

#1 opened about 1 year ago by

New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft about 1 year ago

not run

#1 opened about 1 year ago by

New activity in VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-65536-woft about 1 year ago

How do you use / load these models?

#1 opened about 1 year ago by

New activity in VPTQ-community/README over 1 year ago

Can you start a Space with Qwen2.5 14b?

#2 opened over 1 year ago by

New activity in VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-256-woft over 1 year ago

V8 vs V16?

#1 opened over 1 year ago by