Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

RelaxingSnorlax updated a model 2 days ago

inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-online-500k

RelaxingSnorlax published a model 2 days ago

inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-online-500k

kylesayrs updated a collection 2 days ago

View all activity

inference-optimization 's models 186

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq

5B • Updated Apr 22 • 2

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

2B • Updated Apr 20 • 2

inference-optimization/llama3-8b-sharegpt-5k-gen

inference-optimization/Llama-3.2-3B-Instruct-FP8-Block

3B • Updated Apr 7 • 5

inference-optimization/Llama-3.2-1B-Instruct-FP8-Block

1B • Updated Apr 7 • 4

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3

0.9B • Updated Apr 1 • 4

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt4-speculator.eagle3

0.9B • Updated Apr 1 • 4 • 1

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt3-speculator.eagle3

0.9B • Updated Mar 31 • 3

inference-optimization/gpt-oss-120b-from-self-ckpt5-speculator.eagle3

0.9B • Updated Mar 25 • 5

inference-optimization/gpt-oss-120b-from-self-ckpt3-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-self-ckpt4-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-self-ckpt2-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-self-ckpt1-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-self-ckpt0-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/Qwen3-Next-80B-A3B-Instruct-GSM8K-MTP-finetuned

81B • Updated Mar 25 • 8

inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator_new

2B • Updated Mar 25 • 7

inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt3

0.5B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt3-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt1-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt0-speculator.eagle3

0.9B • Updated Mar 25 • 4

inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt2

0.5B • Updated Mar 25 • 3

inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt1

0.5B • Updated Mar 25 • 3

inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt5

2B • Updated Mar 25 • 3

inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt5

0.5B • Updated Mar 24 • 7

inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt4

2B • Updated Mar 24 • 5

inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt3

2B • Updated Mar 24 • 3

inference-optimization/Qwen3-30B-from-self-speculators.eagle3-ckpt1

0.5B • Updated Mar 24 • 3

inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt2

2B • Updated Mar 24 • 4

inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt1

2B • Updated Mar 24 • 4

inference-optimization/Qwen3-32B-from-self-speculators.eagle3-ckpt0

2B • Updated Mar 24 • 4