prajwal55/slm-125m-ppo
Text Generation • 0.1B • Updated • 295 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
131
Active filters: preference-optimization
tokutsu/japanese-answer-13b-8bit
Updated • 10
HaiZhiYan/CheX-Phi35V
Visual Question Answering • Updated • 2
tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct
Updated • 3
Likhith003/dpo-pairrm-lora-adapter
Text Generation • 1B • Updated • 6 •
Likhith003/dpo-llmjudge-lora-adapter
Text Generation • 1B • Updated • 7 •
jasperyeoh2/mistral-dpo-peft
Updated • 2
loganlin777/mistral-7b-dpo-adapter
Updated
gandhiraketla277/finance-llama-3.1-8b-dpo-trained
Text Generation • Updated • 2
ecoxial2007/CheX-Phi4MM-GRPO
Image-Text-to-Text • 6B • Updated • 19 • 1
vidavox/Qwen3-SKK-32B-DPO
Text Generation • Updated
Nishef/MiniCPM-1B-sft-bf16-Full_KTO_20251225_185339
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_DPO_20251225_130318
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_ENHANCED_KTO_20251225_162818
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_KTO_20251225_102050
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_ORPO_20251225_145426
Text Generation • Updated
Nishef/SmolLM2-360M-Full_DPO_20251225_043457
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ENHANCED_KTO_20251225_074953
Text Generation • Updated
Nishef/SmolLM2-360M-Full_KTO_20251225_020028
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ORPO_20251225_062447
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ENHANCED_KTO_20251225_074953-merged
Text Generation • 0.4B • Updated • 15
Nishef/Qwen3-0.6B-Full_ENHANCED_KTO_20251225_162818-merged
Text Generation • 0.6B • Updated • 22 • 1
Nishef/SmolLM2-360M-Full_KTO_20251225_020028-merged
Text Generation • 0.4B • Updated • 17
Nishef/SmolLM2-360M-Full_DPO_20251225_043457-merged
Text Generation • 0.4B • Updated • 6
Nishef/SmolLM2-360M-Full_ORPO_20251225_062447-merged
Text Generation • 0.4B • Updated • 9
Nishef/Qwen3-0.6B-Full_KTO_20251225_102050-merged
Text Generation • 0.6B • Updated • 10
Nishef/Qwen3-0.6B-Full_DPO_20251225_130318-merged
Text Generation • 0.6B • Updated • 14
Nishef/Qwen3-0.6B-Full_ORPO_20251225_145426-merged
Text Generation • 0.6B • Updated • 11
Nishef/MiniCPM-1B-sft-bf16-Full_KTO_20251225_185339-merged
Text Generation • 1B • Updated • 10
Nishef/SmolLM2-360M-Full_KNOWLEDGE_RETAINING_ENHANCED_KTO_20251227_151509
Text Generation • Updated • 2