How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ewqr2130/moe_scratch")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ewqr2130/moe_scratch")
model = AutoModelForCausalLM.from_pretrained("ewqr2130/moe_scratch")
Quick Links

run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh

run_mistral_dpo_moe_from_init_checkpoint.sh run_mistral_dpo_moe_from_init_checkpoint.sh

Downloads last month
4
Safetensors
Model size
47B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support