How to use from the
Use from the
PEFT library
from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0")
model = PeftModel.from_pretrained(base_model, "arif-butt/tinyllama-trl-lora-adapter")

Not-For-All-Audiences

This repository has been marked as containing sensitive content and may contain potentially harmful and sensitive information.

View model card