Instructions to use fals3/bigcode-starcoder2-3b-unit-test-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use fals3/bigcode-starcoder2-3b-unit-test-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigcode/starcoder2-3b") model = PeftModel.from_pretrained(base_model, "fals3/bigcode-starcoder2-3b-unit-test-lora") - Notebooks
- Google Colab
- Kaggle
| { | |
| "epoch": 2.99835255354201, | |
| "eval_accuracy": 0.7199034201039461, | |
| "eval_loss": 0.7310884594917297, | |
| "eval_runtime": 39.4969, | |
| "eval_samples": 931, | |
| "eval_samples_per_second": 23.571, | |
| "eval_steps_per_second": 11.798, | |
| "perplexity": 2.0773404785234737, | |
| "total_flos": 1.9088629453081805e+17, | |
| "train_loss": 1.0000693833434975, | |
| "train_runtime": 2797.1733, | |
| "train_samples": 7283, | |
| "train_samples_per_second": 7.811, | |
| "train_steps_per_second": 0.488 | |
| } |