How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "RyeAI/STD-BPE-LLAMA3.2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "RyeAI/STD-BPE-LLAMA3.2",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'
Use Docker
docker model run hf.co/RyeAI/STD-BPE-LLAMA3.2
Quick Links

STD-BPE-LLAMA3.2

A standard LLaMA-3.2 model trained with a pretrained Byte-Pair-Encoding (BPE) tokenizer. It provides a benchmark for evaluating the performance of more advanced tokenization approaches.

Downloads last month
3
Safetensors
Model size
1B params
Tensor type
F16
·
Inference Providers NEW

Collection including RyeAI/STD-BPE-LLAMA3.2