| --- |
| title: FastLLM |
| emoji: ⚡ |
| colorFrom: blue |
| colorTo: purple |
| sdk: gradio |
| sdk_version: "5.38.0" |
| python_version: "3.10" |
| app_file: app.py |
| pinned: false |
| --- |
| |
| # ⚡ FastLLM |
|
|
| Chat with FastLLM directly in your browser. |
|
|
| FastLLM is a ~150M parameter decoder-only causal language model created by **devoppro**. |
|
|
| ## Model |
|
|
| - Parameters: ~150M |
| - Architecture: ModernLLMForCausalLM |
| - Hidden size: 768 |
| - Layers: 12 |
| - Attention: GQA |
| - Query heads: 12 |
| - KV heads: 4 |
| - MLP: SwiGLU |
| - Normalization: RMSNorm |
| - Position encoding: RoPE |
| - Context length: 2048 |
| - Format: Safetensors |
|
|
| ## Model |
|
|
| https://huggingface.co/devoppro/FastLLM |
|
|
| ## Runtime |
|
|
| This Space uses Hugging Face Transformers with the model's custom architecture. |
|
|
| No AirLLM or flash-attn is required. |
