File size: 744 Bytes
10197af 8527b54 10197af 8527b54 3082b3a 10197af 8527b54 10197af 8527b54 3082b3a 8527b54 3082b3a 8527b54 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 | ---
title: FastLLM
emoji: ⚡
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: "5.38.0"
python_version: "3.10"
app_file: app.py
pinned: false
---
# ⚡ FastLLM
Chat with FastLLM directly in your browser.
FastLLM is a ~150M parameter decoder-only causal language model created by **devoppro**.
## Model
- Parameters: ~150M
- Architecture: ModernLLMForCausalLM
- Hidden size: 768
- Layers: 12
- Attention: GQA
- Query heads: 12
- KV heads: 4
- MLP: SwiGLU
- Normalization: RMSNorm
- Position encoding: RoPE
- Context length: 2048
- Format: Safetensors
## Model
https://huggingface.co/devoppro/FastLLM
## Runtime
This Space uses Hugging Face Transformers with the model's custom architecture.
No AirLLM or flash-attn is required. |