File size: 744 Bytes
10197af
8527b54
10197af
8527b54
3082b3a
10197af
8527b54
 
10197af
 
 
 
8527b54
3082b3a
8527b54
3082b3a
8527b54
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
title: FastLLM
emoji: 
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: "5.38.0"
python_version: "3.10"
app_file: app.py
pinned: false
---

# ⚡ FastLLM

Chat with FastLLM directly in your browser.

FastLLM is a ~150M parameter decoder-only causal language model created by **devoppro**.

## Model

- Parameters: ~150M
- Architecture: ModernLLMForCausalLM
- Hidden size: 768
- Layers: 12
- Attention: GQA
- Query heads: 12
- KV heads: 4
- MLP: SwiGLU
- Normalization: RMSNorm
- Position encoding: RoPE
- Context length: 2048
- Format: Safetensors

## Model

https://huggingface.co/devoppro/FastLLM

## Runtime

This Space uses Hugging Face Transformers with the model's custom architecture.

No AirLLM or flash-attn is required.