Cactus-Compute
/

gemma4-e2b-grouped-k192-router

Mixture of Experts

grouped-experts

Model card Files Files and versions

gemma4-e2b-grouped-k192-router

Ctrl+K

Ctrl+K

1 contributor

History: 46 commits

ncylich's picture

Upload gemma4.py with huggingface_hub

0f6a12b verified 18 days ago

groups
Upload groups/s50_K192_layer9.pt with huggingface_hub 18 days ago
.gitattributes

1.52 kB
initial commit 18 days ago
README.md

5.17 kB
Upload README.md with huggingface_hub 18 days ago
Sw_grouped_50_K192_router_v27_lora256.pt
Detected Pickle imports (5)
- "torch.FloatStorage",
- "torch.LongStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
11 GB
xet

Upload Sw_grouped_50_K192_router_v27_lora256.pt with huggingface_hub 18 days ago
gemma4.py

27.2 kB
Upload gemma4.py with huggingface_hub 18 days ago
gemma4_hf.py

2.14 kB
Upload gemma4_hf.py with huggingface_hub 18 days ago
inference_router_k192.py

10.6 kB
Upload inference_router_k192.py with huggingface_hub 18 days ago
rung6_moe_g4.py

73.9 kB
Upload rung6_moe_g4.py with huggingface_hub 18 days ago
rung7_swiglu_g4.py

18.3 kB
Upload rung7_swiglu_g4.py with huggingface_hub 18 days ago
rung8_grouped_g4.py

28.2 kB
Upload rung8_grouped_g4.py with huggingface_hub 18 days ago
rung9_polish.py

13.5 kB
Upload rung9_polish.py with huggingface_hub 18 days ago
rung9_router.py

42.7 kB
Upload rung9_router.py with huggingface_hub 18 days ago