5.69 MB

Ctrl+K

1 contributor

History: 1 commit

hidude562

1bitllm code (checkpoints to follow)

4754707 verified 6 days ago

attention_arcs_layer8.png

376 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_consensus_layer8.png

74.8 kB
1bitllm code (checkpoints to follow) 6 days ago
attention_per_head_layer0_step60k.png

485 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_per_head_layer12_step60k.png

488 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_per_head_layer15_step60k.png

479 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_per_head_layer4_step60k.png

502 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_per_head_layer8.png

494 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_per_head_layer8_step60k.png

503 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_top4_layer12.png

381 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_top4_layer4.png

396 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
attention_top4_layer8.png

385 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
fig1_75M_vs_300M.png

254 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
fig2_induction_heads.png

64.8 kB
1bitllm code (checkpoints to follow) 6 days ago
fig3_slope_vs_utilization.png

72.5 kB
1bitllm code (checkpoints to follow) 6 days ago
fig4_per_token_fan.png

119 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
fig5_layer_evolution.png

339 kB
xet

1bitllm code (checkpoints to follow) 6 days ago
fig7_per_token_loss.png

48.3 kB
1bitllm code (checkpoints to follow) 6 days ago
fig8_loss_curve.png

88.2 kB
1bitllm code (checkpoints to follow) 6 days ago
fig9_compression.png

85.3 kB
1bitllm code (checkpoints to follow) 6 days ago
head_specialization_grid.png

52.3 kB
1bitllm code (checkpoints to follow) 6 days ago