Haiku-base / validation.json
kerzgrr's picture
Upload Haiku-base (pretrain EMA @ step 8400)
fba158e verified
Raw
History Blame Contribute Delete
505 Bytes
{
"checkpoint": "checkpoint-00008400",
"ema": {
"batches": 16,
"elapsed_seconds": 7.330645765992813,
"loss": 3.6904296875,
"perplexity": 40.06205742476025,
"tokens": 524288,
"tokens_per_second": 71520.02930385683
},
"normal": {
"batches": 16,
"elapsed_seconds": 7.311252611019881,
"loss": 3.736328125,
"perplexity": 41.943695056893915,
"tokens": 524288,
"tokens_per_second": 71709.73674329993
},
"optimizer_step": 8400,
"type": "validation"
}