Buckets:

glutamatt's picture
download
raw
556 Bytes
{
"custom_metas": null,
"dp": 64,
"metas": {
"consumed_train_samples": 4096000,
"data_stages": [
{
"consumed_tokens_per_dataset_folder": {
"/scratch/joel_niklaus/tmp/finephrase/dataset/article_granite3_1b_hq": 8388608000,
"/scratch/joel_niklaus/tmp/finephrase/dataset/fw_edu_hq": 8388608000
},
"consumed_train_samples": 4096000,
"name": "stable",
"start_training_step": 1
}
],
"last_stage_idx": 0,
"last_train_step": 8000
},
"tp": 1,
"version": "1.4"
}

Xet Storage Details

Size:
556 Bytes
·
Xet hash:
375f420f424d83a64ba6b6a44817a6b6a92fe6babf6a6dfce14cb3a0a3a3ec8a

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.