Buckets:

glutamatt's picture
download
raw
556 Bytes
{
"custom_metas": null,
"dp": 64,
"metas": {
"consumed_train_samples": 2304000,
"data_stages": [
{
"consumed_tokens_per_dataset_folder": {
"/scratch/joel_niklaus/tmp/finephrase/dataset/article_granite3_1b_hq": 4718592000,
"/scratch/joel_niklaus/tmp/finephrase/dataset/fw_edu_hq": 4718592000
},
"consumed_train_samples": 2304000,
"name": "stable",
"start_training_step": 1
}
],
"last_stage_idx": 0,
"last_train_step": 4500
},
"tp": 1,
"version": "1.4"
}

Xet Storage Details

Size:
556 Bytes
·
Xet hash:
42dea14e800c3d494c887beda30ea703a7343a7a835f28a3a35b8521461a77fe

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.