Buckets:

glutamatt's picture
download
raw
554 Bytes
{
"custom_metas": null,
"dp": 64,
"metas": {
"consumed_train_samples": 512000,
"data_stages": [
{
"consumed_tokens_per_dataset_folder": {
"/scratch/joel_niklaus/tmp/finephrase/dataset/article_granite3_1b_hq": 1048576000,
"/scratch/joel_niklaus/tmp/finephrase/dataset/fw_edu_hq": 1048576000
},
"consumed_train_samples": 512000,
"name": "stable",
"start_training_step": 1
}
],
"last_stage_idx": 0,
"last_train_step": 1000
},
"tp": 1,
"version": "1.4"
}

Xet Storage Details

Size:
554 Bytes
·
Xet hash:
b93783212a35c340f81e2eca1d920dbfe0ec0874a659c2c4895cdad259844440

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.