Configuration Parsing Warning:Config file config.json cannot be fetched (too big)

Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

Fine-tuned Qwen3-32B on Bespoke-Stratos-17k

This model is a fine-tuned version of Qwen/Qwen3-32B on the Bespoke-Stratos-17k dataset.

Training Procedure

Hardware

The model was trained on a cluster of 4 x NVIDIA H100 80G GPUs.

Training Time

The total training time was approximately 32 hours and 20 minutes.

Training Hyperparameters

The model was trained using the SFTTrainer from the TRL library, in conjunction with DeepSpeed ZeRO-3 for efficient, distributed training.

The key hyperparameters used during training are listed below:

Hyperparameter	Value	Description
Model
`base_model`	`Qwen/Qwen3-32B`	The foundational model that was fine-tuned.
`max_seq_length`	`16384`	Maximum sequence length processed by the model.
Training Strategy
`num_train_epochs`	`3.0`	The total number of training epochs.
`per_device_train_batch_size`	`1`	Batch size per GPU.
`gradient_accumulation_steps`	`24`	Number of steps to accumulate gradients before an optimizer step.
Effective Batch Size	96	`(4 GPUs * 1 bs/gpu * 24 accum)`
Optimizer & Scheduler
`optimizer`	`AdamW`	As configured in the DeepSpeed config.
`learning_rate`	`1e-5`	The peak learning rate.
`lr_scheduler_type`	`cosine`	Learning rate scheduler with a cosine decay.
`warmup_ratio`	`0.1`	Proportion of training steps for the learning rate warmup.
Precision & Performance
`bf16`	`True`	Used bfloat16 for mixed-precision training.
`tf32`	`True`	Allowed the use of TensorFloat-32 on supported hardware.
`gradient_checkpointing`	`True`	Enabled to reduce memory consumption.
`distributed_type`	`DeepSpeed ZeRO-3`	Distributed training framework and stage.

Framework Versions

Transformers: 4.51.1
Pytorch: 2.6.0+cu124
Datasets: 3.2.0
Tokenizers: 0.21.4
DeepSpeed: 0.15.4

License

This model and its source code are released under the Apache 2.0 License.

Data Format Example

Understanding the data format used for fine-tuning is crucial for effectively using this model. Here is a concrete example of a single training instance.

The raw input_ids and labels for a sample are as follows:

input_ids: a = [151644, 8948, 198, 7771, 3476, 438, 458, 17847, 17601, 26364, 23966, 4755, 1526, 264, 36438, 1293, 7274, 1882, 1573, 8241, 279, 1590, 23560, 323, 13382, 9904, 13, 1096, 7460, 22570, 304, 264, 15817, 10775, 315, 6358, 11, 28285, 4849, 11, 26403, 11, 31734, 23391, 11, 21844, 11, 1182, 376, 4527, 11, 323, 19569, 311, 2225, 1632, 12, 24712, 291, 7274, 1882, 13, 5209, 5944, 697, 2033, 1119, 1378, 1887, 14158, 25, 35187, 323, 12478, 13, 758, 279, 35187, 3772, 11, 7716, 697, 32711, 1882, 1667, 279, 5189, 3561, 25, 82639, 7265, 3575, 5854, 2450, 91, 29, 314, 60565, 448, 7354, 18663, 448, 5196, 77, 1699, 8275, 82639, 408, 3575, 5854, 2450, 91, 29, 8886, 3019, 1265, 2924, 11682, 37764, 1741, 438, 3181, 285, 7024, 4755, 11, 28285, 4849, 9760, 14613, 11, 86781, 287, 501, 6708, 11, 68863, 279, 13403, 315, 279, 1482, 7354, 11, 73185, 894, 5975, 11, 323, 17493, 5853, 3681, 7354, 13, 758, 279, 12478, 3772, 11, 3118, 389, 5257, 13553, 11, 47439, 804, 11, 323, 62751, 504, 279, 35187, 3772, 11, 59726, 3042, 279, 1590, 6291, 429, 498, 81477, 4396, 13, 576, 6291, 1265, 7146, 264, 19819, 11, 13382, 11, 63594, 7493, 1707, 323, 7716, 5871, 3019, 4362, 311, 5545, 279, 16688, 11, 23126, 438, 11017, 25, 82639, 7265, 3575, 50274, 91, 29, 314, 11822, 23126, 11, 23560, 11, 323, 2797, 6291, 92, 82639, 408, 3575, 50274, 91, 29, 4695, 11, 1430, 311, 11625, 279, 2701, 3405, 1526, 279, 3403, 17501, 25, 151645, 198, 151644, 872, 198, 31115, 458, 32156, 13027, 729, 7907, 504, 279, 2661, 9934, 13, 576, 729, 1265, 1896, 31369, 438, 1946, 323, 1173, 279, 2550, 13, 28424, 1618, 279, 729, 1283, 279, 7271, 72672, 11, 44856, 60436, 374, 2661, 308, 65623, 389, 264, 220, 16, 15, 15, 15, 553, 220, 16, 15, 15, 15, 5827, 13, 11733, 6978, 323, 8147, 315, 279, 5827, 525, 48826, 504, 220, 16, 311, 220, 16, 15, 15, 15, 13, 61706, 525, 48826, 504, 1909, 311, 5622, 11, 1393, 8147, 525, 48826, 504, 2115, 311, 1290, 382, 54, 295, 60436, 15482, 429, 1378, 65623, 3359, 1817, 1008, 421, 807, 4332, 279, 1852, 37236, 13, 7036, 11, 429, 419, 374, 279, 1172, 12890, 11, 773, 1378, 65623, 1231, 3359, 1817, 1008, 320, 73846, 311, 44856, 60436, 8, 1496, 421, 1052, 374, 2441, 53206, 7407, 1948, 1105, 13, 4695, 44856, 60436, 6801, 311, 1760, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 4192, 15081, 2505, 70674, 785, 1156, 1555, 315, 279, 1946, 5610, 308, 320, 16, 37294, 308, 37294, 220, 17, 15, 15, 220, 15, 15, 15, 8, 4102, 2293, 279, 1372, 315, 65623, 382, 4854, 315, 1790, 308, 5128, 5610, 1378, 3550, 18663, 25780, 856, 15159, 72, 92, 323, 379, 15159, 72, 92, 320, 16, 37294, 856, 15159, 72, 2137, 379, 15159, 72, 92, 37294, 220, 16, 15, 15, 15, 8, 4102, 2293, 279, 1372, 315, 2802, 323, 279, 1372, 315, 3250, 1380, 600, 7563, 53206, 374, 34228, 13, 1084, 594, 19323, 429, 902, 1378, 65623, 4332, 279, 1852, 2309, 4192, 15081, 5097, 70674, 5097, 825, 7546, 4102, 2293, 279, 1372, 315, 13530, 315, 65623, 892, 3359, 1817, 1008, 13, 14731, 15081, 40381, 34764, 2505, 198, 20, 198, 16, 220, 16, 198, 16, 220, 20, 198, 18, 220, 18, 198, 20, 220, 16, 198, 20, 220, 20, 271, 5097, 198, 21, 271, 2505, 198, 18, 198, 16, 220, 16, 198, 17, 220, 18, 198, 18, 220, 20, 271, 5097, 198, 15, 1022, 15081, 9112, 70674, 641, 279, 1156, 6077, 2701, 13530, 315, 65623, 3359, 1817, 1008, 25, 320, 16, 11, 220, 18, 701, 320, 16, 11, 220, 20, 701, 320, 17, 11, 220, 18, 701, 320, 17, 11, 220, 19, 701, 320, 18, 11, 220, 19, 8, 323, 320, 18, 11, 220, 20, 568, 393, 4720, 320, 16, 11, 220, 17, 701, 320, 16, 11, 220, 19, 701, 320, 17, 11, 220, 20, 8, 323, 320, 19, 11, 220, 20, 8, 653, 537, 3359, 1817, 1008, 1576, 807, 653, 537, 4332, 279, 1852, 37236, 624, 151645, 198, 151644, 77091, 198, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 1490, 13, 576, 3491, 374, 311, 1760, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 421, 807, 525, 389, 279, 1852, 37236, 13, 2055, 1817, 37236, 646, 16792, 1045, 13530, 11, 323, 279, 2790, 374, 279, 2629, 916, 678, 84018, 1127, 315, 279, 10601, 315, 65623, 304, 429, 37236, 4429, 1378, 518, 264, 882, 382, 5338, 11, 358, 1184, 311, 7071, 700, 1246, 311, 1874, 279, 65623, 1119, 862, 19511, 84018, 1127, 13, 2619, 525, 1378, 4494, 315, 84018, 1127, 25, 279, 6174, 429, 30232, 504, 1909, 7950, 311, 5622, 6701, 320, 1149, 594, 1618, 1105, 6785, 84018, 1127, 701, 323, 279, 6174, 429, 30232, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 84018, 1127, 3593, 2461, 264, 6785, 37236, 11, 279, 1376, 374, 856, 481, 379, 13, 9211, 3156, 1741, 264, 37236, 11, 279, 6672, 856, 481, 379, 8458, 6783, 13, 1752, 3110, 11, 320, 16, 11, 16, 8, 702, 856, 12034, 28, 15, 11, 320, 17, 11, 17, 8, 1083, 220, 15, 11, 4992, 13, 2055, 678, 65623, 389, 279, 1852, 6785, 37236, 686, 614, 279, 1852, 856, 12034, 897, 382, 2461, 279, 8225, 84018, 1127, 11, 279, 2629, 856, 488, 379, 374, 6783, 13, 8909, 320, 16, 11, 20, 8, 323, 320, 17, 11, 19, 8, 2176, 2629, 311, 220, 21, 13, 2055, 65623, 389, 279, 1852, 8225, 37236, 686, 614, 279, 1852, 856, 43010, 382, 4416, 279, 3119, 374, 1447, 16, 13, 1752, 1817, 53206, 11, 12564, 2176, 856, 12034, 323, 856, 43010, 624, 17, 13, 1752, 1817, 315, 1493, 1378, 2750, 11, 1874, 279, 65623, 553, 1105, 624, 18, 13, 1752, 1817, 1874, 448, 595, 65623, 11, 912, 595, 6599, 74, 12, 16, 5620, 17, 311, 279, 2790, 1760, 13, 9211, 1817, 6716, 304, 279, 1874, 42972, 311, 279, 2790, 382, 14190, 11, 1290, 13, 9211, 369, 894, 1874, 315, 1379, 595, 11, 279, 1372, 315, 13530, 374, 356, 5969, 11, 17, 8, 892, 374, 595, 6599, 74, 12, 16, 5620, 17, 382, 4416, 279, 7354, 525, 1447, 12, 54340, 916, 678, 65623, 624, 12, 1752, 1817, 11, 11047, 279, 1378, 6894, 25, 856, 12034, 323, 856, 43010, 624, 12, 5443, 57514, 311, 1760, 279, 1372, 315, 65623, 304, 1817, 37236, 320, 21028, 6785, 323, 8225, 4292, 12, 5005, 11, 369, 1817, 1760, 304, 279, 57514, 11, 12564, 279, 27459, 323, 2629, 1105, 678, 382, 14190, 11, 714, 279, 3491, 5302, 429, 1378, 65623, 3359, 1817, 1008, 421, 807, 4332, 279, 1852, 37236, 13, 1988, 1817, 53206, 374, 949, 315, 1378, 84018, 1127, 320, 30487, 323, 8225, 568, 4354, 11, 1378, 65623, 646, 1172, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 6785, 37236, 2726, 279, 1852, 8225, 37236, 13, 2055, 1817, 6716, 374, 29994, 3055, 421, 807, 4332, 2987, 315, 279, 1378, 84018, 1127, 382, 3983, 1246, 653, 582, 5648, 1990, 26580, 287, 30, 1752, 3110, 11, 1378, 65623, 1410, 387, 389, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 1988, 429, 594, 11997, 7241, 807, 525, 279, 1852, 1459, 11, 892, 4436, 944, 5420, 1588, 13, 9211, 421, 1378, 65623, 525, 389, 279, 1852, 856, 12034, 323, 1852, 856, 43010, 11, 1221, 21828, 856, 16, 488, 379, 16, 284, 856, 17, 488, 379, 17, 323, 856, 16, 481, 379, 16, 284, 856, 17, 481, 379, 17, 1035, 2968, 856, 16, 284, 856, 17, 323, 379, 16, 284, 379, 17, 11, 892, 646, 944, 3537, 2474, 279, 9892, 525, 4911, 13, 2055, 902, 1378, 65623, 646, 387, 389, 2176, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 2055, 369, 1817, 6716, 315, 65623, 11, 807, 525, 29994, 2987, 3055, 320, 333, 807, 4332, 2987, 6785, 476, 8225, 37236, 8, 476, 537, 518, 678, 13, 15277, 11, 279, 2629, 315, 279, 27459, 504, 2176, 6785, 323, 8225, 84018, 1127, 686, 2968, 279, 4396, 2790, 382, 4416, 279, 5486, 374, 4396, 13, 2055, 1431, 11, 279, 2038, 7354, 1447, 4418, 308, 382, 12209, 369, 1817, 315, 279, 308, 65623, 11, 1349, 856, 5318, 323, 379, 5318, 382, 46254, 369, 1817, 53206, 1447, 1242, 61304, 284, 856, 488, 379, 198, 13490, 61304, 284, 856, 481, 379, 271, 1654, 1184, 311, 3754, 279, 1372, 315, 65623, 304, 1817, 2629, 61304, 323, 1817, 3638, 61304, 382, 4416, 1378, 57514, 25, 825, 369, 36398, 11, 825, 369, 86947, 382, 12209, 11, 369, 1817, 1376, 304, 36398, 11, 912, 356, 11512, 11, 220, 17, 8, 311, 279, 2790, 382, 19198, 369, 279, 86947, 382, 4416, 279, 2038, 686, 387, 1447, 9928, 2629, 25977, 323, 3638, 25977, 438, 1638, 97599, 320, 269, 5792, 97599, 11, 17271, 311, 220, 15, 3593, 2461, 1817, 856, 11, 379, 1447, 1242, 3097, 284, 856, 488, 379, 271, 13490, 3097, 284, 856, 481, 379, 271, 1242, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 271, 13490, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 271, 12209, 11, 2790, 284, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 2629, 25977, 10656, 368, 873, 488, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 3638, 25977, 10656, 368, 5125, 4792, 594, 279, 4226, 382, 3983, 2474, 308, 646, 387, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 11, 323, 369, 1817, 315, 1105, 582, 1882, 1378, 57514, 11, 419, 1265, 387, 11050, 3322, 13, 9211, 1496, 448, 220, 17, 15, 15, 11, 15, 15, 15, 10695, 11, 279, 57514, 646, 3705, 429, 13, 1597, 279, 2629, 374, 506, 1255, 701, 1380, 296, 374, 279, 1372, 315, 6894, 304, 1817, 10997, 11, 892, 374, 518, 1429, 220, 17, 15, 15, 11, 15, 15, 15, 353, 220, 17, 304, 279, 11785, 1142, 11, 892, 374, 70028, 382, 16451, 279, 1156, 3110, 1447, 2505, 220, 20, 1447, 45793, 525, 320, 16, 11, 16, 701, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 701, 320, 20, 11, 20, 3593, 22464, 518, 2629, 61304, 1447, 7, 16, 10, 16, 11730, 17, 11, 320, 16, 10, 20, 11730, 21, 11, 320, 18, 10, 18, 11730, 21, 11, 320, 20, 10, 16, 11730, 21, 11, 320, 20, 10, 20, 11730, 16, 15, 382, 4416, 2629, 25977, 1447, 17, 25, 220, 16, 271, 21, 25, 220, 18, 320, 27436, 220, 16, 11, 20, 26, 220, 18, 11, 18, 26, 20, 11, 16, 57777, 14190, 3783, 11, 320, 16, 11, 20, 8, 2629, 374, 220, 21, 11, 320, 18, 11, 18, 8, 2629, 374, 220, 21, 11, 320, 20, 11, 16, 8, 2629, 374, 220, 21, 13, 2055, 2629, 220, 21, 702, 1760, 220, 18, 382, 12209, 11, 2629, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 785, 1008, 2629, 14579, 525, 220, 17, 25, 16, 11, 220, 16, 15, 25, 16, 13, 2055, 2629, 18527, 374, 220, 18, 382, 2461, 279, 3638, 61304, 1447, 7, 16, 12, 16, 11730, 15, 11, 320, 16, 12, 20, 8, 10829, 19, 11, 320, 18, 12, 18, 11730, 15, 11, 320, 20, 12, 16, 11730, 19, 11, 320, 20, 12, 20, 11730, 15, 382, 13490, 25977, 1447, 15, 25, 18, 320, 27436, 220, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 692, 12, 19, 25, 16, 271, 19, 25, 16, 382, 4416, 3638, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 4416, 2790, 2629, 374, 220, 18, 320, 1242, 8, 488, 220, 18, 320, 13490, 8, 284, 220, 21, 13, 15920, 9071, 279, 1156, 3110, 594, 2550, 382, 9454, 11, 429, 594, 4396, 382, 14037, 3110, 1447, 2505, 220, 18, 1447, 7, 16, 11, 16, 701, 320, 17, 11, 18, 701, 320, 18, 11, 20, 3593, 1242, 61304, 1447, 16, 10, 16, 28, 17, 320, 1830, 220, 16, 692, 17, 10, 18, 28, 20, 320, 1830, 220, 16, 692, 18, 10, 20, 28, 23, 320, 1830, 220, 16, 568, 8116, 18527, 220, 15, 382, 13490, 61304, 1447, 16, 12, 16, 28, 15, 320, 1830, 16, 692, 17, 12, 18, 284, 481, 16, 320, 1830, 16, 692, 18, 12, 20, 284, 481, 17, 320, 1830, 16, 568, 2055, 3638, 18527, 220, 15, 382, 7595, 220, 15, 13, 39970, 382, 4416, 279, 2038, 1265, 975, 382, 7039, 11, 10822, 419, 304, 13027, 382, 785, 2038, 1265, 1349, 504, 31369, 13, 5005, 11, 12564, 279, 2629, 323, 3638, 14579, 382, 62980, 438, 1447, 4418, 308, 382, 1242, 25977, 284, 42908, 1548, 692, 13490, 25977, 284, 42908, 1548, 692, 1958, 716, 304, 2088, 1445, 7731, 262, 856, 11, 379, 284, 2415, 1548, 11, 1946, 1005, 6960, 12367, 262, 274, 284, 856, 488, 379, 271, 262, 294, 284, 856, 481, 379, 271, 262, 2629, 25977, 11880, 60, 1421, 220, 16, 271, 262, 3638, 25977, 21427, 60, 1421, 220, 16, 271, 5035, 284, 220, 15, 271, 1958, 272, 304, 2629, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1958, 272, 304, 3638, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1350, 22842, 692, 9454, 11, 429, 594, 30339, 382, 16451, 448, 279, 1156, 3110, 1447, 1242, 25977, 369, 220, 21, 374, 220, 18, 320, 1499, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 4579, 2055, 220, 18, 9, 17, 14, 17, 284, 18, 382, 13490, 25977, 369, 220, 15, 374, 220, 18, 320, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 8, 11397, 220, 18, 13, 2055, 2790, 220, 21, 382, 14037, 3110, 11, 438, 1573, 382, 3983, 279, 2038, 15804, 504, 31369, 13, 2055, 279, 729, 1265, 387, 5326, 311, 1349, 11127, 11, 1882, 11, 323, 2550, 382, 3983, 279, 3491, 2727, 311, 6923, 458, 32156, 13027, 729, 429, 15804, 31369, 323, 23473, 279, 2550, 382, 4416, 279, 2038, 1035, 387, 1447, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 1173, 22842, 692, 3817, 2822, 3983, 304, 279, 3491, 5114, 11, 279, 729, 1265, 387, 2598, 1283, 7271, 13, 2055, 429, 594, 4396, 382, 9454, 11, 429, 594, 279, 2038, 13, 1084, 1265, 3705, 678, 5048, 382, 11656, 46024, 1447, 77, 28, 16, 25, 2550, 220, 15, 382, 77, 28, 17, 11, 1852, 2629, 476, 1852, 3638, 25, 2550, 220, 16, 382, 3983, 279, 2038, 4278, 382, 14037, 1142, 25, 65623, 304, 1852, 2629, 714, 2155, 86947, 13, 2055, 807, 16792, 220, 16, 6716, 13, 2521, 1852, 3638, 714, 2155, 2629, 11, 16792, 220, 16, 382, 4416, 2038, 4977, 4396, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 11625, 419, 3491, 11, 582, 1184, 311, 8253, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 37236, 11, 2987, 504, 1909, 7950, 311, 5622, 6701, 320, 30487, 37236, 8, 476, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 37236, 3593, 14374, 53084, 198, 16, 13, 3070, 28301, 1437, 7767, 6113, 1127, 95518, 8886, 53206, 646, 387, 949, 315, 1378, 84018, 1127, 510, 256, 481, 3070, 35490, 7767, 23450, 95518, 15633, 1506, 553, 279, 6672, 17767, 87, 481, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 6785, 37236, 624, 256, 481, 3070, 38489, 7767, 23450, 95518, 15633, 1506, 553, 279, 2629, 17767, 87, 488, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 8225, 37236, 382, 17, 13, 3070, 2507, 425, 50109, 389, 8886, 7767, 23450, 95518, 5443, 1378, 57514, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 6785, 323, 8225, 37236, 13, 576, 1376, 369, 6785, 84018, 1127, 374, 17767, 87, 481, 379, 57758, 323, 369, 8225, 84018, 1127, 374, 17767, 87, 488, 379, 59, 3593, 18, 13, 3070, 47866, 393, 4720, 95518, 1752, 1817, 37236, 320, 21028, 6785, 323, 8225, 701, 421, 1052, 525, 17767, 74, 57758, 65623, 389, 264, 37236, 11, 279, 1372, 315, 22818, 13530, 374, 2661, 553, 279, 10601, 14806, 17767, 34, 5969, 11, 220, 17, 8, 284, 595, 1124, 15136, 320, 74, 481, 220, 16, 8, 608, 220, 17, 59, 568, 8116, 1493, 2750, 369, 678, 84018, 1127, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 14374, 12478, 6119, 198, 73594, 12669, 198, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 1173, 22842, 692, 3817, 741, 13874, 19324, 14374, 71287, 198, 16, 13, 3070, 31899, 5571, 95518, 576, 1946, 374, 1349, 504, 5297, 1946, 13, 576, 1156, 1555, 5610, 279, 1372, 315, 65623, 11, 8110, 553, 862, 9892, 624, 17, 13, 3070, 37119, 7767, 6113, 1127, 95518, 9043, 57514, 11, 1565, 1242, 25977, 63, 323, 1565, 13490, 25977, 7808, 525, 1483, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 8225, 323, 6785, 37236, 11, 15576, 624, 18, 13, 3070, 57908, 1095, 393, 4720, 95518, 1752, 1817, 37236, 320, 1242, 323, 6672, 701, 582, 11047, 279, 1372, 315, 13530, 1667, 279, 10601, 14806, 323, 2629, 1493, 2750, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 1986, 5486, 29720, 5203, 65623, 553, 862, 84018, 1127, 323, 47417, 279, 22818, 13530, 304, 13482, 882, 11, 3259, 432, 14452, 369, 3460, 1946, 12282, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 65623, 382, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198]
labels: [-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 1490, 13, 576, 3491, 374, 311, 1760, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 421, 807, 525, 389, 279, 1852, 37236, 13, 2055, 1817, 37236, 646, 16792, 1045, 13530, 11, 323, 279, 2790, 374, 279, 2629, 916, 678, 84018, 1127, 315, 279, 10601, 315, 65623, 304, 429, 37236, 4429, 1378, 518, 264, 882, 382, 5338, 11, 358, 1184, 311, 7071, 700, 1246, 311, 1874, 279, 65623, 1119, 862, 19511, 84018, 1127, 13, 2619, 525, 1378, 4494, 315, 84018, 1127, 25, 279, 6174, 429, 30232, 504, 1909, 7950, 311, 5622, 6701, 320, 1149, 594, 1618, 1105, 6785, 84018, 1127, 701, 323, 279, 6174, 429, 30232, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 84018, 1127, 3593, 2461, 264, 6785, 37236, 11, 279, 1376, 374, 856, 481, 379, 13, 9211, 3156, 1741, 264, 37236, 11, 279, 6672, 856, 481, 379, 8458, 6783, 13, 1752, 3110, 11, 320, 16, 11, 16, 8, 702, 856, 12034, 28, 15, 11, 320, 17, 11, 17, 8, 1083, 220, 15, 11, 4992, 13, 2055, 678, 65623, 389, 279, 1852, 6785, 37236, 686, 614, 279, 1852, 856, 12034, 897, 382, 2461, 279, 8225, 84018, 1127, 11, 279, 2629, 856, 488, 379, 374, 6783, 13, 8909, 320, 16, 11, 20, 8, 323, 320, 17, 11, 19, 8, 2176, 2629, 311, 220, 21, 13, 2055, 65623, 389, 279, 1852, 8225, 37236, 686, 614, 279, 1852, 856, 43010, 382, 4416, 279, 3119, 374, 1447, 16, 13, 1752, 1817, 53206, 11, 12564, 2176, 856, 12034, 323, 856, 43010, 624, 17, 13, 1752, 1817, 315, 1493, 1378, 2750, 11, 1874, 279, 65623, 553, 1105, 624, 18, 13, 1752, 1817, 1874, 448, 595, 65623, 11, 912, 595, 6599, 74, 12, 16, 5620, 17, 311, 279, 2790, 1760, 13, 9211, 1817, 6716, 304, 279, 1874, 42972, 311, 279, 2790, 382, 14190, 11, 1290, 13, 9211, 369, 894, 1874, 315, 1379, 595, 11, 279, 1372, 315, 13530, 374, 356, 5969, 11, 17, 8, 892, 374, 595, 6599, 74, 12, 16, 5620, 17, 382, 4416, 279, 7354, 525, 1447, 12, 54340, 916, 678, 65623, 624, 12, 1752, 1817, 11, 11047, 279, 1378, 6894, 25, 856, 12034, 323, 856, 43010, 624, 12, 5443, 57514, 311, 1760, 279, 1372, 315, 65623, 304, 1817, 37236, 320, 21028, 6785, 323, 8225, 4292, 12, 5005, 11, 369, 1817, 1760, 304, 279, 57514, 11, 12564, 279, 27459, 323, 2629, 1105, 678, 382, 14190, 11, 714, 279, 3491, 5302, 429, 1378, 65623, 3359, 1817, 1008, 421, 807, 4332, 279, 1852, 37236, 13, 1988, 1817, 53206, 374, 949, 315, 1378, 84018, 1127, 320, 30487, 323, 8225, 568, 4354, 11, 1378, 65623, 646, 1172, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 6785, 37236, 2726, 279, 1852, 8225, 37236, 13, 2055, 1817, 6716, 374, 29994, 3055, 421, 807, 4332, 2987, 315, 279, 1378, 84018, 1127, 382, 3983, 1246, 653, 582, 5648, 1990, 26580, 287, 30, 1752, 3110, 11, 1378, 65623, 1410, 387, 389, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 1988, 429, 594, 11997, 7241, 807, 525, 279, 1852, 1459, 11, 892, 4436, 944, 5420, 1588, 13, 9211, 421, 1378, 65623, 525, 389, 279, 1852, 856, 12034, 323, 1852, 856, 43010, 11, 1221, 21828, 856, 16, 488, 379, 16, 284, 856, 17, 488, 379, 17, 323, 856, 16, 481, 379, 16, 284, 856, 17, 481, 379, 17, 1035, 2968, 856, 16, 284, 856, 17, 323, 379, 16, 284, 379, 17, 11, 892, 646, 944, 3537, 2474, 279, 9892, 525, 4911, 13, 2055, 902, 1378, 65623, 646, 387, 389, 2176, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 2055, 369, 1817, 6716, 315, 65623, 11, 807, 525, 29994, 2987, 3055, 320, 333, 807, 4332, 2987, 6785, 476, 8225, 37236, 8, 476, 537, 518, 678, 13, 15277, 11, 279, 2629, 315, 279, 27459, 504, 2176, 6785, 323, 8225, 84018, 1127, 686, 2968, 279, 4396, 2790, 382, 4416, 279, 5486, 374, 4396, 13, 2055, 1431, 11, 279, 2038, 7354, 1447, 4418, 308, 382, 12209, 369, 1817, 315, 279, 308, 65623, 11, 1349, 856, 5318, 323, 379, 5318, 382, 46254, 369, 1817, 53206, 1447, 1242, 61304, 284, 856, 488, 379, 198, 13490, 61304, 284, 856, 481, 379, 271, 1654, 1184, 311, 3754, 279, 1372, 315, 65623, 304, 1817, 2629, 61304, 323, 1817, 3638, 61304, 382, 4416, 1378, 57514, 25, 825, 369, 36398, 11, 825, 369, 86947, 382, 12209, 11, 369, 1817, 1376, 304, 36398, 11, 912, 356, 11512, 11, 220, 17, 8, 311, 279, 2790, 382, 19198, 369, 279, 86947, 382, 4416, 279, 2038, 686, 387, 1447, 9928, 2629, 25977, 323, 3638, 25977, 438, 1638, 97599, 320, 269, 5792, 97599, 11, 17271, 311, 220, 15, 3593, 2461, 1817, 856, 11, 379, 1447, 1242, 3097, 284, 856, 488, 379, 271, 13490, 3097, 284, 856, 481, 379, 271, 1242, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 271, 13490, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 271, 12209, 11, 2790, 284, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 2629, 25977, 10656, 368, 873, 488, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 3638, 25977, 10656, 368, 5125, 4792, 594, 279, 4226, 382, 3983, 2474, 308, 646, 387, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 11, 323, 369, 1817, 315, 1105, 582, 1882, 1378, 57514, 11, 419, 1265, 387, 11050, 3322, 13, 9211, 1496, 448, 220, 17, 15, 15, 11, 15, 15, 15, 10695, 11, 279, 57514, 646, 3705, 429, 13, 1597, 279, 2629, 374, 506, 1255, 701, 1380, 296, 374, 279, 1372, 315, 6894, 304, 1817, 10997, 11, 892, 374, 518, 1429, 220, 17, 15, 15, 11, 15, 15, 15, 353, 220, 17, 304, 279, 11785, 1142, 11, 892, 374, 70028, 382, 16451, 279, 1156, 3110, 1447, 2505, 220, 20, 1447, 45793, 525, 320, 16, 11, 16, 701, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 701, 320, 20, 11, 20, 3593, 22464, 518, 2629, 61304, 1447, 7, 16, 10, 16, 11730, 17, 11, 320, 16, 10, 20, 11730, 21, 11, 320, 18, 10, 18, 11730, 21, 11, 320, 20, 10, 16, 11730, 21, 11, 320, 20, 10, 20, 11730, 16, 15, 382, 4416, 2629, 25977, 1447, 17, 25, 220, 16, 271, 21, 25, 220, 18, 320, 27436, 220, 16, 11, 20, 26, 220, 18, 11, 18, 26, 20, 11, 16, 57777, 14190, 3783, 11, 320, 16, 11, 20, 8, 2629, 374, 220, 21, 11, 320, 18, 11, 18, 8, 2629, 374, 220, 21, 11, 320, 20, 11, 16, 8, 2629, 374, 220, 21, 13, 2055, 2629, 220, 21, 702, 1760, 220, 18, 382, 12209, 11, 2629, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 785, 1008, 2629, 14579, 525, 220, 17, 25, 16, 11, 220, 16, 15, 25, 16, 13, 2055, 2629, 18527, 374, 220, 18, 382, 2461, 279, 3638, 61304, 1447, 7, 16, 12, 16, 11730, 15, 11, 320, 16, 12, 20, 8, 10829, 19, 11, 320, 18, 12, 18, 11730, 15, 11, 320, 20, 12, 16, 11730, 19, 11, 320, 20, 12, 20, 11730, 15, 382, 13490, 25977, 1447, 15, 25, 18, 320, 27436, 220, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 692, 12, 19, 25, 16, 271, 19, 25, 16, 382, 4416, 3638, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 4416, 2790, 2629, 374, 220, 18, 320, 1242, 8, 488, 220, 18, 320, 13490, 8, 284, 220, 21, 13, 15920, 9071, 279, 1156, 3110, 594, 2550, 382, 9454, 11, 429, 594, 4396, 382, 14037, 3110, 1447, 2505, 220, 18, 1447, 7, 16, 11, 16, 701, 320, 17, 11, 18, 701, 320, 18, 11, 20, 3593, 1242, 61304, 1447, 16, 10, 16, 28, 17, 320, 1830, 220, 16, 692, 17, 10, 18, 28, 20, 320, 1830, 220, 16, 692, 18, 10, 20, 28, 23, 320, 1830, 220, 16, 568, 8116, 18527, 220, 15, 382, 13490, 61304, 1447, 16, 12, 16, 28, 15, 320, 1830, 16, 692, 17, 12, 18, 284, 481, 16, 320, 1830, 16, 692, 18, 12, 20, 284, 481, 17, 320, 1830, 16, 568, 2055, 3638, 18527, 220, 15, 382, 7595, 220, 15, 13, 39970, 382, 4416, 279, 2038, 1265, 975, 382, 7039, 11, 10822, 419, 304, 13027, 382, 785, 2038, 1265, 1349, 504, 31369, 13, 5005, 11, 12564, 279, 2629, 323, 3638, 14579, 382, 62980, 438, 1447, 4418, 308, 382, 1242, 25977, 284, 42908, 1548, 692, 13490, 25977, 284, 42908, 1548, 692, 1958, 716, 304, 2088, 1445, 7731, 262, 856, 11, 379, 284, 2415, 1548, 11, 1946, 1005, 6960, 12367, 262, 274, 284, 856, 488, 379, 271, 262, 294, 284, 856, 481, 379, 271, 262, 2629, 25977, 11880, 60, 1421, 220, 16, 271, 262, 3638, 25977, 21427, 60, 1421, 220, 16, 271, 5035, 284, 220, 15, 271, 1958, 272, 304, 2629, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1958, 272, 304, 3638, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1350, 22842, 692, 9454, 11, 429, 594, 30339, 382, 16451, 448, 279, 1156, 3110, 1447, 1242, 25977, 369, 220, 21, 374, 220, 18, 320, 1499, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 4579, 2055, 220, 18, 9, 17, 14, 17, 284, 18, 382, 13490, 25977, 369, 220, 15, 374, 220, 18, 320, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 8, 11397, 220, 18, 13, 2055, 2790, 220, 21, 382, 14037, 3110, 11, 438, 1573, 382, 3983, 279, 2038, 15804, 504, 31369, 13, 2055, 279, 729, 1265, 387, 5326, 311, 1349, 11127, 11, 1882, 11, 323, 2550, 382, 3983, 279, 3491, 2727, 311, 6923, 458, 32156, 13027, 729, 429, 15804, 31369, 323, 23473, 279, 2550, 382, 4416, 279, 2038, 1035, 387, 1447, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 1173, 22842, 692, 3817, 2822, 3983, 304, 279, 3491, 5114, 11, 279, 729, 1265, 387, 2598, 1283, 7271, 13, 2055, 429, 594, 4396, 382, 9454, 11, 429, 594, 279, 2038, 13, 1084, 1265, 3705, 678, 5048, 382, 11656, 46024, 1447, 77, 28, 16, 25, 2550, 220, 15, 382, 77, 28, 17, 11, 1852, 2629, 476, 1852, 3638, 25, 2550, 220, 16, 382, 3983, 279, 2038, 4278, 382, 14037, 1142, 25, 65623, 304, 1852, 2629, 714, 2155, 86947, 13, 2055, 807, 16792, 220, 16, 6716, 13, 2521, 1852, 3638, 714, 2155, 2629, 11, 16792, 220, 16, 382, 4416, 2038, 4977, 4396, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 11625, 419, 3491, 11, 582, 1184, 311, 8253, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 37236, 11, 2987, 504, 1909, 7950, 311, 5622, 6701, 320, 30487, 37236, 8, 476, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 37236, 3593, 14374, 53084, 198, 16, 13, 3070, 28301, 1437, 7767, 6113, 1127, 95518, 8886, 53206, 646, 387, 949, 315, 1378, 84018, 1127, 510, 256, 481, 3070, 35490, 7767, 23450, 95518, 15633, 1506, 553, 279, 6672, 17767, 87, 481, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 6785, 37236, 624, 256, 481, 3070, 38489, 7767, 23450, 95518, 15633, 1506, 553, 279, 2629, 17767, 87, 488, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 8225, 37236, 382, 17, 13, 3070, 2507, 425, 50109, 389, 8886, 7767, 23450, 95518, 5443, 1378, 57514, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 6785, 323, 8225, 37236, 13, 576, 1376, 369, 6785, 84018, 1127, 374, 17767, 87, 481, 379, 57758, 323, 369, 8225, 84018, 1127, 374, 17767, 87, 488, 379, 59, 3593, 18, 13, 3070, 47866, 393, 4720, 95518, 1752, 1817, 37236, 320, 21028, 6785, 323, 8225, 701, 421, 1052, 525, 17767, 74, 57758, 65623, 389, 264, 37236, 11, 279, 1372, 315, 22818, 13530, 374, 2661, 553, 279, 10601, 14806, 17767, 34, 5969, 11, 220, 17, 8, 284, 595, 1124, 15136, 320, 74, 481, 220, 16, 8, 608, 220, 17, 59, 568, 8116, 1493, 2750, 369, 678, 84018, 1127, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 14374, 12478, 6119, 198, 73594, 12669, 198, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 1173, 22842, 692, 3817, 741, 13874, 19324, 14374, 71287, 198, 16, 13, 3070, 31899, 5571, 95518, 576, 1946, 374, 1349, 504, 5297, 1946, 13, 576, 1156, 1555, 5610, 279, 1372, 315, 65623, 11, 8110, 553, 862, 9892, 624, 17, 13, 3070, 37119, 7767, 6113, 1127, 95518, 9043, 57514, 11, 1565, 1242, 25977, 63, 323, 1565, 13490, 25977, 7808, 525, 1483, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 8225, 323, 6785, 37236, 11, 15576, 624, 18, 13, 3070, 57908, 1095, 393, 4720, 95518, 1752, 1817, 37236, 320, 1242, 323, 6672, 701, 582, 11047, 279, 1372, 315, 13530, 1667, 279, 10601, 14806, 323, 2629, 1493, 2750, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 1986, 5486, 29720, 5203, 65623, 553, 862, 84018, 1127, 323, 47417, 279, 22818, 13530, 304, 13482, 882, 11, 3259, 432, 14452, 369, 3460, 1946, 12282, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 65623, 382, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198]

The model is trained to predict the tokens corresponding to the assistant's response. Therefore, the labels are set to -100 for the input part of the text, which masks them from the loss calculation. The model's task is to predict the subsequent tokens.

Here is a token-by-token comparison of the text with its corresponding input_ids and labels:

FILE

How to Use This Model

You can use the following code snippet to load the model and run inference. This example demonstrates how to structure the prompt to elicit a detailed thought process followed by a final solution.

# Adapted from https://huggingface.co/Qwen/Qwen3-32B
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "Team-Promptia/Qwen3-Stratos-32B"

# load the tokenizer and the model
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype="auto",
    device_map="auto"
)

SYSTEM_PROMPT = "Your role as an assistant involves thoroughly exploring questions through a systematic long thinking process before providing the final precise and accurate solutions. This requires engaging in a comprehensive cycle of analysis, summarizing, exploration, reassessment, reflection, backtracing, and iteration to develop well-considered thinking process. Please structure your response into two main sections: Thought and Solution. In the Thought section, detail your reasoning process using the specified format: <|begin_of_thought|> {thought with steps separated with '\\n\\n'} <|end_of_thought|> Each step should include detailed considerations such as analisying questions, summarizing relevant findings, brainstorming new ideas, verifying the accuracy of the current steps, refining any errors, and revisiting previous steps. In the Solution section, based on various attempts, explorations, and reflections from the Thought section, systematically present the final solution that you deem correct. The solution should remain a logical, accurate, concise expression style and detail necessary step needed to reach the conclusion, formatted as follows: <|begin_of_solution|> {final formatted, precise, and clear solution} <|end_of_solution|> Now, try to solve the following question through the above guidelines:"
# QUESTION from HuggingFaceH4/aime_2024
QUESTION = "Every morning Aya goes for a $9$-kilometer-long walk and stops at a coffee shop afterwards. When she walks at a constant speed of $s$ kilometers per hour, the walk takes her 4 hours, including $t$ minutes spent in the coffee shop. When she walks $s+2$ kilometers per hour, the walk takes her 2 hours and 24 minutes, including $t$ minutes spent in the coffee shop. Suppose Aya walks at $s+\frac{1}{2}$ kilometers per hour. Find the number of minutes the walk takes her, including the $t$ minutes spent in the coffee shop."
messages = [
    {"role": "system", "content": SYSTEM_PROMPT},
    {"role": "user", "content": QUESTION}
]
text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
    enable_thinking=False # Switches between thinking and non-thinking modes. Default is True.
)
text += "<|begin_of_thought|>\n\n"
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)

# conduct text completion
generated_ids = model.generate(
    **model_inputs,
    max_new_tokens=16384
)
output_ids = generated_ids[0][len(model_inputs.input_ids[0]):].tolist() 

output = tokenizer.decode(output_ids, skip_special_tokens=True).strip("\n")

print(output)