Bauxitiego commited on
Commit
064b1b1
·
verified ·
1 Parent(s): f0af99b

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +138 -0
  2. RESULTS.json +353 -0
  3. checkpoints/convgru_A_d3_r3_p0.001.pt +3 -0
  4. checkpoints/convgru_A_d3_r3_p0.003.pt +3 -0
  5. checkpoints/convgru_A_d3_r3_p0.005.pt +3 -0
  6. checkpoints/convgru_A_d3_r3_p0.01.pt +3 -0
  7. checkpoints/convgru_A_d5_r5_p0.001.pt +3 -0
  8. checkpoints/convgru_A_d5_r5_p0.003.pt +3 -0
  9. checkpoints/convgru_A_d5_r5_p0.005.pt +3 -0
  10. checkpoints/convgru_A_d5_r5_p0.01.pt +3 -0
  11. checkpoints/convgru_budget_120000_8_d3_r3_p0.003.pt +3 -0
  12. checkpoints/convgru_budget_120000_8_d5_r5_p0.003.pt +3 -0
  13. checkpoints/convgru_budget_400000_25_d3_r3_p0.003.pt +3 -0
  14. checkpoints/convgru_budget_400000_25_d5_r5_p0.003.pt +3 -0
  15. checkpoints/convgru_budget_800000_40_d3_r3_p0.003.pt +3 -0
  16. checkpoints/convgru_budget_800000_40_d5_r5_p0.003.pt +3 -0
  17. checkpoints/convgru_s0_x0.0005_d3_r3_p0.003.pt +3 -0
  18. checkpoints/convgru_s0_x0.0005_d5_r5_p0.003.pt +3 -0
  19. checkpoints/convgru_s0_x0_d3_r3_p0.003.pt +3 -0
  20. checkpoints/convgru_s0_x0_d5_r5_p0.003.pt +3 -0
  21. checkpoints/convgru_s1.75_x0.0015_d3_r3_p0.003.pt +3 -0
  22. checkpoints/convgru_s1.75_x0.0015_d5_r5_p0.003.pt +3 -0
  23. checkpoints/convgru_s1.75_x0_d3_r3_p0.003.pt +3 -0
  24. checkpoints/convgru_s1.75_x0_d5_r5_p0.003.pt +3 -0
  25. checkpoints/convgru_s1_x0.0005_d3_r3_p0.003.pt +3 -0
  26. checkpoints/convgru_s1_x0.0005_d5_r5_p0.003.pt +3 -0
  27. checkpoints/convgru_s1_x0_d3_r3_p0.003.pt +3 -0
  28. checkpoints/convgru_s1_x0_d5_r5_p0.003.pt +3 -0
  29. checkpoints/gnn_A_d3_r3_p0.001.pt +3 -0
  30. checkpoints/gnn_A_d3_r3_p0.003.pt +3 -0
  31. checkpoints/gnn_A_d3_r3_p0.005.pt +3 -0
  32. checkpoints/gnn_A_d3_r3_p0.01.pt +3 -0
  33. checkpoints/gnn_A_d5_r5_p0.001.pt +3 -0
  34. checkpoints/gnn_A_d5_r5_p0.003.pt +3 -0
  35. checkpoints/gnn_A_d5_r5_p0.005.pt +3 -0
  36. checkpoints/gnn_A_d5_r5_p0.01.pt +3 -0
  37. checkpoints/gnn_s0_x0.0005_d3_r3_p0.003.pt +3 -0
  38. checkpoints/gnn_s0_x0.0005_d5_r5_p0.003.pt +3 -0
  39. checkpoints/gnn_s0_x0_d3_r3_p0.003.pt +3 -0
  40. checkpoints/gnn_s0_x0_d5_r5_p0.003.pt +3 -0
  41. checkpoints/gnn_s1.75_x0.0015_d3_r3_p0.003.pt +3 -0
  42. checkpoints/gnn_s1.75_x0.0015_d5_r5_p0.003.pt +3 -0
  43. checkpoints/gnn_s1.75_x0_d3_r3_p0.003.pt +3 -0
  44. checkpoints/gnn_s1.75_x0_d5_r5_p0.003.pt +3 -0
  45. checkpoints/gnn_s1_x0.0005_d3_r3_p0.003.pt +3 -0
  46. checkpoints/gnn_s1_x0.0005_d5_r5_p0.003.pt +3 -0
  47. checkpoints/gnn_s1_x0_d3_r3_p0.003.pt +3 -0
  48. checkpoints/gnn_s1_x0_d5_r5_p0.003.pt +3 -0
  49. checkpoints/mlp_A_d3_r3_p0.001.pt +3 -0
  50. checkpoints/mlp_A_d3_r3_p0.003.pt +3 -0
README.md ADDED
@@ -0,0 +1,138 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: pytorch
4
+ tags:
5
+ - quantum-computing
6
+ - quantum-error-correction
7
+ - surface-code
8
+ - syndrome-decoding
9
+ - physics
10
+ datasets:
11
+ - Bauxitiego/surface-code-syndromes
12
+ ---
13
+
14
+ # Neural decoders for the surface code
15
+
16
+ Weights from a study of when learned decoders beat minimum-weight perfect matching, and why.
17
+ Anyone can train a network to decode a surface code; that has been done since 2017. The
18
+ question here is narrower. Matching is near-optimal when its noise model is right, so the
19
+ only place a learned decoder can win is where that model is wrong. This measures how much it
20
+ wins by, and at what point it stops.
21
+
22
+ Three architectures, all within 1.2x of each other on parameter count and given identical
23
+ optimiser, schedule and step budget. Comparing a big model to a small one, or one tuned
24
+ harder than another, measures capacity or patience rather than architecture.
25
+
26
+ ## Using a checkpoint
27
+
28
+ Weights, the decision threshold picked on validation, and the padding mask all travel in the
29
+ same file. A checkpoint that makes you reconstruct the threshold by hand is not really
30
+ reusable.
31
+
32
+ ```python
33
+ import torch
34
+ ckpt = torch.load("mlp_A_d3_r3_p0.003.pt", weights_only=False)
35
+ print(ckpt["architecture"], ckpt["distance"], ckpt["p"], ckpt["logical_error_rate"])
36
+ ```
37
+
38
+ Model definitions live in [github.com/Bauxitiego/qec-neural-decoder](https://github.com/Bauxitiego/qec-neural-decoder).
39
+ Filenames encode architecture, regime, distance, rounds and physical error rate.
40
+
41
+ ## The result
42
+
43
+ Regime B holds total noise constant and varies only its structure: the base error rate is
44
+ scaled down by bisection until detection-event density matches the uniform control, so a
45
+ "correlated noise" arm cannot secretly be a "more noise" arm. Matching is run twice, once
46
+ with the true noise model and once with the uniform one it would actually have on hardware.
47
+
48
+ | d | noise | MWPM true | MWPM mis-spec | penalty | best neural | vs mis-spec |
49
+ |---|---|---|---|---|---|---|
50
+ | 3 | `s0_x0` | 0.00652 | 0.00652 | 1.00x | 0.00617 | indistinguishable |
51
+ | 3 | `s0_x0.0005` | 0.01531 | 0.02835 | 1.85x | 0.01536 | neural |
52
+ | 3 | `s1.75_x0` | 0.00639 | 0.00656 | 1.03x | 0.00591 | neural |
53
+ | 3 | `s1.75_x0.0015` | 0.01974 | 0.03949 | 2.00x | 0.02006 | neural |
54
+ | 3 | `s1_x0` | 0.00695 | 0.00702 | 1.01x | 0.00646 | neural |
55
+ | 3 | `s1_x0.0005` | 0.01229 | 0.02002 | 1.63x | 0.01195 | neural |
56
+ | 5 | `s0_x0` | 0.00334 | 0.00334 | 1.00x | 0.01111 | mwpm |
57
+ | 5 | `s0_x0.0005` | 0.01603 | 0.02194 | 1.37x | 0.03611 | mwpm |
58
+ | 5 | `s1.75_x0` | 0.00290 | 0.00335 | 1.16x | 0.01052 | mwpm |
59
+ | 5 | `s1.75_x0.0015` | 0.02515 | 0.03575 | 1.42x | 0.04158 | mwpm |
60
+ | 5 | `s1_x0` | 0.00317 | 0.00356 | 1.12x | 0.01507 | mwpm |
61
+ | 5 | `s1_x0.0005` | 0.01117 | 0.01439 | 1.29x | 0.02854 | mwpm |
62
+
63
+ At distance 3 the networks track true-model matching and beat the mis-specified version by up
64
+ to 2.00x. Two rows are worth reading closely. Per-qubit rate spread on its own barely
65
+ costs matching anything, around 1.01x, because a mis-weighted graph is still roughly the
66
+ right graph. Crosstalk costs it 1.85x, because correlated errors have no edge to live on.
67
+ Rate variation is survivable; correlation is not.
68
+
69
+ At distance 5 matching wins every row. The next section is why.
70
+
71
+ ## Why distance 5 loses
72
+
73
+ | training shots | epochs | logical error rate | vs MWPM |
74
+ |---|---|---|---|
75
+ | 120,000 | 8 | 0.04079 | 12.1x |
76
+ | 400,000 | 25 | 0.01814 | 5.4x |
77
+ | 800,000 | 40 | 0.01118 | 3.3x |
78
+
79
+ The sweep above ran at 400,000 shots and 12 epochs, between the first two rows. At distance 3 the networks saturate by the second row and settle slightly under matching. At distance 5 they are still improving at the largest budget tested, going 12.1x to 5.4x to 3.3x without flattening.
80
+
81
+ So the distance-5 numbers are a statement about how long I trained. Read them as an architecture result and you will draw the wrong conclusion, which is the whole reason this section is here.
82
+
83
+ ## Regime A: uniform noise
84
+
85
+ The control. Matching's model is exactly right here, so it should win, and mostly it does.
86
+
87
+ | d | p | trivial | MWPM | best neural | arch | winner |
88
+ |---|---|---|---|---|---|---|
89
+ | 3 | 0.001 | 0.02308 | 0.00072 | 0.00092 | mlp | indistinguishable |
90
+ | 3 | 0.003 | 0.06567 | 0.00641 | 0.00617 | mlp | indistinguishable |
91
+ | 3 | 0.005 | 0.10454 | 0.01668 | 0.01609 | mlp | indistinguishable |
92
+ | 3 | 0.01 | 0.18744 | 0.06056 | 0.05562 | mlp | neural |
93
+ | 5 | 0.001 | 0.05801 | 0.00010 | 0.00262 | gnn | mwpm |
94
+ | 5 | 0.003 | 0.15393 | 0.00338 | 0.01111 | gnn | mwpm |
95
+ | 5 | 0.005 | 0.22917 | 0.01401 | 0.03736 | gnn | mwpm |
96
+ | 5 | 0.01 | 0.35625 | 0.08121 | 0.15477 | gnn | mwpm |
97
+
98
+ One row is not a tie: at distance 3 and p=0.01 the MLP beats matching outright with
99
+ non-overlapping intervals. That was not the expected outcome in the regime designed to
100
+ favour matching.
101
+
102
+ The architecture ordering also flips with distance. The plain MLP is best at distance 3, the
103
+ graph network at distance 5. The graph prior costs more than it returns until the code is
104
+ large enough for the structure to carry information.
105
+
106
+ ## Real device: Google Sycamore
107
+
108
+ Syndromes from Google's 2023 experiment, with their own published decoder predictions as
109
+ baselines, scored on identical held-out shots. No reimplementation sits between these models
110
+ and the comparison.
111
+
112
+ | d | rounds | trivial | pymatching | correlated | best neural | vs pymatching |
113
+ |---|---|---|---|---|---|---|
114
+ | 3 | 5 | 0.29340 | 0.14790 | 0.13760 | 0.15720 | indistinguishable |
115
+ | 3 | 25 | 0.49010 | 0.43020 | 0.42410 | 0.48920 | mwpm |
116
+ | 5 | 5 | 0.38690 | 0.14730 | 0.12750 | 0.26430 | mwpm |
117
+
118
+ These lose, and the 25-round row loses badly enough to be worth stating plainly: 0.489
119
+ against a trivial floor of 0.490 means the model learned essentially nothing. Each experiment
120
+ has 50,000 shots, so 35,000 to train on, against a 200-detector input with a base flip rate
121
+ near 50 percent. That is not enough supervision, and no amount of architecture fixes it.
122
+
123
+ It is also the most practically useful thing in this repo. Simulated syndromes are free.
124
+ Hardware shots are not, and the shot budget is what actually limits learned decoders on real
125
+ machines.
126
+
127
+ ## Scope
128
+
129
+ Distance 3 and 5, one code, one crosstalk model. The architectures are standard; the
130
+ measurement is the part that is mine. State of the art is AlphaQubit from Google DeepMind,
131
+ which used far more compute and real device data, and nothing here competes with it.
132
+ Regimes A and B are simulated, so leakage and calibration drift are absent. The distance-5
133
+ models remain budget-limited.
134
+
135
+ ## License
136
+
137
+ MIT for code and weights. The device evaluation uses data released by Google Quantum AI under
138
+ CC-BY-4.0; attribution is on the dataset card.
RESULTS.json ADDED
@@ -0,0 +1,353 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "regime_a": [
3
+ {
4
+ "d": 3,
5
+ "p": 0.001,
6
+ "trivial": 0.02308,
7
+ "mwpm": 0.00072,
8
+ "mlp": 0.000916,
9
+ "convgru": 0.001246,
10
+ "gnn": 0.001298,
11
+ "best_neural": "mlp",
12
+ "verdict": "indistinguishable",
13
+ "ratio_mwpm_over_neural": 0.7860262008733625
14
+ },
15
+ {
16
+ "d": 3,
17
+ "p": 0.003,
18
+ "trivial": 0.065665,
19
+ "mwpm": 0.00641,
20
+ "mlp": 0.006174,
21
+ "convgru": 0.006862,
22
+ "gnn": 0.008296,
23
+ "best_neural": "mlp",
24
+ "verdict": "indistinguishable",
25
+ "ratio_mwpm_over_neural": 1.0382248137350178
26
+ },
27
+ {
28
+ "d": 3,
29
+ "p": 0.005,
30
+ "trivial": 0.104545,
31
+ "mwpm": 0.016680407391677286,
32
+ "mlp": 0.016088,
33
+ "convgru": 0.017218,
34
+ "gnn": 0.01842,
35
+ "best_neural": "mlp",
36
+ "verdict": "indistinguishable",
37
+ "ratio_mwpm_over_neural": 1.03682293583275
38
+ },
39
+ {
40
+ "d": 3,
41
+ "p": 0.01,
42
+ "trivial": 0.18744,
43
+ "mwpm": 0.06056112103144578,
44
+ "mlp": 0.055618,
45
+ "convgru": 0.05758,
46
+ "gnn": 0.062736,
47
+ "best_neural": "mlp",
48
+ "verdict": "neural",
49
+ "ratio_mwpm_over_neural": 1.088876281625477
50
+ },
51
+ {
52
+ "d": 5,
53
+ "p": 0.001,
54
+ "trivial": 0.058005,
55
+ "mwpm": 9.5e-05,
56
+ "mlp": 0.003266,
57
+ "convgru": 0.003134,
58
+ "gnn": 0.00262,
59
+ "best_neural": "gnn",
60
+ "verdict": "mwpm",
61
+ "ratio_mwpm_over_neural": 0.03625954198473283
62
+ },
63
+ {
64
+ "d": 5,
65
+ "p": 0.003,
66
+ "trivial": 0.15393,
67
+ "mwpm": 0.00338,
68
+ "mlp": 0.019996,
69
+ "convgru": 0.016982,
70
+ "gnn": 0.011112,
71
+ "best_neural": "gnn",
72
+ "verdict": "mwpm",
73
+ "ratio_mwpm_over_neural": 0.3041756659467243
74
+ },
75
+ {
76
+ "d": 5,
77
+ "p": 0.005,
78
+ "trivial": 0.22917,
79
+ "mwpm": 0.014014885158703083,
80
+ "mlp": 0.05319,
81
+ "convgru": 0.044748,
82
+ "gnn": 0.037362,
83
+ "best_neural": "gnn",
84
+ "verdict": "mwpm",
85
+ "ratio_mwpm_over_neural": 0.37511067819450467
86
+ },
87
+ {
88
+ "d": 5,
89
+ "p": 0.01,
90
+ "trivial": 0.35625,
91
+ "mwpm": 0.08121051148939595,
92
+ "mlp": 0.197032,
93
+ "convgru": 0.173618,
94
+ "gnn": 0.154774,
95
+ "best_neural": "gnn",
96
+ "verdict": "mwpm",
97
+ "ratio_mwpm_over_neural": 0.52470383584708
98
+ }
99
+ ],
100
+ "regime_b": [
101
+ {
102
+ "d": 3,
103
+ "noise": "s0_x0",
104
+ "spread": 0.0,
105
+ "crosstalk": 0.0,
106
+ "trivial": 0.065086,
107
+ "mwpm_true": 0.006518,
108
+ "mwpm_misspecified": 0.006518,
109
+ "mlp": 0.006174,
110
+ "convgru": 0.00699,
111
+ "gnn": 0.008296,
112
+ "best_neural": "mlp",
113
+ "verdict_vs_misspecified": "indistinguishable",
114
+ "ratio_misspecified_over_neural": 1.0557175251052804,
115
+ "mismatch_penalty": 1.0,
116
+ "verdict_vs_true": "indistinguishable"
117
+ },
118
+ {
119
+ "d": 3,
120
+ "noise": "s0_x0.0005",
121
+ "spread": 0.0,
122
+ "crosstalk": 0.0005,
123
+ "trivial": 0.087416,
124
+ "mwpm_true": 0.015312,
125
+ "mwpm_misspecified": 0.028354,
126
+ "mlp": 0.015356,
127
+ "convgru": 0.016322,
128
+ "gnn": 0.016928,
129
+ "best_neural": "mlp",
130
+ "verdict_vs_misspecified": "neural",
131
+ "ratio_misspecified_over_neural": 1.846444386559,
132
+ "mismatch_penalty": 1.85175026123302,
133
+ "verdict_vs_true": "indistinguishable"
134
+ },
135
+ {
136
+ "d": 3,
137
+ "noise": "s1.75_x0",
138
+ "spread": 1.75,
139
+ "crosstalk": 0.0,
140
+ "trivial": 0.06243,
141
+ "mwpm_true": 0.006394,
142
+ "mwpm_misspecified": 0.00656,
143
+ "mlp": 0.00591,
144
+ "convgru": 0.006378,
145
+ "gnn": 0.007654,
146
+ "best_neural": "mlp",
147
+ "verdict_vs_misspecified": "neural",
148
+ "ratio_misspecified_over_neural": 1.1099830795262267,
149
+ "mismatch_penalty": 1.0259618392242726,
150
+ "verdict_vs_true": "neural"
151
+ },
152
+ {
153
+ "d": 3,
154
+ "noise": "s1.75_x0.0015",
155
+ "spread": 1.75,
156
+ "crosstalk": 0.0015,
157
+ "trivial": 0.098352,
158
+ "mwpm_true": 0.019744,
159
+ "mwpm_misspecified": 0.039494,
160
+ "mlp": 0.02006,
161
+ "convgru": 0.020522,
162
+ "gnn": 0.021386,
163
+ "best_neural": "mlp",
164
+ "verdict_vs_misspecified": "neural",
165
+ "ratio_misspecified_over_neural": 1.9687936191425721,
166
+ "mismatch_penalty": 2.000303889789303,
167
+ "verdict_vs_true": "indistinguishable"
168
+ },
169
+ {
170
+ "d": 3,
171
+ "noise": "s1_x0",
172
+ "spread": 1.0,
173
+ "crosstalk": 0.0,
174
+ "trivial": 0.06368,
175
+ "mwpm_true": 0.006952,
176
+ "mwpm_misspecified": 0.00702,
177
+ "mlp": 0.006458,
178
+ "convgru": 0.006998,
179
+ "gnn": 0.007782,
180
+ "best_neural": "mlp",
181
+ "verdict_vs_misspecified": "neural",
182
+ "ratio_misspecified_over_neural": 1.0870238463920718,
183
+ "mismatch_penalty": 1.0097813578826238,
184
+ "verdict_vs_true": "neural"
185
+ },
186
+ {
187
+ "d": 3,
188
+ "noise": "s1_x0.0005",
189
+ "spread": 1.0,
190
+ "crosstalk": 0.0005,
191
+ "trivial": 0.07811,
192
+ "mwpm_true": 0.012294,
193
+ "mwpm_misspecified": 0.02002,
194
+ "mlp": 0.011954,
195
+ "convgru": 0.012774,
196
+ "gnn": 0.012948,
197
+ "best_neural": "mlp",
198
+ "verdict_vs_misspecified": "neural",
199
+ "ratio_misspecified_over_neural": 1.6747532206792706,
200
+ "mismatch_penalty": 1.62843663575728,
201
+ "verdict_vs_true": "indistinguishable"
202
+ },
203
+ {
204
+ "d": 5,
205
+ "noise": "s0_x0",
206
+ "spread": 0.0,
207
+ "crosstalk": 0.0,
208
+ "trivial": 0.155064,
209
+ "mwpm_true": 0.003338,
210
+ "mwpm_misspecified": 0.003338,
211
+ "mlp": 0.019996,
212
+ "convgru": 0.017774,
213
+ "gnn": 0.011112,
214
+ "best_neural": "gnn",
215
+ "verdict_vs_misspecified": "mwpm",
216
+ "ratio_misspecified_over_neural": 0.3003959683225342,
217
+ "mismatch_penalty": 1.0,
218
+ "verdict_vs_true": "mwpm"
219
+ },
220
+ {
221
+ "d": 5,
222
+ "noise": "s0_x0.0005",
223
+ "spread": 0.0,
224
+ "crosstalk": 0.0005,
225
+ "trivial": 0.207968,
226
+ "mwpm_true": 0.016026,
227
+ "mwpm_misspecified": 0.021942,
228
+ "mlp": 0.037846,
229
+ "convgru": 0.036114,
230
+ "gnn": 0.039408,
231
+ "best_neural": "convgru",
232
+ "verdict_vs_misspecified": "mwpm",
233
+ "ratio_misspecified_over_neural": 0.607576009303871,
234
+ "mismatch_penalty": 1.3691501310370648,
235
+ "verdict_vs_true": "mwpm"
236
+ },
237
+ {
238
+ "d": 5,
239
+ "noise": "s1.75_x0",
240
+ "spread": 1.75,
241
+ "crosstalk": 0.0,
242
+ "trivial": 0.139936,
243
+ "mwpm_true": 0.002902,
244
+ "mwpm_misspecified": 0.003352,
245
+ "mlp": 0.017908,
246
+ "convgru": 0.014108,
247
+ "gnn": 0.010516,
248
+ "best_neural": "gnn",
249
+ "verdict_vs_misspecified": "mwpm",
250
+ "ratio_misspecified_over_neural": 0.3187523773297832,
251
+ "mismatch_penalty": 1.155065472088215,
252
+ "verdict_vs_true": "mwpm"
253
+ },
254
+ {
255
+ "d": 5,
256
+ "noise": "s1.75_x0.0015",
257
+ "spread": 1.75,
258
+ "crosstalk": 0.0015,
259
+ "trivial": 0.227382,
260
+ "mwpm_true": 0.025152,
261
+ "mwpm_misspecified": 0.035754,
262
+ "mlp": 0.041584,
263
+ "convgru": 0.048738,
264
+ "gnn": 0.063192,
265
+ "best_neural": "mlp",
266
+ "verdict_vs_misspecified": "mwpm",
267
+ "ratio_misspecified_over_neural": 0.8598018468641785,
268
+ "mismatch_penalty": 1.421517175572519,
269
+ "verdict_vs_true": "mwpm"
270
+ },
271
+ {
272
+ "d": 5,
273
+ "noise": "s1_x0",
274
+ "spread": 1.0,
275
+ "crosstalk": 0.0,
276
+ "trivial": 0.155866,
277
+ "mwpm_true": 0.003168,
278
+ "mwpm_misspecified": 0.003562,
279
+ "mlp": 0.018724,
280
+ "convgru": 0.015072,
281
+ "gnn": 0.01668,
282
+ "best_neural": "convgru",
283
+ "verdict_vs_misspecified": "mwpm",
284
+ "ratio_misspecified_over_neural": 0.23633227176220806,
285
+ "mismatch_penalty": 1.1243686868686869,
286
+ "verdict_vs_true": "mwpm"
287
+ },
288
+ {
289
+ "d": 5,
290
+ "noise": "s1_x0.0005",
291
+ "spread": 1.0,
292
+ "crosstalk": 0.0005,
293
+ "trivial": 0.191118,
294
+ "mwpm_true": 0.011166,
295
+ "mwpm_misspecified": 0.014386,
296
+ "mlp": 0.030922,
297
+ "convgru": 0.028544,
298
+ "gnn": 0.032574,
299
+ "best_neural": "convgru",
300
+ "verdict_vs_misspecified": "mwpm",
301
+ "ratio_misspecified_over_neural": 0.5039938340807175,
302
+ "mismatch_penalty": 1.2883754253985311,
303
+ "verdict_vs_true": "mwpm"
304
+ }
305
+ ],
306
+ "device": [
307
+ {
308
+ "d": 3,
309
+ "rounds": 5,
310
+ "best_neural": "convgru",
311
+ "mlp": 0.1828,
312
+ "convgru": 0.1572,
313
+ "gnn": 0.1593,
314
+ "pymatching": 0.1479,
315
+ "correlated_matching": 0.1376,
316
+ "tensor_network": 0.1252,
317
+ "trivial": 0.2934,
318
+ "verdict_vs_pymatching": "indistinguishable"
319
+ },
320
+ {
321
+ "d": 3,
322
+ "rounds": 25,
323
+ "best_neural": "convgru",
324
+ "mlp": 0.4908,
325
+ "convgru": 0.4892,
326
+ "gnn": 0.4898,
327
+ "pymatching": 0.4302,
328
+ "correlated_matching": 0.4241,
329
+ "tensor_network": 0.4052,
330
+ "trivial": 0.4901,
331
+ "verdict_vs_pymatching": "mwpm"
332
+ },
333
+ {
334
+ "d": 5,
335
+ "rounds": 5,
336
+ "best_neural": "gnn",
337
+ "mlp": 0.3649,
338
+ "convgru": 0.291,
339
+ "gnn": 0.2643,
340
+ "pymatching": 0.1473,
341
+ "correlated_matching": 0.1275,
342
+ "tensor_network": 0.106,
343
+ "trivial": 0.3869,
344
+ "verdict_vs_pymatching": "mwpm"
345
+ }
346
+ ],
347
+ "notes": [],
348
+ "completeness": {
349
+ "regime_a": "24/24",
350
+ "regime_b": "72/72",
351
+ "device": "21/24"
352
+ }
353
+ }
checkpoints/convgru_A_d3_r3_p0.001.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa5ad2e8cecc85627beeccbac28ea646dddd56ade6889827bcd45413833f9d41
3
+ size 647201
checkpoints/convgru_A_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06883843578f77529f7553c51d3f2bd9609970502acdd4e32f1458ba1a7bf85a
3
+ size 647201
checkpoints/convgru_A_d3_r3_p0.005.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b20025f1e5eb0df1d4abb28cfa38bc487c93c527abda7bac78c0a92716a4128
3
+ size 647201
checkpoints/convgru_A_d3_r3_p0.01.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:953aa34f6dee09a162810fffdbf984d26808fcf7fad8fbe3b1bc6bed78e193e3
3
+ size 647112
checkpoints/convgru_A_d5_r5_p0.001.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fb8b90833a6bef0fc0abce389e2bbb0a55930bfb6a78b70b7390580213d56e8
3
+ size 778849
checkpoints/convgru_A_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37809ec4e666efdf977100f7ad7559fc6a57bc02b35bc8502931d96aa794c772
3
+ size 778849
checkpoints/convgru_A_d5_r5_p0.005.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ada5fcffb0132cae9da750c12c4bc901423b22d7e511fb94b3709007123b02a8
3
+ size 778849
checkpoints/convgru_A_d5_r5_p0.01.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90113dde06341ba2c53a402fbec355a84ac1c75e6e237dc4b1533541721e542b
3
+ size 778760
checkpoints/convgru_budget_120000_8_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75ecf09c20f20a044d465846bb9af54219242560b7749eef2a01a74f79a4c079
3
+ size 647615
checkpoints/convgru_budget_120000_8_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13a7814786955c09b0354cd50bd8219e48209784fb29122ee31ca9d072700c93
3
+ size 779199
checkpoints/convgru_budget_400000_25_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:723305b8f9a4a37a695a99df5ff4f77c94e82f27c7ecf98a2991a9e113450955
3
+ size 647640
checkpoints/convgru_budget_400000_25_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b2179bc0cf0e9c8090bf25491c0e3fa48aa7bf8a31e9db933995a1dcc5c2295
3
+ size 779224
checkpoints/convgru_budget_800000_40_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e4826b63a5b6c2dd49ba65f21a9f2acb3fd00a1b3640cd52c55d625af406f6b
3
+ size 647640
checkpoints/convgru_budget_800000_40_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4747d0e98a837123295df357ad84e47dca8332c520585330823c3e4e8cd2361c
3
+ size 779224
checkpoints/convgru_s0_x0.0005_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e4b0dad65902b562a3f9fe6a8c87808b4bf19123046d3e6e5f9fab2ce7ea099
3
+ size 647426
checkpoints/convgru_s0_x0.0005_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:784bf5af6d775f53aa87d2b333cd98f38dbfbe44c9182ea2ed5638ad2141e8da
3
+ size 779074
checkpoints/convgru_s0_x0_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27ff7dcd5505b59ab46df49ba1065ebd1296008291bddeaaa87a08c8c7c2de51
3
+ size 647301
checkpoints/convgru_s0_x0_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f194c0fed53e4e59e10ac63a2ec03b509ef375c375942edd10b2686a5457b67
3
+ size 778949
checkpoints/convgru_s1.75_x0.0015_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03337cbf282bf96f3148be2f87587d7c01577199732388ad2efdc6fccbf71eb5
3
+ size 647501
checkpoints/convgru_s1.75_x0.0015_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b89740e3966f69ad3a9d36b39aa6e35604de6f03066a63eb365a084def8d565
3
+ size 779149
checkpoints/convgru_s1.75_x0_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bf331929b3a12f8e9b10a072c839c27c3eb6abae0a52c1dbcde50d278af41d0
3
+ size 647376
checkpoints/convgru_s1.75_x0_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d9f755762881ec424938f9141dd512f7b35a92d842b745a2291d9f7cb13ec35
3
+ size 779024
checkpoints/convgru_s1_x0.0005_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ba3b2e0e17c9c5ff543b283f3a5f76ce5607fe68bc72bdfcc3ad26eab776365
3
+ size 647426
checkpoints/convgru_s1_x0.0005_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39dbe0a7fb4d8baa8bdf653d117db64d06e94572dc5832c2b45f5792ccc2390a
3
+ size 779074
checkpoints/convgru_s1_x0_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdb9e0a17596af152289049da3ed584b2efc48d63df566cdb80c66518e56229f
3
+ size 647301
checkpoints/convgru_s1_x0_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03483c6ee4fe8be74c6bb4580910911926bd8044b08fbb634d00f0231477f4c2
3
+ size 778949
checkpoints/gnn_A_d3_r3_p0.001.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f04ec496a1548c90e0d0f1a800082d66d1e7c4687926d67656c16f0dfba8a79b
3
+ size 631149
checkpoints/gnn_A_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0f66f28b49702d10b7e0fcbcf40cc56d70bd8152a690e20066ad0e44c55f0e0
3
+ size 631149
checkpoints/gnn_A_d3_r3_p0.005.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3471799e5bc0ba289550f80c2de80501962cbeb8d2a5dbabddfc59a1e57aed2d
3
+ size 631149
checkpoints/gnn_A_d3_r3_p0.01.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7373a84b8b22bfc24432f78bf71bb14486ad3327ba6bffd606212d442fb8d2e
3
+ size 631110
checkpoints/gnn_A_d5_r5_p0.001.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3b963a5c098cada35de10f774cc22caf71a6168e684b31b8d9607835cf6218a
3
+ size 767917
checkpoints/gnn_A_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8842fd9edd098fa0032bd5b8e75e47b169fe9bd70915aeeb9071445f40af14b8
3
+ size 767917
checkpoints/gnn_A_d5_r5_p0.005.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09fbc06ccffea3399f1afc03194491799e2c015ad6c76af90536f86b4cfcde51
3
+ size 767917
checkpoints/gnn_A_d5_r5_p0.01.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6946e49de3afa7999390d10dfae2dbf9acf3d3432627e4fe9d3772cb5f71e06c
3
+ size 767878
checkpoints/gnn_s0_x0.0005_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93e47c0cc486fde0de71ac6fad907313f2cac87e621295096e0bad1d7252397c
3
+ size 631564
checkpoints/gnn_s0_x0.0005_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b6e2dfce50a1c888ce9cc1f39f134ea26c8e47c30895961355b139b5c5b8b3b
3
+ size 768332
checkpoints/gnn_s0_x0_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a10db65ee8e3fa3208c4454bd6f51f22688c732f5b578644d613757655d58487
3
+ size 631369
checkpoints/gnn_s0_x0_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c91ad2eca1923a2988664cb588a1079f6667a225a690d2ab0bdf45e09d5163c
3
+ size 768137
checkpoints/gnn_s1.75_x0.0015_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac78b73e94118b767ae75e5c2ef4109c6d75aece84c92583dfcc01eb1e8d770a
3
+ size 631681
checkpoints/gnn_s1.75_x0.0015_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f433950b032bef2b26def422bae62607d9f27af86be5ef21b8604c844ddf274f
3
+ size 768449
checkpoints/gnn_s1.75_x0_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e77caa511a15dfbbc9eae2dc7ceee82b206d75a640d132702250499cf624ea1b
3
+ size 631486
checkpoints/gnn_s1.75_x0_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:440900eba05124b54a3ad2c2dd5f162f119c281443aafc6cb413d3758a3f3d1a
3
+ size 768254
checkpoints/gnn_s1_x0.0005_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:379e25705719216c8057b05babdb0a9716444fd8587733fc5af3eb80f750dc8b
3
+ size 631564
checkpoints/gnn_s1_x0.0005_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae4ed6a34383f54741f24c24ccfd5711efaca8c1de95cd195e8b107b84ddaa7f
3
+ size 768332
checkpoints/gnn_s1_x0_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15ce1a308b4015eaeac14f5cc74dda5989f7fe2b64f302bbbe0147e0e130c9f0
3
+ size 631369
checkpoints/gnn_s1_x0_d5_r5_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e58d2a57cd257119ed0572958deeb7b4e0f48e989f70ae049680ba4c8e6fbac
3
+ size 768137
checkpoints/mlp_A_d3_r3_p0.001.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7237e5f3ffdbfc107295a0d27fc3e410c30fe3c65f42ff166ea0b578bccb05c7
3
+ size 565614
checkpoints/mlp_A_d3_r3_p0.003.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fbdbecaa140577f96216ec46f5f9bb966e8c4f011c5f7eb43428d8eb0c5d6df
3
+ size 565614