ZShot Gym

← Back to Scoreboard

parcel_redelivery

By Label

Label Runs Pass Rate Avg Calls Avg Tokens In Avg Tokens Out Tokens In per Pass
luna-openrouter@rel5-1010 2 50.0% 38 168,414 7,294 336,829
scout-decision1@rel5-1010 2 0.0% 43 183,894 4,689 —
scout-jev-1.13-openrouter@rel5-1010 2 100.0% 61 243,242 9,833 243,242
scout-microsoft-decision-1-openrouter@rel5-1010 2 50.0% 33 116,502 2,519 233,005
luna@rel5-1010 2 50.0% 41 166,788 3,917 333,576
scout-clef@rel5-1010 2 50.0% 88 539,008 13,602 1,078,016
scout-sonnet-opus@rel5-1010 2 100.0% 51 199,230 7,781 199,230
haiku@rel5-1010 2 100.0% 38 271,453 17,583 271,453
deepseek@rel5-1010 2 0.0% 31 102,227 24,965 —
gpt@rel5-1010 2 100.0% 63 281,097 2,369 281,097
opus@rel5-1010 2 100.0% 24 116,490 3,144 116,490
sonnet@rel5-1010 2 100.0% 28 152,405 4,494 152,405
luna@rel-1010 2 50.0% 39 162,690 5,100 325,381
scout-clef@rel-1010 2 50.0% 48 180,531 2,205 361,062
scout-sonnet-opus@rel-1010 2 0.0% 23 64,572 4,390 —
haiku@rel-1010 2 0.0% 8 31,295 2,094 —
deepseek@rel-1010 2 0.0% 37 112,088 39,236 —
gpt@rel-1010 2 100.0% 58 256,391 1,888 256,391
opus@rel-1010 2 100.0% 32 151,273 5,062 151,273
sonnet@rel-1010 2 0.0% 8 33,257 1,529 —
haiku@visual-memory-1010 2 50.0% 17 86,714 5,349 173,428
scout-clef@visual-memory-1010 2 50.0% 48 172,626 1,744 345,253
scout-sonnet-opus@visual-memory-1010 2 50.0% 34 123,753 5,925 247,507
deepseek@visual-memory-1010 2 50.0% 25 78,842 13,685 157,685
gpt@visual-memory-1010 2 100.0% 60 260,536 2,038 260,536
opus@visual-memory-1010 2 100.0% 38 223,810 9,470 223,810
sonnet@visual-memory-1010 2 50.0% 19 91,670 3,391 183,340
haiku@local-1009 1 100.0% 36 225,997 15,669 225,997
scout-clef@local-1009 1 100.0% 42 166,772 1,726 166,772
scout-sonnet-opus@local-1009 1 100.0% 49 208,007 7,490 208,007
deepseek@local-1009 1 0.0% 26 79,081 13,676 —
gpt@local-1009 1 100.0% 64 286,523 2,516 286,523
opus@local-1009 1 100.0% 25 130,264 3,613 130,264
sonnet@local-1009 1 100.0% 26 140,153 4,934 140,153
haiku-replay@1008 4 (0 metered) 25.0% — — — —
haiku@replay-1008 3 100.0% 27 144,465 9,933 144,465
deepseek@local-1002 3 66.7% 44 193,598 104,073 290,397
gpt@local-1002 3 100.0% 41 206,031 1,119 206,031
opus@local-1002 3 100.0% 30 181,123 4,418 181,123
sonnet@local-1002 3 100.0% 27 166,038 5,170 166,038
scout-sonnet-opus@local-1002 3 66.7% 45 171,970 6,463 257,956
scout-sonnet 9 11.1% 44 179,887 7,557 1,618,984
scout-sonnet-opus 7 71.4% 43 163,169 5,801 228,437
sonnet 7 28.6% 46 313,229 16,507 1,096,304
scout-mercury 14 (10 metered) 35.7% 43 183,373 9,845 366,746
scout-mercury-deepseek 5 0.0% 50 156,482 47,298 —
scout-deepseek 18 16.7% 34 103,148 22,961 618,888
scout-gemini 18 0.0% 28 75,676 13,248 —
scout-qwen 8 0.0% 49 188,452 4,504 —
scout-gpt 4 25.0% 39 121,387 3,711 485,548
scout-opus 4 100.0% 44 184,473 5,918 184,473
opus-thinking 4 25.0% 43 246,920 10,717 987,682
deepseek 4 0.0% 49 196,120 115,382 —
deepseek-low 4 0.0% 67 284,869 85,248 —
gemini 4 0.0% 40 171,364 97,668 —
qwen-noreasoning 4 0.0% 62 342,610 3,564 —
opus 4 50.0% 37 220,583 8,974 441,166
deepseek-noreasoning 6 0.0% 47 179,503 3,655 —
gpt 2 100.0% 44 209,114 1,752 209,114
scout-local 2 0.0% 7 6,772 637 —
local 2 0.0% 1 0 0 —
scout+writer-turns-v3-no-captcha 1 0.0% 128 279,904 35,978 —
scout+writer-turns-v2-no-captcha 1 0.0% 50 197,821 13,116 —
scout+writer-turns-no-captcha 1 0.0% 112 252,803 32,430 —
scout+writer-turns 1 0.0% 98 465,984 11,258 —
scout+writer 1 0.0% 28 56,197 3,067 —

Sessions

ID Label Result Furthest Tokens Est. Cost Took Created
229 luna-openrouter@rel5-1010 pass done 256,487 in / 11,675 out $0.000 4m 0s 2026-10-11 02:07
228 scout-decision1@rel5-1010 fail done 86,997 in / 1,583 out $0.093 52s 2026-10-11 02:06
227 luna-openrouter@rel5-1010 fail done 80,342 in / 2,914 out $0.000 1m 28s 2026-10-11 02:05
226 scout-decision1@rel5-1010 fail confirm 280,791 in / 7,796 out $0.632 2m 24s 2026-10-11 02:03
225 scout-jev-1.13-openrouter@rel5-1010 pass done 246,675 in / 10,020 out $0.281 1m 30s 2026-10-11 01:44
224 scout-microsoft-decision-1-openrouter@rel5-1010 fail done 81,497 in / 1,294 out $0.084 43s 2026-10-11 01:44
223 scout-jev-1.13-openrouter@rel5-1010 pass done 239,810 in / 9,647 out $0.263 1m 24s 2026-10-11 01:42
222 scout-microsoft-decision-1-openrouter@rel5-1010 pass done 151,508 in / 3,745 out $0.270 1m 20s 2026-10-11 01:41
221 luna@rel5-1010 pass done 194,819 in / 5,217 out $0.021 2m 25s 2026-10-10 20:10
220 scout-clef@rel5-1010 pass done 397,084 in / 14,192 out $0.657 3m 27s 2026-10-10 20:06
219 scout-sonnet-opus@rel5-1010 pass done 221,811 in / 8,855 out $0.274 1m 13s 2026-10-10 20:05
218 haiku@rel5-1010 pass done 435,817 in / 28,254 out $0.058 3m 31s 2026-10-10 20:02
217 deepseek@rel5-1010 fail preferences 131,763 in / 38,726 out $0.078 4m 10s 2026-10-10 19:57
216 gpt@rel5-1010 pass done 298,469 in / 2,710 out $3.08 3m 10s 2026-10-10 19:54
215 opus@rel5-1010 pass done 101,085 in / 2,978 out $0.464 1m 17s 2026-10-10 19:53
214 sonnet@rel5-1010 pass done 147,774 in / 4,359 out $0.339 1m 18s 2026-10-10 19:52
213 luna@rel5-1010 fail done 138,757 in / 2,617 out $0.015 1m 35s 2026-10-10 19:50
212 scout-clef@rel5-1010 fail slot 680,932 in / 13,012 out $1.10 4m 52s 2026-10-10 19:45
211 scout-sonnet-opus@rel5-1010 pass done 176,649 in / 6,708 out $0.218 58s 2026-10-10 19:44
210 haiku@rel5-1010 pass done 107,090 in / 6,913 out $0.014 1m 8s 2026-10-10 19:43
209 deepseek@rel5-1010 fail preferences 72,692 in / 11,205 out $0.031 1m 51s 2026-10-10 19:41
208 gpt@rel5-1010 pass done 263,726 in / 2,028 out $2.71 2m 30s 2026-10-10 19:39
207 opus@rel5-1010 pass done 131,895 in / 3,310 out $0.594 1m 27s 2026-10-10 19:37
206 sonnet@rel5-1010 pass done 157,037 in / 4,630 out $0.360 1m 21s 2026-10-10 19:36
205 luna@rel-1010 fail done 222,609 in / 7,136 out $0.026 3m 11s 2026-10-10 19:19
204 scout-clef@rel-1010 fail human 108,753 in / 2,273 out $0.149 1m 5s 2026-10-10 19:18
203 scout-sonnet-opus@rel-1010 fail human 64,405 in / 4,139 out $0.092 34s 2026-10-10 19:18
202 haiku@rel-1010 fail human 31,279 in / 2,111 out $0.004 24s 2026-10-10 19:17
201 deepseek@rel-1010 fail human 42,722 in / 9,394 out $0.020 1m 40s 2026-10-10 19:15
200 gpt@rel-1010 pass done 301,630 in / 2,244 out $3.12 3m 0s 2026-10-10 19:12
199 opus@rel-1010 pass done 154,291 in / 4,087 out $0.699 1m 56s 2026-10-10 19:11
198 sonnet@rel-1010 fail human 29,421 in / 1,524 out $0.074 31s 2026-10-10 19:10
197 scout-clef@rel-1010 pass done 252,309 in / 2,138 out $0.414 1m 47s 2026-10-10 19:08
196 scout-sonnet-opus@rel-1010 fail human 64,740 in / 4,642 out $0.105 41s 2026-10-10 19:08
195 haiku@rel-1010 fail human 31,311 in / 2,078 out $0.004 24s 2026-10-10 19:07
194 deepseek@rel-1010 fail preferences 181,454 in / 69,079 out $0.128 7m 15s 2026-10-10 19:00
193 gpt@rel-1010 pass done 211,153 in / 1,532 out $2.19 2m 5s 2026-10-10 18:58
192 opus@rel-1010 pass done 148,255 in / 6,037 out $0.714 2m 12s 2026-10-10 18:56
191 sonnet@rel-1010 fail human 37,094 in / 1,535 out $0.090 30s 2026-10-10 18:55
190 luna@rel-1010 pass done 102,772 in / 3,065 out $0.012 1m 44s 2026-10-10 18:53
189 haiku@visual-memory-1010 pass done 145,002 in / 8,521 out $0.019 1m 38s 2026-10-10 10:29
188 scout-clef@visual-memory-1010 pass done 152,412 in / 2,384 out $0.209 1m 27s 2026-10-10 10:28
187 scout-sonnet-opus@visual-memory-1010 pass done 177,068 in / 6,712 out $0.262 1m 26s 2026-10-10 10:27
186 deepseek@visual-memory-1010 pass done 92,736 in / 11,788 out $0.040 1m 58s 2026-10-10 10:25
185 gpt@visual-memory-1010 pass done 257,742 in / 2,083 out $2.68 3m 18s 2026-10-10 10:21
184 opus@visual-memory-1010 pass done 136,653 in / 3,552 out $0.618 1m 53s 2026-10-10 10:19
183 sonnet@visual-memory-1010 pass done 152,043 in / 5,503 out $0.359 1m 49s 2026-10-10 10:18
182 haiku@visual-memory-1010 fail human 28,426 in / 2,177 out $0.004 25s 2026-10-10 10:17
181 scout-clef@visual-memory-1010 fail done 192,841 in / 1,105 out $0.150 1m 39s 2026-10-10 10:15
180 scout-sonnet-opus@visual-memory-1010 fail human 70,439 in / 5,139 out $0.112 48s 2026-10-10 10:14