Testing platform for ZShot
| Template | Total Runs | Pass | Fail | Pass Rate | Avg Tokens In | Avg Tokens Out | Tokens In per Pass |
|---|---|---|---|---|---|---|---|
| doom_destroy_a_barrel | 8 | 4 | 4 | 50.0% | 200,028 | 5,984 | 400,056 |
| parcel_redelivery | 218 | 80 | 138 | 36.7% | 169,996 | 16,895 | 451,889 |
Token figures count runs recorded with --llm-usage. Tokens in per pass is every metered run's input over the metered runs that passed.
| ID | Template | Label | Result | Furthest | Tokens | Est. Cost | Took | Created |
|---|---|---|---|---|---|---|---|---|
| 229 | parcel_redelivery | luna-openrouter@rel5-1010 | pass | done | 256,487 in / 11,675 out | $0.000 | 4m 0s | 2026-10-11 02:07 |
| 228 | parcel_redelivery | scout-decision1@rel5-1010 | fail | done | 86,997 in / 1,583 out | $0.093 | 52s | 2026-10-11 02:06 |
| 227 | parcel_redelivery | luna-openrouter@rel5-1010 | fail | done | 80,342 in / 2,914 out | $0.000 | 1m 28s | 2026-10-11 02:05 |
| 226 | parcel_redelivery | scout-decision1@rel5-1010 | fail | confirm | 280,791 in / 7,796 out | $0.632 | 2m 24s | 2026-10-11 02:03 |
| 225 | parcel_redelivery | scout-jev-1.13-openrouter@rel5-1010 | pass | done | 246,675 in / 10,020 out | $0.281 | 1m 30s | 2026-10-11 01:44 |
| 224 | parcel_redelivery | scout-microsoft-decision-1-openrouter@rel5-1010 | fail | done | 81,497 in / 1,294 out | $0.084 | 43s | 2026-10-11 01:44 |
| 223 | parcel_redelivery | scout-jev-1.13-openrouter@rel5-1010 | pass | done | 239,810 in / 9,647 out | $0.263 | 1m 24s | 2026-10-11 01:42 |
| 222 | parcel_redelivery | scout-microsoft-decision-1-openrouter@rel5-1010 | pass | done | 151,508 in / 3,745 out | $0.270 | 1m 20s | 2026-10-11 01:41 |
| 221 | parcel_redelivery | luna@rel5-1010 | pass | done | 194,819 in / 5,217 out | $0.021 | 2m 25s | 2026-10-10 20:10 |
| 220 | parcel_redelivery | scout-clef@rel5-1010 | pass | done | 397,084 in / 14,192 out | $0.657 | 3m 27s | 2026-10-10 20:06 |
| 219 | parcel_redelivery | scout-sonnet-opus@rel5-1010 | pass | done | 221,811 in / 8,855 out | $0.274 | 1m 13s | 2026-10-10 20:05 |
| 218 | parcel_redelivery | haiku@rel5-1010 | pass | done | 435,817 in / 28,254 out | $0.058 | 3m 31s | 2026-10-10 20:02 |
| 217 | parcel_redelivery | deepseek@rel5-1010 | fail | preferences | 131,763 in / 38,726 out | $0.078 | 4m 10s | 2026-10-10 19:57 |
| 216 | parcel_redelivery | gpt@rel5-1010 | pass | done | 298,469 in / 2,710 out | $3.08 | 3m 10s | 2026-10-10 19:54 |
| 215 | parcel_redelivery | opus@rel5-1010 | pass | done | 101,085 in / 2,978 out | $0.464 | 1m 17s | 2026-10-10 19:53 |
| 214 | parcel_redelivery | sonnet@rel5-1010 | pass | done | 147,774 in / 4,359 out | $0.339 | 1m 18s | 2026-10-10 19:52 |
| 213 | parcel_redelivery | luna@rel5-1010 | fail | done | 138,757 in / 2,617 out | $0.015 | 1m 35s | 2026-10-10 19:50 |
| 212 | parcel_redelivery | scout-clef@rel5-1010 | fail | slot | 680,932 in / 13,012 out | $1.10 | 4m 52s | 2026-10-10 19:45 |
| 211 | parcel_redelivery | scout-sonnet-opus@rel5-1010 | pass | done | 176,649 in / 6,708 out | $0.218 | 58s | 2026-10-10 19:44 |
| 210 | parcel_redelivery | haiku@rel5-1010 | pass | done | 107,090 in / 6,913 out | $0.014 | 1m 8s | 2026-10-10 19:43 |
| 209 | parcel_redelivery | deepseek@rel5-1010 | fail | preferences | 72,692 in / 11,205 out | $0.031 | 1m 51s | 2026-10-10 19:41 |
| 208 | parcel_redelivery | gpt@rel5-1010 | pass | done | 263,726 in / 2,028 out | $2.71 | 2m 30s | 2026-10-10 19:39 |
| 207 | parcel_redelivery | opus@rel5-1010 | pass | done | 131,895 in / 3,310 out | $0.594 | 1m 27s | 2026-10-10 19:37 |
| 206 | parcel_redelivery | sonnet@rel5-1010 | pass | done | 157,037 in / 4,630 out | $0.360 | 1m 21s | 2026-10-10 19:36 |
| 205 | parcel_redelivery | luna@rel-1010 | fail | done | 222,609 in / 7,136 out | $0.026 | 3m 11s | 2026-10-10 19:19 |
| 204 | parcel_redelivery | scout-clef@rel-1010 | fail | human | 108,753 in / 2,273 out | $0.149 | 1m 5s | 2026-10-10 19:18 |
| 203 | parcel_redelivery | scout-sonnet-opus@rel-1010 | fail | human | 64,405 in / 4,139 out | $0.092 | 34s | 2026-10-10 19:18 |
| 202 | parcel_redelivery | haiku@rel-1010 | fail | human | 31,279 in / 2,111 out | $0.004 | 24s | 2026-10-10 19:17 |
| 201 | parcel_redelivery | deepseek@rel-1010 | fail | human | 42,722 in / 9,394 out | $0.020 | 1m 40s | 2026-10-10 19:15 |
| 200 | parcel_redelivery | gpt@rel-1010 | pass | done | 301,630 in / 2,244 out | $3.12 | 3m 0s | 2026-10-10 19:12 |
| 199 | parcel_redelivery | opus@rel-1010 | pass | done | 154,291 in / 4,087 out | $0.699 | 1m 56s | 2026-10-10 19:11 |
| 198 | parcel_redelivery | sonnet@rel-1010 | fail | human | 29,421 in / 1,524 out | $0.074 | 31s | 2026-10-10 19:10 |
| 197 | parcel_redelivery | scout-clef@rel-1010 | pass | done | 252,309 in / 2,138 out | $0.414 | 1m 47s | 2026-10-10 19:08 |
| 196 | parcel_redelivery | scout-sonnet-opus@rel-1010 | fail | human | 64,740 in / 4,642 out | $0.105 | 41s | 2026-10-10 19:08 |
| 195 | parcel_redelivery | haiku@rel-1010 | fail | human | 31,311 in / 2,078 out | $0.004 | 24s | 2026-10-10 19:07 |
| 194 | parcel_redelivery | deepseek@rel-1010 | fail | preferences | 181,454 in / 69,079 out | $0.128 | 7m 15s | 2026-10-10 19:00 |
| 193 | parcel_redelivery | gpt@rel-1010 | pass | done | 211,153 in / 1,532 out | $2.19 | 2m 5s | 2026-10-10 18:58 |
| 192 | parcel_redelivery | opus@rel-1010 | pass | done | 148,255 in / 6,037 out | $0.714 | 2m 12s | 2026-10-10 18:56 |
| 191 | parcel_redelivery | sonnet@rel-1010 | fail | human | 37,094 in / 1,535 out | $0.090 | 30s | 2026-10-10 18:55 |
| 190 | parcel_redelivery | luna@rel-1010 | pass | done | 102,772 in / 3,065 out | $0.012 | 1m 44s | 2026-10-10 18:53 |
| 189 | parcel_redelivery | haiku@visual-memory-1010 | pass | done | 145,002 in / 8,521 out | $0.019 | 1m 38s | 2026-10-10 10:29 |
| 188 | parcel_redelivery | scout-clef@visual-memory-1010 | pass | done | 152,412 in / 2,384 out | $0.209 | 1m 27s | 2026-10-10 10:28 |
| 187 | parcel_redelivery | scout-sonnet-opus@visual-memory-1010 | pass | done | 177,068 in / 6,712 out | $0.262 | 1m 26s | 2026-10-10 10:27 |
| 186 | parcel_redelivery | deepseek@visual-memory-1010 | pass | done | 92,736 in / 11,788 out | $0.040 | 1m 58s | 2026-10-10 10:25 |
| 185 | parcel_redelivery | gpt@visual-memory-1010 | pass | done | 257,742 in / 2,083 out | $2.68 | 3m 18s | 2026-10-10 10:21 |
| 184 | parcel_redelivery | opus@visual-memory-1010 | pass | done | 136,653 in / 3,552 out | $0.618 | 1m 53s | 2026-10-10 10:19 |
| 183 | parcel_redelivery | sonnet@visual-memory-1010 | pass | done | 152,043 in / 5,503 out | $0.359 | 1m 49s | 2026-10-10 10:18 |
| 182 | parcel_redelivery | haiku@visual-memory-1010 | fail | human | 28,426 in / 2,177 out | $0.004 | 25s | 2026-10-10 10:17 |
| 181 | parcel_redelivery | scout-clef@visual-memory-1010 | fail | done | 192,841 in / 1,105 out | $0.150 | 1m 39s | 2026-10-10 10:15 |
| 180 | parcel_redelivery | scout-sonnet-opus@visual-memory-1010 | fail | human | 70,439 in / 5,139 out | $0.112 | 48s | 2026-10-10 10:14 |