Testing platform for ZShot
| Template | Total Runs | Pass | Fail | Pass Rate | Avg Tokens In | Avg Tokens Out | Tokens In per Pass |
|---|---|---|---|---|---|---|---|
| doom_destroy_a_barrel | 8 | 4 | 4 | 50.0% | 200,028 | 5,984 | 400,056 |
| parcel_redelivery | 218 | 80 | 138 | 36.7% | 169,996 | 16,895 | 451,889 |
Token figures count runs recorded with --llm-usage. Tokens in per pass is every metered run's input over the metered runs that passed.
| ID | Template | Label | Result | Furthest | Tokens | Est. Cost | Took | Created |
|---|---|---|---|---|---|---|---|---|
| 179 | parcel_redelivery | deepseek@visual-memory-1010 | fail | human | 64,949 in / 15,582 out | $0.036 | 2m 9s | 2026-10-10 10:12 |
| 178 | parcel_redelivery | gpt@visual-memory-1010 | pass | done | 263,330 in / 1,994 out | $2.71 | 3m 18s | 2026-10-10 10:09 |
| 177 | parcel_redelivery | opus@visual-memory-1010 | pass | done | 310,967 in / 15,389 out | $1.55 | 5m 4s | 2026-10-10 10:04 |
| 176 | parcel_redelivery | sonnet@visual-memory-1010 | fail | human | 31,297 in / 1,280 out | $0.075 | 31s | 2026-10-10 10:03 |
| 175 | parcel_redelivery | haiku@local-1009 | pass | done | 225,997 in / 15,669 out | $0.030 | 2m 21s | 2026-10-10 00:36 |
| 174 | parcel_redelivery | scout-clef@local-1009 | pass | done | 166,772 in / 1,726 out | $0.398 | 1m 30s | 2026-10-10 00:34 |
| 173 | parcel_redelivery | scout-sonnet-opus@local-1009 | pass | done | 208,007 in / 7,490 out | $0.290 | 1m 22s | 2026-10-10 00:33 |
| 172 | parcel_redelivery | deepseek@local-1009 | fail | preferences | 79,081 in / 13,676 out | $0.037 | 2m 28s | 2026-10-10 00:30 |
| 171 | parcel_redelivery | gpt@local-1009 | pass | done | 286,523 in / 2,516 out | $2.99 | 3m 44s | 2026-10-10 00:27 |
| 170 | parcel_redelivery | opus@local-1009 | pass | done | 130,264 in / 3,613 out | $0.593 | 1m 33s | 2026-10-10 00:25 |
| 169 | parcel_redelivery | sonnet@local-1009 | pass | done | 140,153 in / 4,934 out | $0.330 | 1m 29s | 2026-10-10 00:24 |
| 168 | doom_destroy_a_barrel | clef@doom-1009 | fail | — | 40,988 in / 0 out | $0.010 | 38s | 2026-10-09 19:57 |
| 167 | doom_destroy_a_barrel | clef@doom-1009 | fail | — | 40,988 in / 0 out | $0.010 | 36s | 2026-10-09 19:56 |
| 166 | doom_destroy_a_barrel | clef@doom-1009 | fail | — | 40,988 in / 0 out | $0.010 | 39s | 2026-10-09 19:55 |
| 165 | doom_destroy_a_barrel | scout-clef@doom-1009c | pass | — | 291,007 in / 10,864 out | $0.699 | 4m 10s | 2026-10-09 19:22 |
| 164 | doom_destroy_a_barrel | scout-clef@doom-1009c | pass | — | 436,440 in / 12,703 out | $1.31 | 5m 35s | 2026-10-09 19:17 |
| 163 | doom_destroy_a_barrel | scout-clef@doom-1009c | pass | — | 420,114 in / 11,173 out | $1.24 | 5m 22s | 2026-10-09 19:11 |
| 162 | doom_destroy_a_barrel | scout-clef@doom-1009b | active | — | — | — | — | 2026-10-09 19:10 |
| 161 | doom_destroy_a_barrel | scout-clef@doom-1009b | pass | — | 328,589 in / 13,135 out | $0.912 | 4m 58s | 2026-10-09 19:05 |
| 160 | doom_destroy_a_barrel | scout-clef@doom-1009 | fail | — | 1,112 in / 0 out | $0.000 | 3s | 2026-10-09 18:55 |
| 159 | parcel_redelivery | haiku-replay@1008 | pass | done | — | — | 12s | 2026-10-08 18:51 |
| 158 | parcel_redelivery | haiku@replay-1008 | pass | done | 131,639 in / 9,446 out | $0.018 | 1m 31s | 2026-10-08 18:49 |
| 157 | parcel_redelivery | haiku-replay@1008 | fail | preferences | — | — | 42s | 2026-10-08 18:47 |
| 156 | parcel_redelivery | haiku-replay@1008 | fail | slot | — | — | 39s | 2026-10-08 18:43 |
| 155 | parcel_redelivery | haiku-replay@1008 | fail | consent | — | — | 31s | 2026-10-08 18:41 |
| 154 | parcel_redelivery | haiku@replay-1008 | pass | done | 152,029 in / 10,002 out | $0.020 | 1m 36s | 2026-10-08 18:39 |
| 153 | parcel_redelivery | haiku-replay@1008 | active | — | — | — | — | 2026-10-08 16:20 |
| 152 | parcel_redelivery | haiku@replay-1008 | pass | done | 149,729 in / 10,351 out | $0.020 | 1m 44s | 2026-10-08 16:18 |
| 151 | parcel_redelivery | deepseek@local-1002 | pass | done | 284,463 in / 155,057 out | $0.256 | 13m 4s | 2026-10-02 17:21 |
| 150 | parcel_redelivery | gpt@local-1002 | pass | done | 147,902 in / 776 out | $1.45 | 2m 22s | 2026-10-02 17:13 |
| 149 | parcel_redelivery | opus@local-1002 | pass | done | 194,170 in / 4,544 out | $0.868 | 2m 48s | 2026-10-02 17:13 |
| 148 | parcel_redelivery | sonnet@local-1002 | pass | done | 165,865 in / 4,969 out | $0.381 | 2m 3s | 2026-10-02 17:11 |
| 147 | parcel_redelivery | deepseek@local-1002 | fail | done | 163,489 in / 121,802 out | $0.181 | 10m 14s | 2026-10-02 17:11 |
| 146 | parcel_redelivery | scout-sonnet-opus@local-1002 | fail | done | 69,687 in / 4,072 out | $0.041 | 34s | 2026-10-02 17:11 |
| 145 | parcel_redelivery | gpt@local-1002 | pass | done | 212,360 in / 1,033 out | $2.18 | 2m 38s | 2026-10-02 17:11 |
| 144 | parcel_redelivery | opus@local-1002 | pass | done | 174,237 in / 4,098 out | $0.779 | 3m 0s | 2026-10-02 17:10 |
| 143 | parcel_redelivery | sonnet@local-1002 | pass | done | 166,157 in / 4,910 out | $0.381 | 2m 2s | 2026-10-02 17:09 |
| 142 | parcel_redelivery | scout-sonnet-opus@local-1002 | pass | done | 224,486 in / 7,659 out | $0.484 | 1m 46s | 2026-10-02 17:09 |
| 141 | parcel_redelivery | deepseek@local-1002 | pass | done | 132,842 in / 35,360 out | $0.077 | 3m 54s | 2026-10-02 17:07 |
| 140 | parcel_redelivery | sonnet@local-1002 | pass | done | 166,093 in / 5,631 out | $0.388 | 2m 3s | 2026-10-02 17:07 |
| 139 | parcel_redelivery | scout-sonnet-opus@local-1002 | pass | done | 221,739 in / 7,660 out | $0.607 | 2m 2s | 2026-10-02 17:07 |
| 138 | parcel_redelivery | opus@local-1002 | pass | done | 174,963 in / 4,614 out | $0.792 | 2m 41s | 2026-10-02 17:07 |
| 137 | parcel_redelivery | gpt@local-1002 | pass | done | 257,832 in / 1,548 out | $2.66 | 3m 32s | 2026-10-02 17:07 |
| 136 | parcel_redelivery | scout-sonnet | fail | done | 169,470 in / 7,165 out | $0.216 | 1m 25s | 2026-09-28 19:32 |
| 135 | parcel_redelivery | scout-sonnet-opus | pass | done | 195,820 in / 6,700 out | $0.493 | 2m 3s | 2026-09-28 19:32 |
| 134 | parcel_redelivery | sonnet | pass | done | 164,863 in / 5,464 out | $0.384 | 1m 57s | 2026-09-28 19:32 |
| 133 | parcel_redelivery | scout-sonnet-opus | pass | done | 193,058 in / 6,269 out | $0.572 | 2m 7s | 2026-09-28 19:30 |
| 132 | parcel_redelivery | scout-sonnet | fail | done | 257,770 in / 11,822 out | $0.453 | 2m 33s | 2026-09-28 19:30 |
| 131 | parcel_redelivery | sonnet | pass | done | 191,474 in / 6,656 out | $0.450 | 2m 15s | 2026-09-28 19:30 |
| 130 | parcel_redelivery | scout-sonnet | pass | done | 209,867 in / 8,304 out | $0.338 | 1m 54s | 2026-09-28 19:28 |