Testing platform for ZShot
| Template | Total Runs | Pass | Fail | Pass Rate | Avg Tokens In | Avg Tokens Out | Tokens In per Pass |
|---|---|---|---|---|---|---|---|
| doom_destroy_a_barrel | 8 | 4 | 4 | 50.0% | 200,028 | 5,984 | 400,056 |
| parcel_redelivery | 218 | 80 | 138 | 36.7% | 169,996 | 16,895 | 451,889 |
Token figures count runs recorded with --llm-usage. Tokens in per pass is every metered run's input over the metered runs that passed.
| ID | Template | Label | Result | Furthest | Tokens | Est. Cost | Took | Created |
|---|---|---|---|---|---|---|---|---|
| 129 | parcel_redelivery | scout-sonnet-opus | pass | done | 197,212 in / 6,683 out | $0.565 | 2m 1s | 2026-09-28 19:28 |
| 128 | parcel_redelivery | sonnet | fail | confirm | 156,472 in / 4,712 out | $0.360 | 1m 46s | 2026-09-28 19:28 |
| 127 | parcel_redelivery | scout-mercury | fail | lookup | 11,315 in / 2,870 out | $0.005 | 12s | 2026-09-28 16:50 |
| 126 | parcel_redelivery | scout-mercury | fail | lookup | 11,309 in / 3,512 out | $0.005 | 16s | 2026-09-28 16:50 |
| 125 | parcel_redelivery | scout-mercury | fail | lookup | 25,855 in / 3,951 out | $0.011 | 17s | 2026-09-28 16:50 |
| 124 | parcel_redelivery | scout-mercury | fail | preferences | 146,857 in / 11,552 out | $0.346 | 1m 47s | 2026-09-28 16:48 |
| 123 | parcel_redelivery | scout-mercury-deepseek | fail | confirm | 157,722 in / 33,136 out | $0.081 | 3m 4s | 2026-09-28 16:45 |
| 122 | parcel_redelivery | scout-mercury-deepseek | fail | done | 162,143 in / 74,191 out | $0.130 | 6m 13s | 2026-09-28 16:38 |
| 121 | parcel_redelivery | scout-mercury-deepseek | fail | done | 153,551 in / 54,695 out | $0.108 | 4m 47s | 2026-09-28 16:34 |
| 120 | parcel_redelivery | scout-mercury | fail | consent | — | — | 0s | 2026-09-28 16:30 |
| 119 | parcel_redelivery | scout-mercury | fail | consent | — | — | 0s | 2026-09-28 16:30 |
| 118 | parcel_redelivery | scout-mercury | fail | consent | — | — | 0s | 2026-09-28 16:30 |
| 117 | parcel_redelivery | scout-mercury | fail | consent | — | — | 0s | 2026-09-28 16:30 |
| 116 | parcel_redelivery | scout-mercury-deepseek | fail | confirm | 203,110 in / 63,951 out | $0.123 | 5m 13s | 2026-09-28 16:28 |
| 115 | parcel_redelivery | scout-mercury | pass | done | 234,010 in / 15,321 out | $0.588 | 2m 18s | 2026-09-28 16:27 |
| 114 | parcel_redelivery | scout-mercury-deepseek | fail | done | 105,884 in / 10,519 out | $0.044 | 55s | 2026-09-28 16:27 |
| 113 | parcel_redelivery | scout-mercury | pass | done | 322,346 in / 13,213 out | $0.787 | 4m 52s | 2026-09-28 16:15 |
| 112 | parcel_redelivery | scout-mercury | pass | done | 360,317 in / 14,388 out | $0.908 | 7m 35s | 2026-09-28 16:07 |
| 111 | parcel_redelivery | scout-mercury | fail | done | 187,622 in / 9,534 out | $0.173 | 10m 1s | 2026-09-28 15:57 |
| 110 | parcel_redelivery | scout-mercury | pass | done | 254,573 in / 11,731 out | $0.700 | 2m 23s | 2026-09-28 15:55 |
| 109 | parcel_redelivery | scout-deepseek | pass | done | 143,479 in / 25,057 out | $0.072 | 3m 37s | 2026-09-28 15:53 |
| 108 | parcel_redelivery | scout-deepseek | fail | done | 197,810 in / 41,376 out | $0.112 | 5m 40s | 2026-09-28 15:48 |
| 107 | parcel_redelivery | scout-mercury | pass | done | 279,529 in / 12,381 out | $0.715 | 7m 38s | 2026-09-28 15:47 |
| 106 | parcel_redelivery | scout-gemini | fail | done | 121,543 in / 18,973 out | $0.123 | 2m 58s | 2026-09-28 15:45 |
| 105 | parcel_redelivery | scout-deepseek | fail | done | 148,998 in / 24,220 out | $0.075 | 4m 16s | 2026-09-28 15:43 |
| 104 | parcel_redelivery | scout-gemini | fail | done | 119,717 in / 14,807 out | $0.111 | 4m 0s | 2026-09-28 15:41 |
| 103 | parcel_redelivery | scout-gemini | fail | done | 150,411 in / 17,651 out | $0.144 | 2m 27s | 2026-09-28 15:38 |
| 102 | parcel_redelivery | scout-deepseek | pass | done | 179,844 in / 59,884 out | $0.121 | 5m 52s | 2026-09-28 15:38 |
| 101 | parcel_redelivery | scout-gemini | fail | done | 72,235 in / 8,534 out | $0.055 | 1m 2s | 2026-09-28 15:37 |
| 100 | parcel_redelivery | scout-deepseek | fail | done | 101,221 in / 16,193 out | $0.050 | 1m 51s | 2026-09-28 15:36 |
| 99 | parcel_redelivery | scout-gemini | fail | done | 100,274 in / 9,914 out | $0.079 | 1m 26s | 2026-09-28 15:36 |
| 98 | parcel_redelivery | scout-deepseek | fail | consent | 0 in / 0 out | $0.000 | 39s | 2026-09-28 13:37 |
| 97 | parcel_redelivery | scout-gemini | fail | consent | 1,887 in / 218 out | $0.001 | 52s | 2026-09-28 13:37 |
| 96 | parcel_redelivery | scout-deepseek | fail | consent | 5,477 in / 539 out | $0.002 | 1m 53s | 2026-09-28 13:35 |
| 95 | parcel_redelivery | scout-gemini | fail | consent | 9,366 in / 872 out | $0.004 | 1m 47s | 2026-09-28 13:35 |
| 94 | parcel_redelivery | scout-deepseek | fail | consent | 4,090 in / 438 out | $0.002 | 2m 14s | 2026-09-28 13:33 |
| 93 | parcel_redelivery | scout-gemini | fail | consent | 3,171 in / 320 out | $0.001 | 1m 36s | 2026-09-28 13:33 |
| 92 | parcel_redelivery | scout-deepseek | fail | consent | 1,884 in / 218 out | $0.001 | 1m 20s | 2026-09-28 13:32 |
| 91 | parcel_redelivery | scout-gemini | fail | consent | 3,171 in / 320 out | $0.001 | 1m 59s | 2026-09-28 13:31 |
| 90 | parcel_redelivery | scout-deepseek | fail | consent | 3,165 in / 320 out | $0.001 | 1m 32s | 2026-09-28 13:30 |
| 89 | parcel_redelivery | scout-gemini | fail | consent | 3,171 in / 320 out | $0.001 | 53s | 2026-09-28 13:30 |
| 88 | parcel_redelivery | scout-deepseek | pass | done | 129,108 in / 18,506 out | $0.062 | 3m 5s | 2026-09-28 13:21 |
| 87 | parcel_redelivery | scout-qwen | fail | confirm | 227,624 in / 5,297 out | $0.048 | 4m 53s | 2026-09-28 13:21 |
| 86 | parcel_redelivery | scout-gemini | fail | done | 91,100 in / 11,012 out | $0.077 | 2m 19s | 2026-09-28 13:20 |
| 85 | parcel_redelivery | scout-gpt | pass | done | 171,995 in / 4,856 out | $0.754 | 2m 28s | 2026-09-28 13:20 |
| 84 | parcel_redelivery | scout-qwen | fail | confirm | 144,694 in / 4,482 out | $0.028 | 4m 18s | 2026-09-28 13:17 |
| 83 | parcel_redelivery | scout-gpt | fail | done | 205,635 in / 4,558 out | $1.18 | 3m 20s | 2026-09-28 13:17 |
| 82 | parcel_redelivery | scout-gemini | fail | done | 115,151 in / 28,198 out | $0.159 | 3m 56s | 2026-09-28 13:16 |
| 81 | parcel_redelivery | scout-deepseek | fail | done | 137,890 in / 44,903 out | $0.095 | 5m 15s | 2026-09-28 13:16 |
| 80 | parcel_redelivery | scout-qwen | fail | preferences | 347,696 in / 6,159 out | $0.026 | 7m 10s | 2026-09-28 11:52 |