Paywary

Leaderboard / mini-tollbooth.onrender.com / endpoint

GET https://mini-tollbooth.onrender.com/prompt-cost

Scores measure reliability and honesty, not output quality.

53Cautionconfidence: medium
  • Answered 3 of 6 probes in the last 7 days (50%).
  • Answered 3 of 6 probes in the last 30 days (50%).
Category
Other by llm, confidence 10%
Latest quote
— on — to —
Uptime
50% / 7d, 50% / 30d
HTTPS
yes
First listed
2026-11-16
Last probe
5h ago
Next probe
2026-11-17 16:43 UTC

Score components

Uptime, 7 days
0w 20%
Uptime, 30 days
0w 15%
Valid x402 challenge
100w 15%
Price honesty
100w 15%
Delivery after payment
n/aexcluded
Wallet stability
100w 10%
Listing age
5w 5%
HTTPS
100w 5%

Catalog listings

SourceSchemeNetworkAssetListed pricePay toFlowCurrentLast seen

Listing changes

WhenEventFromTo
2h agodisappeared——
2h agodisappeared——

Paid probes

No paid probes yet. Paid probing is off by default and runs weekly per host under a strict spend cap; each paid probe links to its on-chain transaction here.

Delivery checks

Inside each paid probe we ask for something whose correct answer we know, then compare. A pass means the seller delivered what it was paid for; a fail means it charged and returned something wrong; inconclusive means we could not judge (no reference, unknown input shape, or a non-2xx response). Every row carries the request, the response hash and the reference so the verdict can be reproduced. Delivery results do not affect scores yet.

No delivery checks yet. They run inside the weekly paid probe.

Classification history

Every classification is kept; the newest row is the current category. Rules match the listing text; the model is consulted only when the rules are unsure.

WhenCategoryConfidenceMethodVersionEvidence
2h agoOther10%llmv1claude-haiku-5-5: The listing has no service name, tags, description, or example fields, and the resource path '/prompt-cost' suggests a token or prompt pricing tool, but that is too little to place it confidently in any category.
2h agoOther20%rulesv1rule none matched "" in none
15h agoUtility50%llmv1claude-haiku-5-5: The endpoint estimates token counts and per-model cost for a prompt, a small calculator-style utility. It is not inference itself, since it returns no model output, and it is not a signal or compute_math formula, so utility fits best with moderate confidence.
18h agoData transform60%rulesv1rule data_transform matched "tokenize" in description

Probe history

WhenKindStatusLatencyx402ValidQuotedPay toFlags
5h agofree50351 ms—no——server_errorstatus_not_402
11h agofree50381 ms—no——server_errorstatus_not_402
17h agofree50395 ms—no——server_errorstatus_not_402
24h agofree402149 msv2yes$0.020x8BE8…96C0—
30h agofree40254 msv2yes$0.020x8BE8…96C0—
37h agofree40260 msv2yes$0.020x8BE8…96C0—