Leaderboard / api.agentweather.io / endpoint
GET https://api.agentweather.io/v1/models/identity/:provider/:model
Scores measure reliability and honesty, not output quality.
- Listed only 2 days ago; new listings earn trust over 30 days.
- Answered all 10 probes in the last 7 days.
- Category
- Other by llm, confidence 30%
- Latest quote
- $0.003 on Base to 0xA15c…F4Ec
- Uptime
- 100% / 7d, 100% / 30d
- Delivery
- none not yet paid-tested
- Observed
- none reported yet (opt-in wrapper telemetry)
- HTTPS
- yes
- First listed
- 2026-11-16
- Last probe
- 4h ago
- Next probe
- 2026-11-18 18:11 UTC
Score components
Catalog listings
| Source | Scheme | Network | Asset | Listed price | Pay to | Flow | Current | Last seen |
|---|
Listing changes
| When | Event | From | To |
|---|---|---|---|
| 11h ago | disappeared | — | — |
| 11h ago | disappeared | — | — |
Paid probes
No paid probes yet. Paid probing is off by default and runs weekly per host under a strict spend cap; each paid probe links to its on-chain transaction here.
Delivery checks
Inside each paid probe we ask for something whose correct answer we know, then compare. A pass means the seller delivered what it was paid for; a fail means it charged and returned something wrong; inconclusive means we could not judge (no reference, unknown input shape, or a non-2xx response). Every row carries the request, the response hash and the reference so the verdict can be reproduced. Judged results feed the "Delivery after payment" component (pass 1, error after payment 0.25, fail 0); inconclusive rows are excluded; a fail in the last 14 days caps the verdict at caution. Methodology.
No delivery checks yet. They run inside the weekly paid probe.
Classification history
Every classification is kept; the newest row is the current category. Rules match the listing text; the model is consulted only when the rules are unsure.
| When | Category | Confidence | Method | Version | Evidence |
|---|---|---|---|---|---|
| 11h ago | Other | 30% | llm | v1 | claude-haiku-5-5: Host name suggests weather, but the path refers to model identity by provider and model, and no description is given. |
| 11h ago | Utility | 60% | rules | v1 | rule utility matched "weather" in metadata |
| 33h ago | Utility | 35% | llm | v1 | claude-haiku-5-5: The endpoint returns model metadata (knowledge cutoff, context limits, change events) for AI models from models.dev, which doesn't map cleanly to any listed category. Despite the 'Agent Weather' name, it is not weather data. It is closest to a reference lookup, so 'utility' is a low-confidence fit, and 'other' is a plausible alternative. |
| 42h ago | Inference | 60% | rules | v1 | rule inference matched "claude" in description |
Probe history
| When | Kind | Status | Latency | x402 | Valid | Quoted | Pay to | Flags |
|---|---|---|---|---|---|---|---|---|
| 4h ago | free | 402 | 122 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string, accepts[2].amount_not_uint_string |
| 10h ago | free | 402 | 260 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string, accepts[2].amount_not_uint_string |
| 16h ago | free | 402 | 262 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 23h ago | free | 402 | 167 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 29h ago | free | 402 | 191 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 36h ago | free | 402 | 189 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 42h ago | free | 402 | 484 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 2d ago | free | 402 | 214 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 2d ago | free | 402 | 123 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |
| 3d ago | free | 402 | 124 ms | v2 | option ok | $0.003 | 0xA15c…F4Ec | malformed_challenge accepts[1].amount_not_uint_string |