Store
Setup
| Adapter | neon-postgres |
| Round trip | SELECT 1 returned 1SELECT 1 returned 1 |
| Durable | survives redeploy |
| Scope | 14f03b3f… |
Hosted Postgres. Rows survive redeploys and cold starts. Local development uses an embedded Postgres under ./.crucible with zero environment variables. Production refuses to start without a hosted DATABASE_URL, because a serverless filesystem is not a database.
Engine
| Factor | Weight |
|---|---|
| determinism | 0.26 |
| discrimination | 0.22 |
| fixture seal | 0.18 |
| assertion specificity | 0.16 |
| reproduction | 0.10 |
| cost fit | 0.08 |
| sum | 1.00 |
engine crucible-grade-v1.0.0 · grader crucible-grader-v1.0.0
| Band | Range | Required action |
|---|---|---|
| Unusable | 0–20 | Do not publish. Add deterministic assertions before anything else. |
| Non-discriminating | 20–40 | Add a near-miss fixture so a plausible wrong answer starts to cost points. |
| Judge-bound | 40–60 | Convert the highest-weighted judge rubric into an exact assertion. |
| Needs hardening | 60–80 | Pin the loose input and tighten the lowest-weighted substring assertion. |
| Publishable | 80–100 | Ship it. Push the task and run it on the Kaggle model proxy. |
Feeds
| Hugging Face Hub | livefetched 2026-10-04 14:18:15 UTC |
| Sealed snapshot | 4 model records recorded 2025-01-12 and shown with that date whenever the live lookup fails. A sealed row is never presented as current. |
| arXiv | cs.CL capability-evaluation papers, newest first, queried per request with a bounded retry and a timeout. |
Preferences
Stored against this session's scope in the database, not in browser storage. Clearing the cookie loses them, which is the honest behaviour for a product with no accounts.
Those rows are the interesting ones: a closed model has no pinnable revision, so a third party cannot reproduce a run against it.
Endpoints