docs: correct reproduction and cache claims
The small-model page said make small reproduced every number, but the threshold table and several derived values only appear in the JSON payload. Say what the commands actually print, fix the stale weather-cache docstring, and lead the e2e evidence page with what it checks.
This commit is contained in:
1 parent
070ecd2a78
commit
ac0d8984bb
4 files changed
+13
-11
No files matched your search
+3
-2
@@ -6,7 +6,8 @@ forecast: six cheap features, a time-based split, and under a second to fit.
|
||||
|
||||
Every number below comes from the baked artifact
|
||||
`artifacts/small_metrics.json` (version `logit-20261114-052723`, trained
|
||||
2026-11-14T05:27:23Z) and can be reproduced with `make small`.
|
||||
2026-11-14T05:27:23Z). `make small` prints the headline metrics and per-sensor
|
||||
table; `scripts/train_small.py --json` prints the full payload.
|
||||
|
||||
## Target
|
||||
|
||||
@@ -132,7 +133,7 @@ it is not evidence of a strong signal there.
|
||||
## Reproduce
|
||||
|
||||
```bash
|
||||
# Full challenge CSV, prints every number above.
|
||||
# Full challenge CSV, prints the metrics and per-sensor table above.
|
||||
make small
|
||||
|
||||
# Explicit CSV, all rows, save the baked artifact.
|
||||
|
||||
+6
-5
@@ -1,16 +1,17 @@
|
||||
# Training end-to-end evidence
|
||||
|
||||
The script starts a real `uvicorn pulsecast.server:app` process with
|
||||
`CONTROL_TOKEN`, waits for startup, and drives the HTTP API only. It checks the
|
||||
snapshot, every prediction/scenario path, auth and error paths, one job at a
|
||||
time, and both training jobs; it exits non-zero on the first failed check.
|
||||
Unit/contract tests (`make check`) are separate.
|
||||
|
||||
Reproduce with:
|
||||
|
||||
```bash
|
||||
uv run python scripts/e2e_train.py --port 18000 --report /tmp/e2e.json
|
||||
```
|
||||
|
||||
The script starts a real `uvicorn pulsecast.server:app` process with
|
||||
`CONTROL_TOKEN`, waits for startup, and drives the HTTP API only. It exits
|
||||
non-zero on the first failed check. Unit/contract tests (`make check`) are
|
||||
separate.
|
||||
|
||||
## Run
|
||||
|
||||
| Field | Value |
|
||||
|
||||
Reference in new issue
Block a user