docs: small-model artifact, paper metrics, train e2e evidence

- docs/small-model.md: target, features, split, metrics, full confusion
  matrix, per-sensor table, honest limits
- docs/metrics.md: provenance, protocol, headline, ablation, per-sensor,
  uncertainty, small model, supported/unsupported claims
- docs/figures: generated ablation, per-sensor, confusion-matrix SVGs
- docs/train-e2e.md: exact 38-check live run, small + forecast job results
- model_card.md and README updated with final metrics and links
This commit is contained in:
Noel Sabia committed 2026-11-14 06:35:22 +01:00
1 parent 2bcf66c550
commit c7ea524b5b
8 files changed
+702 -16

No files matched your search

+60
View File
@@ -0,0 +1,60 @@
<svg xmlns="http://www.w3.org/2000/svg" width="960" height="446" viewBox="0 0 960 446" role="img" aria-label="Per-sensor holdout MAE: production model vs seasonal naive">
<rect width="100%" height="100%" fill="#ffffff"/>
<g font-family="-apple-system, Segoe UI, Helvetica, Arial, sans-serif">
<text x="24" y="34" font-size="20" font-weight="600" fill="#0f172a">Per-sensor holdout MAE: production model vs seasonal naive</text>
<text x="24" y="56" font-size="13" fill="#475569">Holdout 2026-10-10T23:00:00Z .. 2026-11-07T23:00:00Z, n=5350</text>
<line x1="230.0" y1="68" x2="230.0" y2="390" stroke="#e2e8f0" stroke-width="1"/>
<text x="230.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">0.0</text>
<line x1="388.5" y1="68" x2="388.5" y2="390" stroke="#e2e8f0" stroke-width="1"/>
<text x="388.5" y="62" font-size="11" fill="#64748b" text-anchor="middle">2.8</text>
<line x1="547.0" y1="68" x2="547.0" y2="390" stroke="#e2e8f0" stroke-width="1"/>
<text x="547.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">5.6</text>
<line x1="705.5" y1="68" x2="705.5" y2="390" stroke="#e2e8f0" stroke-width="1"/>
<text x="705.5" y="62" font-size="11" fill="#64748b" text-anchor="middle">8.4</text>
<line x1="864.0" y1="68" x2="864.0" y2="390" stroke="#e2e8f0" stroke-width="1"/>
<text x="864.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">11.2</text>
<rect x="230" y="52" width="10" height="10" fill="#94a3b8"/><text x="246" y="61" font-size="12" fill="#475569">seasonal naive</text>
<rect x="370" y="52" width="10" height="10" fill="#2563eb"/><text x="386" y="61" font-size="12" fill="#475569">weather-7d</text>
<text x="218" y="106" font-size="12" fill="#0f172a" text-anchor="end">Density 01</text>
<rect x="230" y="89" width="202.3" height="12" fill="#94a3b8"/>
<text x="438.3" y="99" font-size="11" fill="#64748b">3.58</text>
<rect x="230" y="104" width="127.7" height="12" fill="#2563eb"/>
<text x="363.7" y="114" font-size="11" fill="#0f172a">2.26</text>
<text x="218" y="144" font-size="12" fill="#0f172a" text-anchor="end">Götzenturm</text>
<rect x="230" y="127" width="217.0" height="12" fill="#94a3b8"/>
<text x="453.0" y="137" font-size="11" fill="#64748b">3.84</text>
<rect x="230" y="142" width="135.6" height="12" fill="#2563eb"/>
<text x="371.6" y="152" font-size="11" fill="#0f172a">2.40</text>
<text x="218" y="182" font-size="12" fill="#0f172a" text-anchor="end">Hagenbuchersee 1</text>
<rect x="230" y="165" width="226.6" height="12" fill="#94a3b8"/>
<text x="462.6" y="175" font-size="11" fill="#64748b">4.01</text>
<rect x="230" y="180" width="139.6" height="12" fill="#2563eb"/>
<text x="375.6" y="190" font-size="11" fill="#0f172a">2.47</text>
<text x="218" y="220" font-size="12" fill="#0f172a" text-anchor="end">Hagenbuchersee 2</text>
<rect x="230" y="203" width="366.7" height="12" fill="#94a3b8"/>
<text x="602.7" y="213" font-size="11" fill="#64748b">6.49</text>
<rect x="230" y="218" width="232.8" height="12" fill="#2563eb"/>
<text x="468.8" y="228" font-size="11" fill="#0f172a">4.12</text>
<text x="218" y="258" font-size="12" fill="#0f172a" text-anchor="end">Marahaus</text>
<rect x="230" y="241" width="258.2" height="12" fill="#94a3b8"/>
<text x="494.2" y="251" font-size="11" fill="#64748b">4.57</text>
<rect x="230" y="256" width="150.9" height="12" fill="#2563eb"/>
<text x="386.9" y="266" font-size="11" fill="#0f172a">2.67</text>
<text x="218" y="296" font-size="12" fill="#0f172a" text-anchor="end">Neckarufer</text>
<rect x="230" y="279" width="332.8" height="12" fill="#94a3b8"/>
<text x="568.8" y="289" font-size="11" fill="#64748b">5.89</text>
<rect x="230" y="294" width="205.1" height="12" fill="#2563eb"/>
<text x="441.1" y="304" font-size="11" fill="#0f172a">3.63</text>
<text x="218" y="334" font-size="12" fill="#0f172a" text-anchor="end">Soleo</text>
<rect x="230" y="317" width="248.6" height="12" fill="#94a3b8"/>
<text x="484.6" y="327" font-size="11" fill="#64748b">4.40</text>
<rect x="230" y="332" width="180.2" height="12" fill="#2563eb"/>
<text x="416.2" y="342" font-size="11" fill="#0f172a">3.19</text>
<text x="218" y="372" font-size="12" fill="#0f172a" text-anchor="end">Stadtgalerie</text>
<rect x="230" y="355" width="587.0" height="12" fill="#94a3b8"/>
<text x="823.0" y="365" font-size="11" fill="#64748b">10.39</text>
<rect x="230" y="370" width="329.4" height="12" fill="#2563eb"/>
<text x="565.4" y="380" font-size="11" fill="#0f172a">5.83</text>
<text x="24" y="434" font-size="11" fill="#64748b">Source: artifacts/metrics.json · PulseCast 28-day time-based holdout</text>
</g>
</svg>

After

Width:  |  Height:  |  Size: 4.5 KiB