docs: small-model artifact, paper metrics, train e2e evidence
- docs/small-model.md: target, features, split, metrics, full confusion matrix, per-sensor table, honest limits - docs/metrics.md: provenance, protocol, headline, ablation, per-sensor, uncertainty, small model, supported/unsupported claims - docs/figures: generated ablation, per-sensor, confusion-matrix SVGs - docs/train-e2e.md: exact 38-check live run, small + forecast job results - model_card.md and README updated with final metrics and links
This commit is contained in:
1 parent
2bcf66c550
commit
c7ea524b5b
8 files changed
+702
-16
No files matched your search
@@ -0,0 +1,36 @@
|
||||
<svg xmlns="http://www.w3.org/2000/svg" width="960" height="370" viewBox="0 0 960 370" role="img" aria-label="Ablation: holdout MAE by feature set">
|
||||
<rect width="100%" height="100%" fill="#ffffff"/>
|
||||
<g font-family="-apple-system, Segoe UI, Helvetica, Arial, sans-serif">
|
||||
<text x="24" y="34" font-size="20" font-weight="600" fill="#0f172a">Ablation: holdout MAE by feature set</text>
|
||||
<text x="24" y="56" font-size="13" fill="#475569">Holdout 2026-10-10T23:00:00Z .. 2026-11-07T23:00:00Z, n=5350</text>
|
||||
<line x1="230.0" y1="68" x2="230.0" y2="314" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="230.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">0.0</text>
|
||||
<line x1="388.5" y1="68" x2="388.5" y2="314" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="388.5" y="62" font-size="11" fill="#64748b" text-anchor="middle">1.5</text>
|
||||
<line x1="547.0" y1="68" x2="547.0" y2="314" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="547.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">2.9</text>
|
||||
<line x1="705.5" y1="68" x2="705.5" y2="314" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="705.5" y="62" font-size="11" fill="#64748b" text-anchor="middle">4.4</text>
|
||||
<line x1="864.0" y1="68" x2="864.0" y2="314" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="864.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">5.8</text>
|
||||
<text x="218" y="106" font-size="12" fill="#0f172a" text-anchor="end">seasonal naive</text>
|
||||
<rect x="230" y="92" width="587.0" height="22" fill="#2563eb"/>
|
||||
<text x="823.0" y="107" font-size="12" fill="#0f172a">5.40</text>
|
||||
<text x="218" y="144" font-size="12" fill="#0f172a" text-anchor="end">day no weather</text>
|
||||
<rect x="230" y="130" width="430.5" height="22" fill="#2563eb"/>
|
||||
<text x="666.5" y="145" font-size="12" fill="#0f172a">3.96</text>
|
||||
<text x="218" y="182" font-size="12" fill="#0f172a" text-anchor="end">day holiday</text>
|
||||
<rect x="230" y="168" width="417.4" height="22" fill="#2563eb"/>
|
||||
<text x="653.4" y="183" font-size="12" fill="#0f172a">3.84</text>
|
||||
<text x="218" y="220" font-size="12" fill="#0f172a" text-anchor="end">day weather</text>
|
||||
<rect x="230" y="206" width="365.3" height="22" fill="#2563eb"/>
|
||||
<text x="601.3" y="221" font-size="12" fill="#0f172a">3.36</text>
|
||||
<text x="218" y="258" font-size="12" fill="#0f172a" text-anchor="end">week no weather</text>
|
||||
<rect x="230" y="244" width="443.5" height="22" fill="#2563eb"/>
|
||||
<text x="679.5" y="259" font-size="12" fill="#0f172a">4.08</text>
|
||||
<text x="218" y="296" font-size="12" fill="#0f172a" text-anchor="end">week weather</text>
|
||||
<rect x="230" y="282" width="360.9" height="22" fill="#0f766e"/>
|
||||
<text x="596.9" y="297" font-size="12" fill="#0f172a">3.32</text>
|
||||
<text x="24" y="358" font-size="11" fill="#64748b">Source: artifacts/metrics.json · PulseCast 28-day time-based holdout</text>
|
||||
</g>
|
||||
</svg>
|
||||
|
After Width: | Height: | Size: 2.7 KiB |
@@ -0,0 +1,60 @@
|
||||
<svg xmlns="http://www.w3.org/2000/svg" width="960" height="446" viewBox="0 0 960 446" role="img" aria-label="Per-sensor holdout MAE: production model vs seasonal naive">
|
||||
<rect width="100%" height="100%" fill="#ffffff"/>
|
||||
<g font-family="-apple-system, Segoe UI, Helvetica, Arial, sans-serif">
|
||||
<text x="24" y="34" font-size="20" font-weight="600" fill="#0f172a">Per-sensor holdout MAE: production model vs seasonal naive</text>
|
||||
<text x="24" y="56" font-size="13" fill="#475569">Holdout 2026-10-10T23:00:00Z .. 2026-11-07T23:00:00Z, n=5350</text>
|
||||
<line x1="230.0" y1="68" x2="230.0" y2="390" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="230.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">0.0</text>
|
||||
<line x1="388.5" y1="68" x2="388.5" y2="390" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="388.5" y="62" font-size="11" fill="#64748b" text-anchor="middle">2.8</text>
|
||||
<line x1="547.0" y1="68" x2="547.0" y2="390" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="547.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">5.6</text>
|
||||
<line x1="705.5" y1="68" x2="705.5" y2="390" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="705.5" y="62" font-size="11" fill="#64748b" text-anchor="middle">8.4</text>
|
||||
<line x1="864.0" y1="68" x2="864.0" y2="390" stroke="#e2e8f0" stroke-width="1"/>
|
||||
<text x="864.0" y="62" font-size="11" fill="#64748b" text-anchor="middle">11.2</text>
|
||||
<rect x="230" y="52" width="10" height="10" fill="#94a3b8"/><text x="246" y="61" font-size="12" fill="#475569">seasonal naive</text>
|
||||
<rect x="370" y="52" width="10" height="10" fill="#2563eb"/><text x="386" y="61" font-size="12" fill="#475569">weather-7d</text>
|
||||
<text x="218" y="106" font-size="12" fill="#0f172a" text-anchor="end">Density 01</text>
|
||||
<rect x="230" y="89" width="202.3" height="12" fill="#94a3b8"/>
|
||||
<text x="438.3" y="99" font-size="11" fill="#64748b">3.58</text>
|
||||
<rect x="230" y="104" width="127.7" height="12" fill="#2563eb"/>
|
||||
<text x="363.7" y="114" font-size="11" fill="#0f172a">2.26</text>
|
||||
<text x="218" y="144" font-size="12" fill="#0f172a" text-anchor="end">Götzenturm</text>
|
||||
<rect x="230" y="127" width="217.0" height="12" fill="#94a3b8"/>
|
||||
<text x="453.0" y="137" font-size="11" fill="#64748b">3.84</text>
|
||||
<rect x="230" y="142" width="135.6" height="12" fill="#2563eb"/>
|
||||
<text x="371.6" y="152" font-size="11" fill="#0f172a">2.40</text>
|
||||
<text x="218" y="182" font-size="12" fill="#0f172a" text-anchor="end">Hagenbuchersee 1</text>
|
||||
<rect x="230" y="165" width="226.6" height="12" fill="#94a3b8"/>
|
||||
<text x="462.6" y="175" font-size="11" fill="#64748b">4.01</text>
|
||||
<rect x="230" y="180" width="139.6" height="12" fill="#2563eb"/>
|
||||
<text x="375.6" y="190" font-size="11" fill="#0f172a">2.47</text>
|
||||
<text x="218" y="220" font-size="12" fill="#0f172a" text-anchor="end">Hagenbuchersee 2</text>
|
||||
<rect x="230" y="203" width="366.7" height="12" fill="#94a3b8"/>
|
||||
<text x="602.7" y="213" font-size="11" fill="#64748b">6.49</text>
|
||||
<rect x="230" y="218" width="232.8" height="12" fill="#2563eb"/>
|
||||
<text x="468.8" y="228" font-size="11" fill="#0f172a">4.12</text>
|
||||
<text x="218" y="258" font-size="12" fill="#0f172a" text-anchor="end">Marahaus</text>
|
||||
<rect x="230" y="241" width="258.2" height="12" fill="#94a3b8"/>
|
||||
<text x="494.2" y="251" font-size="11" fill="#64748b">4.57</text>
|
||||
<rect x="230" y="256" width="150.9" height="12" fill="#2563eb"/>
|
||||
<text x="386.9" y="266" font-size="11" fill="#0f172a">2.67</text>
|
||||
<text x="218" y="296" font-size="12" fill="#0f172a" text-anchor="end">Neckarufer</text>
|
||||
<rect x="230" y="279" width="332.8" height="12" fill="#94a3b8"/>
|
||||
<text x="568.8" y="289" font-size="11" fill="#64748b">5.89</text>
|
||||
<rect x="230" y="294" width="205.1" height="12" fill="#2563eb"/>
|
||||
<text x="441.1" y="304" font-size="11" fill="#0f172a">3.63</text>
|
||||
<text x="218" y="334" font-size="12" fill="#0f172a" text-anchor="end">Soleo</text>
|
||||
<rect x="230" y="317" width="248.6" height="12" fill="#94a3b8"/>
|
||||
<text x="484.6" y="327" font-size="11" fill="#64748b">4.40</text>
|
||||
<rect x="230" y="332" width="180.2" height="12" fill="#2563eb"/>
|
||||
<text x="416.2" y="342" font-size="11" fill="#0f172a">3.19</text>
|
||||
<text x="218" y="372" font-size="12" fill="#0f172a" text-anchor="end">Stadtgalerie</text>
|
||||
<rect x="230" y="355" width="587.0" height="12" fill="#94a3b8"/>
|
||||
<text x="823.0" y="365" font-size="11" fill="#64748b">10.39</text>
|
||||
<rect x="230" y="370" width="329.4" height="12" fill="#2563eb"/>
|
||||
<text x="565.4" y="380" font-size="11" fill="#0f172a">5.83</text>
|
||||
<text x="24" y="434" font-size="11" fill="#64748b">Source: artifacts/metrics.json · PulseCast 28-day time-based holdout</text>
|
||||
</g>
|
||||
</svg>
|
||||
|
After Width: | Height: | Size: 4.5 KiB |
@@ -0,0 +1,24 @@
|
||||
<svg xmlns="http://www.w3.org/2000/svg" width="760" height="520" viewBox="0 0 760 520" role="img" aria-label="Small busy-hour classifier: holdout confusion matrix">
|
||||
<rect width="100%" height="100%" fill="#ffffff"/>
|
||||
<g font-family="-apple-system, Segoe UI, Helvetica, Arial, sans-serif">
|
||||
<text x="24" y="34" font-size="20" font-weight="600" fill="#0f172a">Small busy-hour classifier: holdout confusion matrix</text>
|
||||
<text x="24" y="56" font-size="13" fill="#475569">n=5,710 · accuracy 0.708 · precision 0.360 · recall 0.574 · F1 0.443 · ROC-AUC 0.726</text>
|
||||
<text x="295.0" y="114" font-size="13" fill="#475569" text-anchor="middle">Predicted not busy</text>
|
||||
<text x="485.0" y="114" font-size="13" fill="#475569" text-anchor="middle">Predicted busy</text>
|
||||
<text x="182" y="225.0" font-size="13" fill="#475569" text-anchor="end">Actually not busy</text>
|
||||
<text x="182" y="415.0" font-size="13" fill="#475569" text-anchor="end">Actually busy</text>
|
||||
<rect x="200" y="130" width="190" height="190" fill="#1d4ed8" stroke="#ffffff" stroke-width="2"/>
|
||||
<text x="295.0" y="217.0" font-size="30" font-weight="600" fill="#ffffff" text-anchor="middle">3,377</text>
|
||||
<text x="295.0" y="245.0" font-size="13" fill="#ffffff" text-anchor="middle">TN · 74.1% of row</text>
|
||||
<rect x="390" y="130" width="190" height="190" fill="#8aa7ee" stroke="#ffffff" stroke-width="2"/>
|
||||
<text x="485.0" y="217.0" font-size="30" font-weight="600" fill="#0f172a" text-anchor="middle">1,178</text>
|
||||
<text x="485.0" y="245.0" font-size="13" fill="#0f172a" text-anchor="middle">FP · 25.9% of row</text>
|
||||
<rect x="200" y="320" width="190" height="190" fill="#acc3f5" stroke="#ffffff" stroke-width="2"/>
|
||||
<text x="295.0" y="407.0" font-size="30" font-weight="600" fill="#0f172a" text-anchor="middle">492</text>
|
||||
<text x="295.0" y="435.0" font-size="13" fill="#0f172a" text-anchor="middle">FN · 42.6% of row</text>
|
||||
<rect x="390" y="320" width="190" height="190" fill="#a3bcf3" stroke="#ffffff" stroke-width="2"/>
|
||||
<text x="485.0" y="407.0" font-size="30" font-weight="600" fill="#0f172a" text-anchor="middle">663</text>
|
||||
<text x="485.0" y="435.0" font-size="13" fill="#0f172a" text-anchor="middle">TP · 57.4% of row</text>
|
||||
<text x="24" y="508" font-size="11" fill="#64748b">Source: artifacts/small_metrics.json · chronological 80/20 split</text>
|
||||
</g>
|
||||
</svg>
|
||||
|
After Width: | Height: | Size: 2.3 KiB |
Reference in new issue
Block a user