docs(okf): add server memory budget and analytics proposal
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
64fef83314
commit
261cf17e52
13 files changed
+178
-12
No files matched your search
@@ -37,4 +37,5 @@ statically by the [gateway](/architecture/gateway.md). It adds nothing to the cl
|
||||
|
||||
- **Download size:** 5M parameters in fp32 is about 20 MB, 30M is about 120 MB.
|
||||
Ship int8 weights (about 4× smaller) and load them lazily.
|
||||
- **Training happens on Noel's own computer.** The [server](/architecture/server-budget.md) only serves the weights file.
|
||||
- **PyTorch is new tooling** and needs Noel's approval under the stack rule.
|
||||
Reference in new issue
Block a user