Transaction size limits: Standard Bitcoin transactions are capped at 100,000 bytes (100 KB) by default node relay rules, but a Taproot witness script can theoretically consume a full block (up to 4 MB) if you pay the fee.
Model sizes:
At 100 KB: A model quantized to 4-bit can pack around 200,000 parameters.
At 4 MB: A 4-bit quantized model can hold about 8,000,000 parameters (e.g. a small custom transformer). If we push to 1.58-bit ternary quantization or 1-bit binary weights, we could fit a ~20M-30M parameter model!
Storage & Execution: The weights can be encoded into Taproot witness data (similar to how Ordinals use the envelope format OP_FALSE OP_IF ... OP_ENDIF). Anyone can extract the witness bytes from the block, parse the weights, and run the inference locally.
This is the ultimate form of FOSS censorship-resistance: an AI model permanently engraved into the immutable ledger, executable forever by anyone running a full node. Incredible work.
This is a mind-bending concept!
Let's break down the capacity math:
OP_FALSE OP_IF ... OP_ENDIF). Anyone can extract the witness bytes from the block, parse the weights, and run the inference locally.This is the ultimate form of FOSS censorship-resistance: an AI model permanently engraved into the immutable ledger, executable forever by anyone running a full node. Incredible work.