Serve IPFS retrievals

[bajtos]

Tracking all remaining work to ship IPFS retrieval to mainnet.
Main implementation lives in PR #312 (calibration-only, not yet on mainnet).

Shipped (calibration)

• ipfs-retriever worker: URL format 1-{base32DataSetId}-{base32PieceId}.ipfs.filbeam.io
• wallet/CID redirect via link.ipfs.calibration.filbeam.io/{wallet}/{cid}
• CAR → raw bytes conversion (streaming via CarBlockIterator)

Related

• Convert IPFS CAR stream to raw content #295

[bajtos]

In order to support static websites loading sub-resources at absolute paths (e.g. /style.css), we need to move the IPFS CID to the domain name. Because Cloudflare does not support wildcards on multiple levels (docs), we must combine the client wallet address and the IPFS CID into one hostname component. For example: https://bafk123-0xabc.filbeam.io/ and https://bafk123-0xabc.filbeam.io/favicon.ico

User requested URL: https://bafk123-0xabc.filbeam.io/favicon.ico

SP Origin URL: https://{sp}/ipfs/bafk123/favicon.ico

[bajtos]

Discussion about the URL format:
https://www.notion.so/spacemeridian/FilBeam-URL-format-27ecdd5cccdb806caeeaefad80cbf64d

[bajtos]

Note: it is not possible to put address+CID into a single hostname component

Slack discussion: https://space-meridian.slack.com/archives/C099XQTBGLU/p1759235259831849

The maximum length for a single label (a part of the domain name separated by dots, like "example" in "example.com") is 63 characters, while the total length of the fully qualified domain name (FQDN), including the dots, is limited to 253 characters.

[juliangruber]

Product requirements (working document): https://www.notion.so/filecoindev/FilBeam-IPFS-support-364dc41950c180c28472fa1b206a004b