Firehose ingest: handle tooBig commits and poison frames #39

Open opened by topos-backsword.test.pds.did.bot

Live ingest (#33) doesn't special-case tooBig commits, whose blocks are missing from the CAR, so it would fail to decode them and reconnect from the same cursor forever. Fetch the named records instead, and add a way to skip a poison frame. Collections that first appear during a gap also aren't reconciled yet; that needs a per-repo collection registry.

🤖 Generated with Claude Code

Sign up or Sign in to add to the discussion.