oppi.li / indigo-ci
porting all github actions from bluesky-social/indigo to tangled CI
fork atom
indigo-ci / cmd / rainbow /
at main 3 files
Dockerfile
README.md
main.go
README.md

rainbow: atproto Firehose Fanout Service#

This is an atproto service which consumes from a firehose (eg, from a relay or PDS) and fans out events to many subscribers.

Features and design points:

  • retains "backfill window" on local disk (using pebble)
  • serves the com.atproto.sync.subscribeRepos endpoint (WebSocket)
  • proxies through public and administrative API requests to the backing host
  • retains upstream firehose "sequence numbers"
  • does not validate events (signatures, repo tree, hashes, etc), just passes through
  • does not archive or mirror individual records or entire repositories (or implement related API endpoints)
  • somewhat disk I/O intensive: fast NVMe disks are recommended, and RAM is helpful for caching
  • single golang binary for easy deployment
  • observability: logging, prometheus metrics, and OTEL traces

Running#

This is a simple, single-binary Go program. You can also build and run it as a docker container (see ./Dockerfile).

From the top level of this repo, you can build:

go build ./cmd/rainbow -o rainbow

or just run it, and see configuration options:

go run ./cmd/rainbow --help