About
Resources
Blog
Docs
Source
Status
Social
Discord
IRC
Bluesky
X/Twitter
Contact
team@tangled.org
security@tangled.org
Legal
Terms of Service
Privacy Policy
Sign in
Join now
hydrant
ptr.pet
/
Star
Starred
Star
107
Something went wrong. Try again.
Fork
6
Eye filled
Watch
Watching
Watch
very fast at protocol indexer with flexible filtering, xrpc queries, cursor-backed event stream, and more, built on fjall
rust
fjall
at-protocol
atproto
indexer
+5 more
rust
fjall
at-protocol
atproto
indexer
Star
Starred
Star
107
Something went wrong. Try again.
Fork
6
Eye filled
Watch
Watching
Watch
Overview
Overview
Issues
Issues
10
1
0
Pulls
Pulls
Pipelines
Pipelines
Version history of
src/crawler/
worker.rs
November 2026
[ingest] limit how often a peer can make us refetch a repo
ptr.pet
·
2w ago
9bd8951e
Copied
Failed
Copy SHA
ptr.pet
9bd8951e
Copied
Failed
Copy SHA
[ingest] limit how often a peer can make us refetch a repo
2w ago
[crawler] don't trust listed revs from the future
ptr.pet
·
2w ago
e3a2926f
Copied
Failed
Copy SHA
ptr.pet
e3a2926f
Copied
Failed
Copy SHA
[crawler] don't trust listed revs from the future
2w ago
October 2026
[crawler] wake the backfill worker when a listing queues a backfill
ptr.pet
·
2w ago
942f366f
Copied
Failed
Copy SHA
ptr.pet
942f366f
Copied
Failed
Copy SHA
[crawler] wake the backfill worker when a listing queues a backfill
2w ago
[xrpc] remove jacquard-api and jacquard-derive dependencies
ptr.pet
·
3w ago
68cd57da
Copied
Failed
Copy SHA
ptr.pet
68cd57da
Copied
Failed
Copy SHA
[xrpc] remove jacquard-api and jacquard-derive dependencies
3w ago
[mst] replace jacquard-repo with in-tree mst and commit implementation
ptr.pet
·
3w ago
1d89ad88
Copied
Failed
Copy SHA
ptr.pet
1d89ad88
Copied
Failed
Copy SHA
[mst] replace jacquard-repo with in-tree mst and commit implementation
3w ago
[indexer] work on a shard hands the jobs it started back, no ResumeJob
message
message
ptr.pet
·
1mo ago
15527222
Copied
Failed
Copy SHA
ptr.pet
15527222
Copied
Failed
Copy SHA
[indexer] work on a shard hands the jobs it started back, no ResumeJob message
1mo ago
[indexer] one helper decides between the owner shard and in
place
place
ptr.pet
·
1mo ago
019947f8
Copied
Failed
Copy SHA
ptr.pet
019947f8
Copied
Failed
Copy SHA
[indexer] one helper decides between the owner shard and in place
1mo ago
[types] drop the exclude flag from the erase job
marker
marker
ptr.pet
·
1mo ago
02085d5d
Copied
Failed
Copy SHA
ptr.pet
02085d5d
Copied
Failed
Copy SHA
[types] drop the exclude flag from the erase job marker
1mo ago
[throttle] drop the egress pool size every caller passed as
1
1
ptr.pet
·
1mo ago
de26db5c
Copied
Failed
Copy SHA
ptr.pet
de26db5c
Copied
Failed
Copy SHA
[throttle] drop the egress pool size every caller passed as 1
1mo ago
[crawler] don't queue a newer listing's backfill for an untracked, erased or wiped
repo
repo
ptr.pet
·
1mo ago
5892486b
Copied
Failed
Copy SHA
ptr.pet
5892486b
Copied
Failed
Copy SHA
[crawler] don't queue a newer listing's backfill for an untracked, erased or wiped repo
1mo ago
[crawler] stop a gone producer's waiting pages from moving its
cursor
cursor
ptr.pet
·
1mo ago
8232bf4a
Copied
Failed
Copy SHA
ptr.pet
8232bf4a
Copied
Failed
Copy SHA
[crawler] stop a gone producer's waiting pages from moving its cursor
1mo ago
[crawler] keep a page's cursor back when the worker failed its
repos
repos
ptr.pet
·
1mo ago
f9454b1a
Copied
Failed
Copy SHA
ptr.pet
f9454b1a
Copied
Failed
Copy SHA
[crawler] keep a page's cursor back when the worker failed its repos
1mo ago
[crawler] drop a cfg gate the crawler module already
has
has
ptr.pet
·
1mo ago
3aaec856
Copied
Failed
Copy SHA
ptr.pet
3aaec856
Copied
Failed
Copy SHA
[crawler] drop a cfg gate the crawler module already has
1mo ago
[crawler] drop the rand imports nothing
uses
uses
ptr.pet
·
1mo ago
23335f86
Copied
Failed
Copy SHA
ptr.pet
23335f86
Copied
Failed
Copy SHA
[crawler] drop the rand imports nothing uses
1mo ago
[crawler] keep reading pages while one waits for the
firehose
firehose
ptr.pet
·
1mo ago
095b7e20
Copied
Failed
Copy SHA
ptr.pet
095b7e20
Copied
Failed
Copy SHA
[crawler] keep reading pages while one waits for the firehose
1mo ago
[crawler] wait for the firehose before judging a listing's newer
rev
rev
ptr.pet
·
1mo ago
1c6ef977
Copied
Failed
Copy SHA
ptr.pet
1c6ef977
Copied
Failed
Copy SHA
[crawler] wait for the firehose before judging a listing's newer rev
1mo ago
[db] retire the repo
lock
lock
ptr.pet
·
1mo ago
04656b80
Copied
Failed
Copy SHA
ptr.pet
04656b80
Copied
Failed
Copy SHA
[db] retire the repo lock
1mo ago
[db] drop the repo lock protocol now that a repo's owner shard writes
it
it
ptr.pet
·
1mo ago
a924a1b7
Copied
Failed
Copy SHA
ptr.pet
a924a1b7
Copied
Failed
Copy SHA
[db] drop the repo lock protocol now that a repo's owner shard writes it
1mo ago
[crawler] write a page's repos on their owner
shards
shards
ptr.pet
·
1mo ago
bcf2ac44
Copied
Failed
Copy SHA
ptr.pet
bcf2ac44
Copied
Failed
Copy SHA
[crawler] write a page's repos on their owner shards
1mo ago
[backfill] erase and wipe repos in steps on their indexer shard, with job
markers
markers
ptr.pet
·
1mo ago
576affd8
Copied
Failed
Copy SHA
ptr.pet
576affd8
Copied
Failed
Copy SHA
[backfill] erase and wipe repos in steps on their indexer shard, with job markers
1mo ago
[crawler] let the pds decide when a relay lists an inactive repo as
active
active
ptr.pet
·
1mo ago
14dc13c6
Copied
Failed
Copy SHA
ptr.pet
14dc13c6
Copied
Failed
Copy SHA
[crawler] let the pds decide when a relay lists an inactive repo as active
1mo ago
[db] give every repo its own write
lock
lock
ptr.pet
·
1mo ago
2e79e0ae
Copied
Failed
Copy SHA
ptr.pet
2e79e0ae
Copied
Failed
Copy SHA
[db] give every repo its own write lock
1mo ago
[crawler] let the pds decide when a relay lists a repo as
inactive
inactive
ptr.pet
·
1mo ago
5a0e701c
Copied
Failed
Copy SHA
ptr.pet
5a0e701c
Copied
Failed
Copy SHA
[crawler] let the pds decide when a relay lists a repo as inactive
1mo ago
[db] read a repo row once when a write to it
follows
follows
ptr.pet
·
1mo ago
52f6f7b7
Copied
Failed
Copy SHA
ptr.pet
52f6f7b7
Copied
Failed
Copy SHA
[db] read a repo row once when a write to it follows
1mo ago
[db] count from the row a txn already read instead of reading it
again
again
ptr.pet
·
1mo ago
9c1e0f5f
Copied
Failed
Copy SHA
ptr.pet
9c1e0f5f
Copied
Failed
Copy SHA
[db] count from the row a txn already read instead of reading it again
1mo ago
[db] count a repo for its pds from the row each write
replaces
replaces
ptr.pet
·
1mo ago
b45547fc
Copied
Failed
Copy SHA
ptr.pet
b45547fc
Copied
Failed
Copy SHA
[db] count a repo for its pds from the row each write replaces
1mo ago
[db] keep a did-ordered copy of the backfill
queue
queue
ptr.pet
·
1mo ago
b0fdb698
Copied
Failed
Copy SHA
ptr.pet
b0fdb698
Copied
Failed
Copy SHA
[db] keep a did-ordered copy of the backfill queue
1mo ago
[db] reach the backfill queue only through IndexerDb
accessors
accessors
ptr.pet
·
1mo ago
d77b97d2
Copied
Failed
Copy SHA
ptr.pet
d77b97d2
Copied
Failed
Copy SHA
[db] reach the backfill queue only through IndexerDb accessors
1mo ago
September 2026
[db] assign stream positions at commit
time
time
ptr.pet
·
1mo ago
17ade9fa
Copied
Failed
Copy SHA
ptr.pet
17ade9fa
Copied
Failed
Copy SHA
[db] assign stream positions at commit time
1mo ago
[core] bump jacquard to 0.12.2 and migrate lifetime-free types
ptr.pet
·
2mo ago
87c73718
Copied
Failed
Copy SHA
ptr.pet
87c73718
Copied
Failed
Copy SHA
[core] bump jacquard to 0.12.2 and migrate lifetime-free types
2mo ago
August 2026
[db] enforce stripe lock ordering and exclusion
re-checks
re-checks
ptr.pet
·
3mo ago
6ec5f2e5
Copied
Failed
Copy SHA
ptr.pet
6ec5f2e5
Copied
Failed
Copy SHA
[db] enforce stripe lock ordering and exclusion re-checks
3mo ago
[db] store record bodies inline with versioned
history
history
ptr.pet
·
3mo ago
4410ee3b
Copied
Failed
Copy SHA
ptr.pet
4410ee3b
Copied
Failed
Copy SHA
[db] store record bodies inline with versioned history
3mo ago
July 2026
[crawler] add relay-first deep discovery
ptr.pet
·
3mo ago
4e040d72
Copied
Failed
Copy SHA
ptr.pet
4e040d72
Copied
Failed
Copy SHA
[crawler] add relay-first deep discovery
3mo ago
[crawler] expand full-network discovery lookahead
ptr.pet
·
3mo ago
710975c4
Copied
Failed
Copy SHA
ptr.pet
710975c4
Copied
Failed
Copy SHA
[crawler] expand full-network discovery lookahead
3mo ago
[crawler] reconcile relay repository state
ptr.pet
·
3mo ago
2f321fbf
Copied
Failed
Copy SHA
ptr.pet
2f321fbf
Copied
Failed
Copy SHA
[crawler] reconcile relay repository state
3mo ago
[db] migrate async boundaries to Db::run
ptr.pet
·
4mo ago
a8f59ecf
Copied
Failed
Copy SHA
ptr.pet
a8f59ecf
Copied
Failed
Copy SHA
[db] migrate async boundaries to Db::run
4mo ago
[db] group mode-specific keyspaces into per-mode
structs
structs
ptr.pet
·
4mo ago
725b5468
Copied
Failed
Copy SHA
ptr.pet
725b5468
Copied
Failed
Copy SHA
[db] group mode-specific keyspaces into per-mode structs
4mo ago
June 2026
[db] refactor how repo counts are handled
ptr.pet
·
4mo ago
bc47fdca
Copied
Failed
Copy SHA
ptr.pet
bc47fdca
Copied
Failed
Copy SHA
[db] refactor how repo counts are handled
4mo ago
May 2026
[hydrant] clippy
fixes
fixes
oyster.cafe
·
6mo ago
0817cd9e
Copied
Failed
Copy SHA
oyster.cafe
0817cd9e
Copied
Failed
Copy SHA
[hydrant] clippy fixes
6mo ago
April 2026
[db] make count tracking more durable
ptr.pet
·
6mo ago
6f2cce4f
Copied
Failed
Copy SHA
ptr.pet
6f2cce4f
Copied
Failed
Copy SHA
[db] make count tracking more durable
6mo ago
[all] re-organize types and feature gates
ptr.pet
·
7mo ago
9af943f2
Copied
Failed
Copy SHA
ptr.pet
9af943f2
Copied
Failed
Copy SHA
[all] re-organize types and feature gates
7mo ago
March 2026
[relay] ratelimits, ratelimit tiers and management
ptr.pet
·
7mo ago
d73d9a15
Copied
Failed
Copy SHA
ptr.pet
d73d9a15
Copied
Failed
Copy SHA
[relay] ratelimits, ratelimit tiers and management
7mo ago
[all] internal relay backed indexer
ptr.pet
·
7mo ago
abace9d6
Copied
Failed
Copy SHA
ptr.pet
abace9d6
Copied
Failed
Copy SHA
[all] internal relay backed indexer
7mo ago
[crawler] rewrite component, spread into producers, add consuming from listReposByCollection
ptr.pet
·
7mo ago
f99a9cd2
Copied
Failed
Copy SHA
ptr.pet
f99a9cd2
Copied
Failed
Copy SHA
[crawler] rewrite component, spread into producers, add consuming from listReposByCollection
7mo ago