+10
-1
README.md
+10
-1
README.md
···
12
12
all the data from the none bsky pdses and then processes it into a 2 massive
13
13
json file.
14
14
15
-
To run the fetcher, run the following command:
15
+
To run the fetcher, run the following commands:
16
+
17
+
1. First we need to fetch a new instance of the pdses list. This isn't needed
18
+
if you already have all the pdses you want to check.
19
+
20
+
```bash
21
+
curl "https://raw.githubusercontent.com/mary-ext/atproto-scraping/refs/heads/trunk/state.json" -o data/data.json
22
+
```
23
+
24
+
2. Then we can run the fetcher:
16
25
17
26
```bash
18
27
pnpm run gen