···18# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
19# and can be added to the global gitignore or merged into this file. For a more nuclear
20# option (not recommended) you can uncomment the following to ignore the entire idea folder.
21-#.idea/
0
···18# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
19# and can be added to the global gitignore or merged into this file. For a more nuclear
20# option (not recommended) you can uncomment the following to ignore the entire idea folder.
21+.idea/
22+.vscode/
···1+ GNU AFFERO GENERAL PUBLIC LICENSE
2+ Version 3, 19 November 2007
3+4+ Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
5+ Everyone is permitted to copy and distribute verbatim copies
6+ of this license document, but changing it is not allowed.
7+8+ Preamble
9+10+ The GNU Affero General Public License is a free, copyleft license for
11+software and other kinds of works, specifically designed to ensure
12+cooperation with the community in the case of network server software.
13+14+ The licenses for most software and other practical works are designed
15+to take away your freedom to share and change the works. By contrast,
16+our General Public Licenses are intended to guarantee your freedom to
17+share and change all versions of a program--to make sure it remains free
18+software for all its users.
19+20+ When we speak of free software, we are referring to freedom, not
21+price. Our General Public Licenses are designed to make sure that you
22+have the freedom to distribute copies of free software (and charge for
23+them if you wish), that you receive source code or can get it if you
24+want it, that you can change the software or use pieces of it in new
25+free programs, and that you know you can do these things.
26+27+ Developers that use our General Public Licenses protect your rights
28+with two steps: (1) assert copyright on the software, and (2) offer
29+you this License which gives you legal permission to copy, distribute
30+and/or modify the software.
31+32+ A secondary benefit of defending all users' freedom is that
33+improvements made in alternate versions of the program, if they
34+receive widespread use, become available for other developers to
35+incorporate. Many developers of free software are heartened and
36+encouraged by the resulting cooperation. However, in the case of
37+software used on network servers, this result may fail to come about.
38+The GNU General Public License permits making a modified version and
39+letting the public access it on a server without ever releasing its
40+source code to the public.
41+42+ The GNU Affero General Public License is designed specifically to
43+ensure that, in such cases, the modified source code becomes available
44+to the community. It requires the operator of a network server to
45+provide the source code of the modified version running there to the
46+users of that server. Therefore, public use of a modified version, on
47+a publicly accessible server, gives the public access to the source
48+code of the modified version.
49+50+ An older license, called the Affero General Public License and
51+published by Affero, was designed to accomplish similar goals. This is
52+a different license, not a version of the Affero GPL, but Affero has
53+released a new version of the Affero GPL which permits relicensing under
54+this license.
55+56+ The precise terms and conditions for copying, distribution and
57+modification follow.
58+59+ TERMS AND CONDITIONS
60+61+ 0. Definitions.
62+63+ "This License" refers to version 3 of the GNU Affero General Public License.
64+65+ "Copyright" also means copyright-like laws that apply to other kinds of
66+works, such as semiconductor masks.
67+68+ "The Program" refers to any copyrightable work licensed under this
69+License. Each licensee is addressed as "you". "Licensees" and
70+"recipients" may be individuals or organizations.
71+72+ To "modify" a work means to copy from or adapt all or part of the work
73+in a fashion requiring copyright permission, other than the making of an
74+exact copy. The resulting work is called a "modified version" of the
75+earlier work or a work "based on" the earlier work.
76+77+ A "covered work" means either the unmodified Program or a work based
78+on the Program.
79+80+ To "propagate" a work means to do anything with it that, without
81+permission, would make you directly or secondarily liable for
82+infringement under applicable copyright law, except executing it on a
83+computer or modifying a private copy. Propagation includes copying,
84+distribution (with or without modification), making available to the
85+public, and in some countries other activities as well.
86+87+ To "convey" a work means any kind of propagation that enables other
88+parties to make or receive copies. Mere interaction with a user through
89+a computer network, with no transfer of a copy, is not conveying.
90+91+ An interactive user interface displays "Appropriate Legal Notices"
92+to the extent that it includes a convenient and prominently visible
93+feature that (1) displays an appropriate copyright notice, and (2)
94+tells the user that there is no warranty for the work (except to the
95+extent that warranties are provided), that licensees may convey the
96+work under this License, and how to view a copy of this License. If
97+the interface presents a list of user commands or options, such as a
98+menu, a prominent item in the list meets this criterion.
99+100+ 1. Source Code.
101+102+ The "source code" for a work means the preferred form of the work
103+for making modifications to it. "Object code" means any non-source
104+form of a work.
105+106+ A "Standard Interface" means an interface that either is an official
107+standard defined by a recognized standards body, or, in the case of
108+interfaces specified for a particular programming language, one that
109+is widely used among developers working in that language.
110+111+ The "System Libraries" of an executable work include anything, other
112+than the work as a whole, that (a) is included in the normal form of
113+packaging a Major Component, but which is not part of that Major
114+Component, and (b) serves only to enable use of the work with that
115+Major Component, or to implement a Standard Interface for which an
116+implementation is available to the public in source code form. A
117+"Major Component", in this context, means a major essential component
118+(kernel, window system, and so on) of the specific operating system
119+(if any) on which the executable work runs, or a compiler used to
120+produce the work, or an object code interpreter used to run it.
121+122+ The "Corresponding Source" for a work in object code form means all
123+the source code needed to generate, install, and (for an executable
124+work) run the object code and to modify the work, including scripts to
125+control those activities. However, it does not include the work's
126+System Libraries, or general-purpose tools or generally available free
127+programs which are used unmodified in performing those activities but
128+which are not part of the work. For example, Corresponding Source
129+includes interface definition files associated with source files for
130+the work, and the source code for shared libraries and dynamically
131+linked subprograms that the work is specifically designed to require,
132+such as by intimate data communication or control flow between those
133+subprograms and other parts of the work.
134+135+ The Corresponding Source need not include anything that users
136+can regenerate automatically from other parts of the Corresponding
137+Source.
138+139+ The Corresponding Source for a work in source code form is that
140+same work.
141+142+ 2. Basic Permissions.
143+144+ All rights granted under this License are granted for the term of
145+copyright on the Program, and are irrevocable provided the stated
146+conditions are met. This License explicitly affirms your unlimited
147+permission to run the unmodified Program. The output from running a
148+covered work is covered by this License only if the output, given its
149+content, constitutes a covered work. This License acknowledges your
150+rights of fair use or other equivalent, as provided by copyright law.
151+152+ You may make, run and propagate covered works that you do not
153+convey, without conditions so long as your license otherwise remains
154+in force. You may convey covered works to others for the sole purpose
155+of having them make modifications exclusively for you, or provide you
156+with facilities for running those works, provided that you comply with
157+the terms of this License in conveying all material for which you do
158+not control copyright. Those thus making or running the covered works
159+for you must do so exclusively on your behalf, under your direction
160+and control, on terms that prohibit them from making any copies of
161+your copyrighted material outside their relationship with you.
162+163+ Conveying under any other circumstances is permitted solely under
164+the conditions stated below. Sublicensing is not allowed; section 10
165+makes it unnecessary.
166+167+ 3. Protecting Users' Legal Rights From Anti-Circumvention Law.
168+169+ No covered work shall be deemed part of an effective technological
170+measure under any applicable law fulfilling obligations under article
171+11 of the WIPO copyright treaty adopted on 20 December 1996, or
172+similar laws prohibiting or restricting circumvention of such
173+measures.
174+175+ When you convey a covered work, you waive any legal power to forbid
176+circumvention of technological measures to the extent such circumvention
177+is effected by exercising rights under this License with respect to
178+the covered work, and you disclaim any intention to limit operation or
179+modification of the work as a means of enforcing, against the work's
180+users, your or third parties' legal rights to forbid circumvention of
181+technological measures.
182+183+ 4. Conveying Verbatim Copies.
184+185+ You may convey verbatim copies of the Program's source code as you
186+receive it, in any medium, provided that you conspicuously and
187+appropriately publish on each copy an appropriate copyright notice;
188+keep intact all notices stating that this License and any
189+non-permissive terms added in accord with section 7 apply to the code;
190+keep intact all notices of the absence of any warranty; and give all
191+recipients a copy of this License along with the Program.
192+193+ You may charge any price or no price for each copy that you convey,
194+and you may offer support or warranty protection for a fee.
195+196+ 5. Conveying Modified Source Versions.
197+198+ You may convey a work based on the Program, or the modifications to
199+produce it from the Program, in the form of source code under the
200+terms of section 4, provided that you also meet all of these conditions:
201+202+ a) The work must carry prominent notices stating that you modified
203+ it, and giving a relevant date.
204+205+ b) The work must carry prominent notices stating that it is
206+ released under this License and any conditions added under section
207+ 7. This requirement modifies the requirement in section 4 to
208+ "keep intact all notices".
209+210+ c) You must license the entire work, as a whole, under this
211+ License to anyone who comes into possession of a copy. This
212+ License will therefore apply, along with any applicable section 7
213+ additional terms, to the whole of the work, and all its parts,
214+ regardless of how they are packaged. This License gives no
215+ permission to license the work in any other way, but it does not
216+ invalidate such permission if you have separately received it.
217+218+ d) If the work has interactive user interfaces, each must display
219+ Appropriate Legal Notices; however, if the Program has interactive
220+ interfaces that do not display Appropriate Legal Notices, your
221+ work need not make them do so.
222+223+ A compilation of a covered work with other separate and independent
224+works, which are not by their nature extensions of the covered work,
225+and which are not combined with it such as to form a larger program,
226+in or on a volume of a storage or distribution medium, is called an
227+"aggregate" if the compilation and its resulting copyright are not
228+used to limit the access or legal rights of the compilation's users
229+beyond what the individual works permit. Inclusion of a covered work
230+in an aggregate does not cause this License to apply to the other
231+parts of the aggregate.
232+233+ 6. Conveying Non-Source Forms.
234+235+ You may convey a covered work in object code form under the terms
236+of sections 4 and 5, provided that you also convey the
237+machine-readable Corresponding Source under the terms of this License,
238+in one of these ways:
239+240+ a) Convey the object code in, or embodied in, a physical product
241+ (including a physical distribution medium), accompanied by the
242+ Corresponding Source fixed on a durable physical medium
243+ customarily used for software interchange.
244+245+ b) Convey the object code in, or embodied in, a physical product
246+ (including a physical distribution medium), accompanied by a
247+ written offer, valid for at least three years and valid for as
248+ long as you offer spare parts or customer support for that product
249+ model, to give anyone who possesses the object code either (1) a
250+ copy of the Corresponding Source for all the software in the
251+ product that is covered by this License, on a durable physical
252+ medium customarily used for software interchange, for a price no
253+ more than your reasonable cost of physically performing this
254+ conveying of source, or (2) access to copy the
255+ Corresponding Source from a network server at no charge.
256+257+ c) Convey individual copies of the object code with a copy of the
258+ written offer to provide the Corresponding Source. This
259+ alternative is allowed only occasionally and noncommercially, and
260+ only if you received the object code with such an offer, in accord
261+ with subsection 6b.
262+263+ d) Convey the object code by offering access from a designated
264+ place (gratis or for a charge), and offer equivalent access to the
265+ Corresponding Source in the same way through the same place at no
266+ further charge. You need not require recipients to copy the
267+ Corresponding Source along with the object code. If the place to
268+ copy the object code is a network server, the Corresponding Source
269+ may be on a different server (operated by you or a third party)
270+ that supports equivalent copying facilities, provided you maintain
271+ clear directions next to the object code saying where to find the
272+ Corresponding Source. Regardless of what server hosts the
273+ Corresponding Source, you remain obligated to ensure that it is
274+ available for as long as needed to satisfy these requirements.
275+276+ e) Convey the object code using peer-to-peer transmission, provided
277+ you inform other peers where the object code and Corresponding
278+ Source of the work are being offered to the general public at no
279+ charge under subsection 6d.
280+281+ A separable portion of the object code, whose source code is excluded
282+from the Corresponding Source as a System Library, need not be
283+included in conveying the object code work.
284+285+ A "User Product" is either (1) a "consumer product", which means any
286+tangible personal property which is normally used for personal, family,
287+or household purposes, or (2) anything designed or sold for incorporation
288+into a dwelling. In determining whether a product is a consumer product,
289+doubtful cases shall be resolved in favor of coverage. For a particular
290+product received by a particular user, "normally used" refers to a
291+typical or common use of that class of product, regardless of the status
292+of the particular user or of the way in which the particular user
293+actually uses, or expects or is expected to use, the product. A product
294+is a consumer product regardless of whether the product has substantial
295+commercial, industrial or non-consumer uses, unless such uses represent
296+the only significant mode of use of the product.
297+298+ "Installation Information" for a User Product means any methods,
299+procedures, authorization keys, or other information required to install
300+and execute modified versions of a covered work in that User Product from
301+a modified version of its Corresponding Source. The information must
302+suffice to ensure that the continued functioning of the modified object
303+code is in no case prevented or interfered with solely because
304+modification has been made.
305+306+ If you convey an object code work under this section in, or with, or
307+specifically for use in, a User Product, and the conveying occurs as
308+part of a transaction in which the right of possession and use of the
309+User Product is transferred to the recipient in perpetuity or for a
310+fixed term (regardless of how the transaction is characterized), the
311+Corresponding Source conveyed under this section must be accompanied
312+by the Installation Information. But this requirement does not apply
313+if neither you nor any third party retains the ability to install
314+modified object code on the User Product (for example, the work has
315+been installed in ROM).
316+317+ The requirement to provide Installation Information does not include a
318+requirement to continue to provide support service, warranty, or updates
319+for a work that has been modified or installed by the recipient, or for
320+the User Product in which it has been modified or installed. Access to a
321+network may be denied when the modification itself materially and
322+adversely affects the operation of the network or violates the rules and
323+protocols for communication across the network.
324+325+ Corresponding Source conveyed, and Installation Information provided,
326+in accord with this section must be in a format that is publicly
327+documented (and with an implementation available to the public in
328+source code form), and must require no special password or key for
329+unpacking, reading or copying.
330+331+ 7. Additional Terms.
332+333+ "Additional permissions" are terms that supplement the terms of this
334+License by making exceptions from one or more of its conditions.
335+Additional permissions that are applicable to the entire Program shall
336+be treated as though they were included in this License, to the extent
337+that they are valid under applicable law. If additional permissions
338+apply only to part of the Program, that part may be used separately
339+under those permissions, but the entire Program remains governed by
340+this License without regard to the additional permissions.
341+342+ When you convey a copy of a covered work, you may at your option
343+remove any additional permissions from that copy, or from any part of
344+it. (Additional permissions may be written to require their own
345+removal in certain cases when you modify the work.) You may place
346+additional permissions on material, added by you to a covered work,
347+for which you have or can give appropriate copyright permission.
348+349+ Notwithstanding any other provision of this License, for material you
350+add to a covered work, you may (if authorized by the copyright holders of
351+that material) supplement the terms of this License with terms:
352+353+ a) Disclaiming warranty or limiting liability differently from the
354+ terms of sections 15 and 16 of this License; or
355+356+ b) Requiring preservation of specified reasonable legal notices or
357+ author attributions in that material or in the Appropriate Legal
358+ Notices displayed by works containing it; or
359+360+ c) Prohibiting misrepresentation of the origin of that material, or
361+ requiring that modified versions of such material be marked in
362+ reasonable ways as different from the original version; or
363+364+ d) Limiting the use for publicity purposes of names of licensors or
365+ authors of the material; or
366+367+ e) Declining to grant rights under trademark law for use of some
368+ trade names, trademarks, or service marks; or
369+370+ f) Requiring indemnification of licensors and authors of that
371+ material by anyone who conveys the material (or modified versions of
372+ it) with contractual assumptions of liability to the recipient, for
373+ any liability that these contractual assumptions directly impose on
374+ those licensors and authors.
375+376+ All other non-permissive additional terms are considered "further
377+restrictions" within the meaning of section 10. If the Program as you
378+received it, or any part of it, contains a notice stating that it is
379+governed by this License along with a term that is a further
380+restriction, you may remove that term. If a license document contains
381+a further restriction but permits relicensing or conveying under this
382+License, you may add to a covered work material governed by the terms
383+of that license document, provided that the further restriction does
384+not survive such relicensing or conveying.
385+386+ If you add terms to a covered work in accord with this section, you
387+must place, in the relevant source files, a statement of the
388+additional terms that apply to those files, or a notice indicating
389+where to find the applicable terms.
390+391+ Additional terms, permissive or non-permissive, may be stated in the
392+form of a separately written license, or stated as exceptions;
393+the above requirements apply either way.
394+395+ 8. Termination.
396+397+ You may not propagate or modify a covered work except as expressly
398+provided under this License. Any attempt otherwise to propagate or
399+modify it is void, and will automatically terminate your rights under
400+this License (including any patent licenses granted under the third
401+paragraph of section 11).
402+403+ However, if you cease all violation of this License, then your
404+license from a particular copyright holder is reinstated (a)
405+provisionally, unless and until the copyright holder explicitly and
406+finally terminates your license, and (b) permanently, if the copyright
407+holder fails to notify you of the violation by some reasonable means
408+prior to 60 days after the cessation.
409+410+ Moreover, your license from a particular copyright holder is
411+reinstated permanently if the copyright holder notifies you of the
412+violation by some reasonable means, this is the first time you have
413+received notice of violation of this License (for any work) from that
414+copyright holder, and you cure the violation prior to 30 days after
415+your receipt of the notice.
416+417+ Termination of your rights under this section does not terminate the
418+licenses of parties who have received copies or rights from you under
419+this License. If your rights have been terminated and not permanently
420+reinstated, you do not qualify to receive new licenses for the same
421+material under section 10.
422+423+ 9. Acceptance Not Required for Having Copies.
424+425+ You are not required to accept this License in order to receive or
426+run a copy of the Program. Ancillary propagation of a covered work
427+occurring solely as a consequence of using peer-to-peer transmission
428+to receive a copy likewise does not require acceptance. However,
429+nothing other than this License grants you permission to propagate or
430+modify any covered work. These actions infringe copyright if you do
431+not accept this License. Therefore, by modifying or propagating a
432+covered work, you indicate your acceptance of this License to do so.
433+434+ 10. Automatic Licensing of Downstream Recipients.
435+436+ Each time you convey a covered work, the recipient automatically
437+receives a license from the original licensors, to run, modify and
438+propagate that work, subject to this License. You are not responsible
439+for enforcing compliance by third parties with this License.
440+441+ An "entity transaction" is a transaction transferring control of an
442+organization, or substantially all assets of one, or subdividing an
443+organization, or merging organizations. If propagation of a covered
444+work results from an entity transaction, each party to that
445+transaction who receives a copy of the work also receives whatever
446+licenses to the work the party's predecessor in interest had or could
447+give under the previous paragraph, plus a right to possession of the
448+Corresponding Source of the work from the predecessor in interest, if
449+the predecessor has it or can get it with reasonable efforts.
450+451+ You may not impose any further restrictions on the exercise of the
452+rights granted or affirmed under this License. For example, you may
453+not impose a license fee, royalty, or other charge for exercise of
454+rights granted under this License, and you may not initiate litigation
455+(including a cross-claim or counterclaim in a lawsuit) alleging that
456+any patent claim is infringed by making, using, selling, offering for
457+sale, or importing the Program or any portion of it.
458+459+ 11. Patents.
460+461+ A "contributor" is a copyright holder who authorizes use under this
462+License of the Program or a work on which the Program is based. The
463+work thus licensed is called the contributor's "contributor version".
464+465+ A contributor's "essential patent claims" are all patent claims
466+owned or controlled by the contributor, whether already acquired or
467+hereafter acquired, that would be infringed by some manner, permitted
468+by this License, of making, using, or selling its contributor version,
469+but do not include claims that would be infringed only as a
470+consequence of further modification of the contributor version. For
471+purposes of this definition, "control" includes the right to grant
472+patent sublicenses in a manner consistent with the requirements of
473+this License.
474+475+ Each contributor grants you a non-exclusive, worldwide, royalty-free
476+patent license under the contributor's essential patent claims, to
477+make, use, sell, offer for sale, import and otherwise run, modify and
478+propagate the contents of its contributor version.
479+480+ In the following three paragraphs, a "patent license" is any express
481+agreement or commitment, however denominated, not to enforce a patent
482+(such as an express permission to practice a patent or covenant not to
483+sue for patent infringement). To "grant" such a patent license to a
484+party means to make such an agreement or commitment not to enforce a
485+patent against the party.
486+487+ If you convey a covered work, knowingly relying on a patent license,
488+and the Corresponding Source of the work is not available for anyone
489+to copy, free of charge and under the terms of this License, through a
490+publicly available network server or other readily accessible means,
491+then you must either (1) cause the Corresponding Source to be so
492+available, or (2) arrange to deprive yourself of the benefit of the
493+patent license for this particular work, or (3) arrange, in a manner
494+consistent with the requirements of this License, to extend the patent
495+license to downstream recipients. "Knowingly relying" means you have
496+actual knowledge that, but for the patent license, your conveying the
497+covered work in a country, or your recipient's use of the covered work
498+in a country, would infringe one or more identifiable patents in that
499+country that you have reason to believe are valid.
500+501+ If, pursuant to or in connection with a single transaction or
502+arrangement, you convey, or propagate by procuring conveyance of, a
503+covered work, and grant a patent license to some of the parties
504+receiving the covered work authorizing them to use, propagate, modify
505+or convey a specific copy of the covered work, then the patent license
506+you grant is automatically extended to all recipients of the covered
507+work and works based on it.
508+509+ A patent license is "discriminatory" if it does not include within
510+the scope of its coverage, prohibits the exercise of, or is
511+conditioned on the non-exercise of one or more of the rights that are
512+specifically granted under this License. You may not convey a covered
513+work if you are a party to an arrangement with a third party that is
514+in the business of distributing software, under which you make payment
515+to the third party based on the extent of your activity of conveying
516+the work, and under which the third party grants, to any of the
517+parties who would receive the covered work from you, a discriminatory
518+patent license (a) in connection with copies of the covered work
519+conveyed by you (or copies made from those copies), or (b) primarily
520+for and in connection with specific products or compilations that
521+contain the covered work, unless you entered into that arrangement,
522+or that patent license was granted, prior to 28 March 2007.
523+524+ Nothing in this License shall be construed as excluding or limiting
525+any implied license or other defenses to infringement that may
526+otherwise be available to you under applicable patent law.
527+528+ 12. No Surrender of Others' Freedom.
529+530+ If conditions are imposed on you (whether by court order, agreement or
531+otherwise) that contradict the conditions of this License, they do not
532+excuse you from the conditions of this License. If you cannot convey a
533+covered work so as to satisfy simultaneously your obligations under this
534+License and any other pertinent obligations, then as a consequence you may
535+not convey it at all. For example, if you agree to terms that obligate you
536+to collect a royalty for further conveying from those to whom you convey
537+the Program, the only way you could satisfy both those terms and this
538+License would be to refrain entirely from conveying the Program.
539+540+ 13. Remote Network Interaction; Use with the GNU General Public License.
541+542+ Notwithstanding any other provision of this License, if you modify the
543+Program, your modified version must prominently offer all users
544+interacting with it remotely through a computer network (if your version
545+supports such interaction) an opportunity to receive the Corresponding
546+Source of your version by providing access to the Corresponding Source
547+from a network server at no charge, through some standard or customary
548+means of facilitating copying of software. This Corresponding Source
549+shall include the Corresponding Source for any work covered by version 3
550+of the GNU General Public License that is incorporated pursuant to the
551+following paragraph.
552+553+ Notwithstanding any other provision of this License, you have
554+permission to link or combine any covered work with a work licensed
555+under version 3 of the GNU General Public License into a single
556+combined work, and to convey the resulting work. The terms of this
557+License will continue to apply to the part which is the covered work,
558+but the work with which it is combined will remain governed by version
559+3 of the GNU General Public License.
560+561+ 14. Revised Versions of this License.
562+563+ The Free Software Foundation may publish revised and/or new versions of
564+the GNU Affero General Public License from time to time. Such new versions
565+will be similar in spirit to the present version, but may differ in detail to
566+address new problems or concerns.
567+568+ Each version is given a distinguishing version number. If the
569+Program specifies that a certain numbered version of the GNU Affero General
570+Public License "or any later version" applies to it, you have the
571+option of following the terms and conditions either of that numbered
572+version or of any later version published by the Free Software
573+Foundation. If the Program does not specify a version number of the
574+GNU Affero General Public License, you may choose any version ever published
575+by the Free Software Foundation.
576+577+ If the Program specifies that a proxy can decide which future
578+versions of the GNU Affero General Public License can be used, that proxy's
579+public statement of acceptance of a version permanently authorizes you
580+to choose that version for the Program.
581+582+ Later license versions may give you additional or different
583+permissions. However, no additional obligations are imposed on any
584+author or copyright holder as a result of your choosing to follow a
585+later version.
586+587+ 15. Disclaimer of Warranty.
588+589+ THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
590+APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
591+HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
592+OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
593+THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
594+PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
595+IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
596+ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
597+598+ 16. Limitation of Liability.
599+600+ IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
601+WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
602+THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
603+GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
604+USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
605+DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
606+PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
607+EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
608+SUCH DAMAGES.
609+610+ 17. Interpretation of Sections 15 and 16.
611+612+ If the disclaimer of warranty and limitation of liability provided
613+above cannot be given local legal effect according to their terms,
614+reviewing courts shall apply local law that most closely approximates
615+an absolute waiver of all civil liability in connection with the
616+Program, unless a warranty or assumption of liability accompanies a
617+copy of the Program in return for a fee.
618+619+ END OF TERMS AND CONDITIONS
620+621+ How to Apply These Terms to Your New Programs
622+623+ If you develop a new program, and you want it to be of the greatest
624+possible use to the public, the best way to achieve this is to make it
625+free software which everyone can redistribute and change under these terms.
626+627+ To do so, attach the following notices to the program. It is safest
628+to attach them to the start of each source file to most effectively
629+state the exclusion of warranty; and each file should have at least
630+the "copyright" line and a pointer to where the full notice is found.
631+632+ <one line to give the program's name and a brief idea of what it does.>
633+ Copyright (C) 2025 <name of author>
634+635+ This program is free software: you can redistribute it and/or modify
636+ it under the terms of the GNU Affero General Public License as published
637+ by the Free Software Foundation, either version 3 of the License, or
638+ (at your option) any later version.
639+640+ This program is distributed in the hope that it will be useful,
641+ but WITHOUT ANY WARRANTY; without even the implied warranty of
642+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
643+ GNU Affero General Public License for more details.
644+645+ You should have received a copy of the GNU Affero General Public License
646+ along with this program. If not, see <https://www.gnu.org/licenses/>.
647+648+Also add information on how to contact you by electronic and paper mail.
649+650+ If your software can interact with users remotely through a computer
651+network, you should also make sure that it provides a way for users to
652+get its source. For example, if your program is a web application, its
653+interface could display a "Source" link that leads users to an archive
654+of the code. There are many ways you could offer source, and different
655+solutions will be better for different programs; see section 13 for the
656+specific requirements.
657+658+ You should also get your employer (if you work as a programmer) or school,
659+if any, to sign a "copyright disclaimer" for the program, if necessary.
660+For more information on this, and how to apply and follow the GNU AGPL, see
661+<https://www.gnu.org/licenses/>.
+207
README.md
···001# Personal Activity Index
23A CLI that ingests content from Substack, Bluesky, and Leaflet into SQLite, with an optional Cloudflare Worker + D1 deployment path.
0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
···1+<!-- markdownlint-disable MD033 -->
2+3# Personal Activity Index
45A CLI that ingests content from Substack, Bluesky, and Leaflet into SQLite, with an optional Cloudflare Worker + D1 deployment path.
6+7+## Features
8+9+- Fetch posts from multiple sources:
10+ - **Substack** via RSS feeds
11+ - **Bluesky** via AT Protocol
12+ - **Leaflet** publications via RSS feeds
13+- Local SQLite storage with full-text search
14+- Flexible filtering and querying
15+- Self-hostable or serverless (Cloudflare Workers)
16+17+## Quick Start
18+19+```bash
20+# Install
21+cargo install --path cli
22+23+# Initialize config (creates ~/.config/pai/config.toml)
24+pai init
25+26+# Edit config with your sources
27+$EDITOR ~/.config/pai/config.toml
28+29+# Sync content
30+pai sync
31+32+# List items
33+pai list -n 10
34+35+# Check database
36+pai db-check
37+```
38+39+## Configuration
40+41+Configuration is loaded from `$XDG_CONFIG_HOME/pai/config.toml` or `$HOME/.config/pai/config.toml`.
42+43+See [config.example.toml](./config.example.toml) for a complete example with all available options.
44+45+## Architecture
46+47+The project is organized as a Cargo workspace
48+49+```sh
50+.
51+├── core # Shared types, fetchers, and the storage trait
52+├── cli # CLI binary (POSIX-compliant)
53+└── worker # Cloudflare Worker deployment using workers-rs
54+```
55+56+<details>
57+<summary><strong>Source Implementations</strong></summary>
58+59+### Substack (RSS)
60+61+Substack fetcher uses standard RSS 2.0 feeds available at `{base_url}/feed`.
62+63+**Implementation:**
64+65+- Fetches RSS feed using `feed-rs` parser
66+- Maps RSS `<item>` elements to standardized `Item` struct
67+- Uses GUID as item ID, falls back to link if GUID is missing
68+- Normalizes `pubDate` to ISO 8601 format
69+70+**Key mappings:**
71+72+- `id` = RSS GUID or link
73+- `source_kind` = `substack`
74+- `source_id` = Domain extracted from base_url
75+- `title` = RSS title
76+- `summary` = RSS description
77+- `url` = RSS link
78+- `content_html` = RSS content (if available)
79+- `published_at` = RSS pubDate (normalized to ISO 8601)
80+81+**Example RSS structure:**
82+83+```xml
84+<item>
85+ <title>Post Title</title>
86+ <link>https://example.substack.com/p/post-slug</link>
87+ <guid>https://example.substack.com/p/post-slug</guid>
88+ <pubDate>Mon, 01 Jan 2024 12:00:00 +0000</pubDate>
89+ <description>Post summary or excerpt</description>
90+</item>
91+```
92+93+### AT Protocol Integration (Bluesky)
94+95+#### Overview
96+97+Bluesky is built on the AT Protocol (Authenticated Transfer Protocol), a decentralized social networking protocol.
98+99+**Key Concepts:**
100+101+- **DID (Decentralized Identifier)**: Unique identifier for users (e.g., `did:plc:xyz123`)
102+- **Handle**: Human-readable identifier (e.g., `user.bsky.social`)
103+- **AT URI**: Resource identifier (e.g., `at://did:plc:xyz/app.bsky.feed.post/abc123`)
104+- **Lexicon**: Schema definition language for records and API methods
105+- **XRPC**: HTTP API wrapper for AT Protocol methods
106+- **PDS (Personal Data Server)**: Server that stores user data
107+108+#### Implementation
109+110+Bluesky uses standard `app.bsky.feed.post` records and provides a public API for fetching posts.
111+112+**Endpoint:** `GET https://public.api.bsky.app/xrpc/app.bsky.feed.getAuthorFeed`
113+114+**Parameters:**
115+116+- `actor` - User handle or DID
117+- `limit` - Number of posts to fetch (default: 50)
118+- `cursor` - Pagination cursor (optional)
119+120+**Implementation:**
121+122+- Fetches author feed using `app.bsky.feed.getAuthorFeed`
123+- Filters out reposts and quotes (only includes original posts)
124+- Converts AT URIs to canonical Bluesky URLs
125+- Truncates long post text to create titles
126+127+**Key mappings:**
128+129+- `id` = AT URI (e.g., `at://did:plc:xyz/app.bsky.feed.post/abc123`)
130+- `source_kind` = `bluesky`
131+- `source_id` = User handle
132+- `title` = Truncated post text (first 100 chars)
133+- `summary` = Full post text
134+- `url` = Canonical URL (`https://bsky.app/profile/{handle}/post/{post_id}`)
135+- `author` = Post author handle
136+- `published_at` = Post `createdAt` timestamp
137+138+**Filtering reposts:**
139+Posts with a `reason` field (indicating repost or quote) are excluded to fetch only original content.
140+141+### Leaflet (RSS)
142+143+#### Overview
144+145+Leaflet publications provide RSS feeds at `{base_url}/rss`, making them straightforward to fetch using standard RSS parsing.
146+147+**Note:** While Leaflet is built on AT Protocol and uses custom `pub.leaflet.post` records, we use RSS feeds for simplicity and reliability. Leaflet's RSS implementation provides all necessary metadata without requiring AT Protocol PDS queries.
148+149+**Implementation:**
150+151+- Fetches RSS feed using `feed-rs` parser
152+- Maps RSS `<item>` elements to standardized `Item` struct
153+- Supports multiple publications via config array
154+- Uses entry ID from feed, falls back to link if missing
155+- Normalizes publication dates to ISO 8601 format
156+157+**Key mappings:**
158+159+- `id` = RSS entry ID or link
160+- `source_kind` = `leaflet`
161+- `source_id` = Publication ID from config (e.g., `desertthunder`, `stormlightlabs`)
162+- `title` = RSS entry title
163+- `summary` = RSS entry summary/description
164+- `url` = RSS entry link
165+- `content_html` = RSS content body (if available)
166+- `author` = RSS entry author
167+- `published_at` = RSS published date or updated date (normalized to ISO 8601)
168+169+**Configuration:**
170+171+Leaflet supports multiple publications through array configuration:
172+173+```toml
174+[[sources.leaflet]]
175+enabled = true
176+id = "desertthunder"
177+base_url = "https://desertthunder.leaflet.pub"
178+179+[[sources.leaflet]]
180+enabled = true
181+id = "stormlightlabs"
182+base_url = "https://stormlightlabs.leaflet.pub"
183+```
184+185+**Example RSS structure:**
186+187+```xml
188+<item>
189+ <title>Dev Log: 2025-11-22</title>
190+ <link>https://desertthunder.leaflet.pub/3m6a7fuk7u22p</link>
191+ <guid>https://desertthunder.leaflet.pub/3m6a7fuk7u22p</guid>
192+ <pubDate>Fri, 22 Nov 2025 16:22:54 +0000</pubDate>
193+ <description>Post summary or excerpt</description>
194+</item>
195+```
196+197+</details>
198+199+## References
200+201+- [AT Protocol Documentation](https://atproto.com)
202+- [Lexicon Guide](https://atproto.com/guides/lexicon) - Schema definition language
203+- [XRPC Specification](https://atproto.com/specs/xrpc) - HTTP API wrapper
204+- [Bluesky API Documentation](https://docs.bsky.app/)
205+- [Leaflet](https://tangled.org/leaflet.pub/leaflet) - Leaflet source code
206+- [Leaflet Manual](https://about.leaflet.pub/) - User-facing documentation
207+208+## License
209+210+See [LICENSE file](./LICENSE) for details.
+1
cli/Cargo.toml
···13rusqlite = { version = "0.37", features = ["bundled"] }
14chrono = "0.4"
15dirs = "6.0"
0
···13rusqlite = { version = "0.37", features = ["bundled"] }
14chrono = "0.4"
15dirs = "6.0"
16+owo-colors = "4.1"
+138-58
cli/src/main.rs
···2mod storage;
34use clap::{Parser, Subcommand};
05use pai_core::{Config, ListFilter, PaiError, SourceKind};
6use std::path::PathBuf;
7use storage::SqliteStorage;
···23 command: Commands,
24}
25000000000000000000000000000000000000000000026#[derive(Subcommand, Debug)]
27enum Commands {
28 /// Fetch and store content from configured sources
···64 },
6566 /// Produce feeds or export files
67- Export {
68- /// Filter by source kind
69- #[arg(short = 'k', value_name = "KIND")]
70- kind: Option<SourceKind>,
71-72- /// Filter by specific source ID
73- #[arg(short = 'S', value_name = "ID")]
74- source_id: Option<String>,
75-76- /// Maximum number of items
77- #[arg(short = 'n', value_name = "NUMBER")]
78- limit: Option<usize>,
79-80- /// Only items published at or after this time
81- #[arg(short = 's', value_name = "TIME")]
82- since: Option<String>,
83-84- /// Filter items by substring
85- #[arg(short = 'q', value_name = "PATTERN")]
86- query: Option<String>,
87-88- /// Output format
89- #[arg(short = 'f', value_name = "FORMAT", default_value = "json")]
90- format: String,
91-92- /// Output file (default: stdout)
93- #[arg(short = 'o', value_name = "FILE")]
94- output: Option<PathBuf>,
95- },
9697 /// Self-host HTTP API
98 Serve {
···103104 /// Verify database schema and print statistics
105 DbCheck,
0000000106}
107108fn main() {
···113 Commands::List { kind, source_id, limit, since, query } => {
114 handle_list(cli.db_path, kind, source_id, limit, since, query)
115 }
116- Commands::Export { kind, source_id, limit, since, query, format, output } => {
117- handle_export(cli.db_path, kind, source_id, limit, since, query, format, output)
118- }
119 Commands::Serve { address } => handle_serve(cli.db_path, address),
120 Commands::DbCheck => handle_db_check(cli.db_path),
0121 };
122123 if let Err(e) = result {
124- eprintln!("Error: {e}");
125 std::process::exit(1);
126 }
127}
128129fn handle_sync(
130- config_dir: Option<PathBuf>, db_path: Option<PathBuf>, _all: bool, _kind: Option<SourceKind>,
131- _source_id: Option<String>,
132) -> Result<(), PaiError> {
133 let db_path = paths::resolve_db_path(db_path)?;
134- let _config_dir = paths::resolve_config_dir(config_dir)?;
135136 let storage = SqliteStorage::new(db_path)?;
137- let config = Config::default();
138139- let count = pai_core::sync_all_sources(&config, &storage)?;
000000000140141- println!("Synced {count} items");
0000000142 Ok(())
143}
144···154 let items = pai_core::Storage::list_items(&storage, &filter)?;
155156 if items.is_empty() {
157- println!("No items found");
158 return Ok(());
159 }
160161- println!("Found {} items:\n", items.len());
162 for item in items {
163- println!("ID: {}", item.id);
164- println!("Source: {} ({})", item.source_kind, item.source_id);
00000165 if let Some(title) = &item.title {
166- println!("Title: {title}");
167 }
168 if let Some(author) = &item.author {
169- println!("Author: {author}");
170 }
171- println!("URL: {}", item.url);
172- println!("Published: {}", item.published_at);
173 println!();
174 }
175176 Ok(())
177}
178179-fn handle_export(
180- db_path: Option<PathBuf>, kind: Option<SourceKind>, source_id: Option<String>, limit: Option<usize>,
181- since: Option<String>, query: Option<String>, format: String, output: Option<PathBuf>,
182-) -> Result<(), PaiError> {
183 let db_path = paths::resolve_db_path(db_path)?;
184 let _storage = SqliteStorage::new(db_path)?;
185186- let filter = ListFilter { source_kind: kind, source_id, limit, since, query };
00187188 println!("export command - format: {format}, output: {output:?}, filter: {filter:?}");
189 Ok(())
···201 let db_path = paths::resolve_db_path(db_path)?;
202 let storage = SqliteStorage::new(db_path)?;
203204- println!("Verifying database schema...");
205 storage.verify_schema()?;
206- println!("Schema verification: OK\n");
207208- println!("Database statistics:");
209 let total = storage.count_items()?;
210- println!(" Total items: {total}");
211212 let stats = storage.get_stats()?;
213 if !stats.is_empty() {
214- println!("\nItems by source:");
215 for (source_kind, count) in stats {
216- println!(" {source_kind}: {count}");
217 }
218 }
219220 Ok(())
221}
000000000000000000000000000000000000000
···2mod storage;
34use clap::{Parser, Subcommand};
5+use owo_colors::OwoColorize;
6use pai_core::{Config, ListFilter, PaiError, SourceKind};
7use std::path::PathBuf;
8use storage::SqliteStorage;
···24 command: Commands,
25}
2627+#[derive(Parser, Debug)]
28+struct ExportOpts {
29+ /// Filter by source kind
30+ #[arg(short = 'k', value_name = "KIND")]
31+ kind: Option<SourceKind>,
32+33+ /// Filter by specific source ID
34+ #[arg(short = 'S', value_name = "ID")]
35+ source_id: Option<String>,
36+37+ /// Maximum number of items
38+ #[arg(short = 'n', value_name = "NUMBER")]
39+ limit: Option<usize>,
40+41+ /// Only items published at or after this time
42+ #[arg(short = 's', value_name = "TIME")]
43+ since: Option<String>,
44+45+ /// Filter items by substring
46+ #[arg(short = 'q', value_name = "PATTERN")]
47+ query: Option<String>,
48+49+ /// Output format
50+ #[arg(short = 'f', value_name = "FORMAT", default_value = "json")]
51+ format: String,
52+53+ /// Output file (default: stdout)
54+ #[arg(short = 'o', value_name = "FILE")]
55+ output: Option<PathBuf>,
56+}
57+58+impl From<ExportOpts> for ListFilter {
59+ fn from(opts: ExportOpts) -> Self {
60+ ListFilter {
61+ source_kind: opts.kind,
62+ source_id: opts.source_id,
63+ limit: opts.limit,
64+ since: opts.since,
65+ query: opts.query,
66+ }
67+ }
68+}
69+70#[derive(Subcommand, Debug)]
71enum Commands {
72 /// Fetch and store content from configured sources
···108 },
109110 /// Produce feeds or export files
111+ Export(ExportOpts),
0000000000000000000000000000112113 /// Self-host HTTP API
114 Serve {
···119120 /// Verify database schema and print statistics
121 DbCheck,
122+123+ /// Initialize configuration file
124+ Init {
125+ /// Force overwrite existing config
126+ #[arg(short = 'f')]
127+ force: bool,
128+ },
129}
130131fn main() {
···136 Commands::List { kind, source_id, limit, since, query } => {
137 handle_list(cli.db_path, kind, source_id, limit, since, query)
138 }
139+ Commands::Export(opts) => handle_export(cli.db_path, opts),
00140 Commands::Serve { address } => handle_serve(cli.db_path, address),
141 Commands::DbCheck => handle_db_check(cli.db_path),
142+ Commands::Init { force } => handle_init(cli.config_dir, force),
143 };
144145 if let Err(e) = result {
146+ eprintln!("{} {}", "Error:".red().bold(), e);
147 std::process::exit(1);
148 }
149}
150151fn handle_sync(
152+ config_dir: Option<PathBuf>, db_path: Option<PathBuf>, _all: bool, kind: Option<SourceKind>,
153+ source_id: Option<String>,
154) -> Result<(), PaiError> {
155 let db_path = paths::resolve_db_path(db_path)?;
156+ let config_dir = paths::resolve_config_dir(config_dir)?;
157158 let storage = SqliteStorage::new(db_path)?;
0159160+ let config_path = config_dir.join("config.toml");
161+ let config = if config_path.exists() {
162+ Config::from_file(&config_path)?
163+ } else {
164+ println!(
165+ "{} No config file found, using default configuration",
166+ "Warning:".yellow()
167+ );
168+ Config::default()
169+ };
170171+ let count = pai_core::sync_all_sources(&config, &storage, kind, source_id.as_deref())?;
172+173+ if count == 0 {
174+ println!("{} No sources synced (check your config or filters)", "Info:".cyan());
175+ } else {
176+ println!("{} Synced {}", "Success:".green(), format!("{count} source(s)").bold());
177+ }
178+179 Ok(())
180}
181···191 let items = pai_core::Storage::list_items(&storage, &filter)?;
192193 if items.is_empty() {
194+ println!("{}", "No items found".yellow());
195 return Ok(());
196 }
197198+ println!("{} {}\n", "Found".cyan(), format!("{} items:", items.len()).bold());
199 for item in items {
200+ println!("{} {}", "ID:".bright_black(), item.id);
201+ println!(
202+ "{} {} {}",
203+ "Source:".bright_black(),
204+ item.source_kind.to_string().cyan(),
205+ format!("({})", item.source_id).bright_black()
206+ );
207 if let Some(title) = &item.title {
208+ println!("{} {}", "Title:".bright_black(), title.bold());
209 }
210 if let Some(author) = &item.author {
211+ println!("{} {}", "Author:".bright_black(), author);
212 }
213+ println!("{} {}", "URL:".bright_black(), item.url.blue().underline());
214+ println!("{} {}", "Published:".bright_black(), item.published_at);
215 println!();
216 }
217218 Ok(())
219}
220221+fn handle_export(db_path: Option<PathBuf>, opts: ExportOpts) -> Result<(), PaiError> {
000222 let db_path = paths::resolve_db_path(db_path)?;
223 let _storage = SqliteStorage::new(db_path)?;
224225+ let format = opts.format.clone();
226+ let output = opts.output.clone();
227+ let filter: ListFilter = opts.into();
228229 println!("export command - format: {format}, output: {output:?}, filter: {filter:?}");
230 Ok(())
···242 let db_path = paths::resolve_db_path(db_path)?;
243 let storage = SqliteStorage::new(db_path)?;
244245+ println!("{}", "Verifying database schema...".cyan());
246 storage.verify_schema()?;
247+ println!("{} {}\n", "Schema verification:".green(), "OK".bold());
248249+ println!("{}", "Database statistics:".cyan().bold());
250 let total = storage.count_items()?;
251+ println!(" {}: {}", "Total items".bright_black(), total.to_string().bold());
252253 let stats = storage.get_stats()?;
254 if !stats.is_empty() {
255+ println!("\n{}", "Items by source:".cyan().bold());
256 for (source_kind, count) in stats {
257+ println!(" {}: {}", source_kind.bright_black(), count.to_string().bold());
258 }
259 }
260261 Ok(())
262}
263+264+fn handle_init(config_dir: Option<PathBuf>, force: bool) -> Result<(), PaiError> {
265+ let config_dir = paths::resolve_config_dir(config_dir)?;
266+ let config_path = config_dir.join("config.toml");
267+268+ if config_path.exists() && !force {
269+ println!(
270+ "{} Config file already exists at {}",
271+ "Error:".red().bold(),
272+ config_path.display()
273+ );
274+ println!("{} Use {} to overwrite", "Hint:".yellow(), "pai init -f".bold());
275+ return Err(PaiError::Config("Config file already exists".to_string()));
276+ }
277+278+ std::fs::create_dir_all(&config_dir)
279+ .map_err(|e| PaiError::Config(format!("Failed to create config directory: {e}")))?;
280+281+ let default_config = include_str!("../../config.example.toml");
282+ std::fs::write(&config_path, default_config)
283+ .map_err(|e| PaiError::Config(format!("Failed to write config file: {e}")))?;
284+285+ println!("{} Created configuration file", "Success:".green().bold());
286+ println!(
287+ " {}: {}",
288+ "Location".bright_black(),
289+ config_path.display().to_string().bold()
290+ );
291+ println!();
292+ println!("{}", "Next steps:".cyan().bold());
293+ println!(" 1. Edit the config file to add your sources:");
294+ println!(" {}", format!("$EDITOR {}", config_path.display()).bright_black());
295+ println!(" 2. Run sync to fetch content:");
296+ println!(" {}", "pai sync".bright_black());
297+ println!(" 3. List your items:");
298+ println!(" {}", "pai list -n 10".bright_black());
299+300+ Ok(())
301+}
+41
config.example.toml
···00000000000000000000000000000000000000000
···1+# Personal Activity Index Configuration Example
2+# Copy this file to your config directory and customize as needed
3+#
4+# Default config location:
5+# - $XDG_CONFIG_HOME/pai/config.toml
6+# - $HOME/.config/pai/config.toml
7+8+[database]
9+# Path to SQLite database file (optional, defaults to $XDG_DATA_HOME/pai/pai.db)
10+path = "/home/owais/.local/share/pai/pai.db"
11+12+[deployment]
13+# Deployment mode: "sqlite" for local, "cloudflare" for Workers
14+mode = "sqlite"
15+16+# Cloudflare deployment configuration (optional, only needed for Workers)
17+[deployment.cloudflare]
18+worker_name = "personal-activity-index"
19+d1_binding = "DB"
20+database_name = "personal_activity_db"
21+22+# Substack RSS feed source
23+[sources.substack]
24+enabled = true
25+base_url = "https://patternmatched.substack.com"
26+27+# Bluesky AT Protocol source
28+[sources.bluesky]
29+enabled = true
30+handle = "desertthunder.dev"
31+32+# Leaflet publications (can have multiple)
33+[[sources.leaflet]]
34+enabled = true
35+id = "desertthunder"
36+base_url = "https://desertthunder.leaflet.pub"
37+38+[[sources.leaflet]]
39+enabled = true
40+id = "stormlightlabs"
41+base_url = "https://stormlightlabs.leaflet.pub"
···1+use crate::{Item, LeafletConfig, PaiError, Result, SourceFetcher, SourceKind, Storage};
2+use chrono::Utc;
3+use feed_rs::parser;
4+5+/// Fetcher for Leaflet publications via RSS
6+///
7+/// Retrieves posts from Leaflet publications by parsing their RSS feeds.
8+/// Each Leaflet publication provides an RSS feed at {base_url}/rss.
9+pub struct LeafletFetcher {
10+ config: LeafletConfig,
11+ client: reqwest::Client,
12+}
13+14+impl LeafletFetcher {
15+ /// Creates a new Leaflet fetcher with the given configuration
16+ pub fn new(config: LeafletConfig) -> Self {
17+ Self { config, client: reqwest::Client::new() }
18+ }
19+20+ /// Fetches and parses the RSS feed
21+ async fn fetch_feed(&self) -> Result<feed_rs::model::Feed> {
22+ let feed_url = format!("{}/rss", self.config.base_url.trim_end_matches('/'));
23+ let response = self
24+ .client
25+ .get(&feed_url)
26+ .send()
27+ .await
28+ .map_err(|e| PaiError::Fetch(format!("Failed to fetch Leaflet RSS feed: {e}")))?;
29+30+ let body = response
31+ .text()
32+ .await
33+ .map_err(|e| PaiError::Fetch(format!("Failed to read response body: {e}")))?;
34+35+ parser::parse(body.as_bytes()).map_err(|e| PaiError::Parse(format!("Failed to parse RSS feed: {e}")))
36+ }
37+}
38+39+impl SourceFetcher for LeafletFetcher {
40+ fn sync(&self, storage: &dyn Storage) -> Result<()> {
41+ let runtime =
42+ tokio::runtime::Runtime::new().map_err(|e| PaiError::Fetch(format!("Failed to create runtime: {e}")))?;
43+44+ runtime.block_on(async {
45+ let feed = self.fetch_feed().await?;
46+47+ for entry in feed.entries {
48+ let id = entry.id.clone();
49+ let url = entry
50+ .links
51+ .first()
52+ .map(|link| link.href.clone())
53+ .unwrap_or_else(|| id.clone());
54+55+ let title = entry.title.as_ref().map(|t| t.content.clone());
56+ let summary = entry.summary.as_ref().map(|s| s.content.clone());
57+ let author = entry.authors.first().map(|a| a.name.clone());
58+ let content_html = entry.content.and_then(|c| c.body);
59+60+ let published_at = entry
61+ .published
62+ .or(entry.updated)
63+ .map(|dt| dt.to_rfc3339())
64+ .unwrap_or_else(|| Utc::now().to_rfc3339());
65+66+ let item = Item {
67+ id,
68+ source_kind: SourceKind::Leaflet,
69+ source_id: self.config.id.clone(),
70+ author,
71+ title,
72+ summary,
73+ url,
74+ content_html,
75+ published_at,
76+ created_at: Utc::now().to_rfc3339(),
77+ };
78+79+ storage.insert_or_replace_item(&item)?;
80+ }
81+82+ Ok(())
83+ })
84+ }
85+}
86+87+#[cfg(test)]
88+mod tests {
89+ use super::*;
90+91+ #[test]
92+ fn parse_valid_rss() {
93+ let rss = r#"<?xml version="1.0" encoding="UTF-8"?>
94+<rss version="2.0">
95+<channel>
96+ <title>Test Leaflet</title>
97+ <link>https://test.leaflet.pub</link>
98+ <description>Test publication</description>
99+ <item>
100+ <title>Test Post</title>
101+ <link>https://test.leaflet.pub/test-post</link>
102+ <guid>test-guid</guid>
103+ <pubDate>Mon, 01 Jan 2024 12:00:00 +0000</pubDate>
104+ <description>Test summary</description>
105+ </item>
106+</channel>
107+</rss>"#;
108+109+ let feed = parser::parse(rss.as_bytes()).unwrap();
110+ assert_eq!(feed.entries.len(), 1);
111+ assert_eq!(feed.entries[0].title.as_ref().unwrap().content, "Test Post");
112+ }
113+114+ #[test]
115+ fn parse_invalid_rss() {
116+ let invalid_rss = "this is not valid XML";
117+ let result = parser::parse(invalid_rss.as_bytes());
118+ assert!(result.is_err());
119+ }
120+121+ #[test]
122+ fn parse_empty_rss() {
123+ let rss = r#"<?xml version="1.0" encoding="UTF-8"?>
124+<rss version="2.0">
125+<channel>
126+ <title>Empty Feed</title>
127+</channel>
128+</rss>"#;
129+130+ let feed = parser::parse(rss.as_bytes()).unwrap();
131+ assert_eq!(feed.entries.len(), 0);
132+ }
133+}
+7
core/src/fetchers/mod.rs
···0000000
···1+mod bluesky;
2+mod leaflet;
3+mod substack;
4+5+pub use bluesky::BlueskyFetcher;
6+pub use leaflet::LeafletFetcher;
7+pub use substack::SubstackFetcher;