spoon #

gleam add spoon@1

import spoon

pub fn main() -> Nil {
      spoon.new("https://example.com")
      |> spoon.run()
}

Further documentation can be found at https://spoon.hexdocs.pm/.

Development #

gleam run   # Run the project
gleam test  # Run the tests

Non-goals #

• JavaScript rendering (no Chromium/Puppeteer/etc).

Prior art #

• Scrapy (Python)
• Colly (Go)
• Apache Nutch (Java)
• Heritrix (Java)
• StormCrawler (Java)
• Crawly (Elixir)
• Hop (Elixir)