Show HN: Firecrawl-Simple – Stable fork of Firecrawl optimized for self-hosting

Firecrawl Simple is a stripped down and stable version of firecrawl optimized for self-hosting and ease of contribution.

The upstream firecrawl repo contains the following blurb:

>This repository is in development, and we're still integrating custom modules into the mono repo. It's not fully ready for self-hosted deployment yet, but you can run it locally.

Firecrawl's API surface and general functionality were ideal for our Trieve sitesearch product, but we needed a version ready for self-hosting that was easy to contribute to and scale on Kubernetes. Therefore, we decided to fork and begin maintaining a stripped down, stable version.

Fire-engine, Firecrawl's solution for anti-bot pages, being closed source is the biggest deal breaker requiring us to maintain this fork. Further, our purposes not requiring the SaaS and AI dependencies also pushes our use-case far enough away from Firecrawl's current mission that it doesn't seem like merging into the upstream is viable at this time.

Comments URL: https://news.ycombinator.com/item?id=42056056

Points: 9

# Comments: 0

https://github.com/devflowinc/firecrawl-simple