I built IndexFlow-core, an open-source search engine indexing infrastructure written in Rust.
The project started from problems I encountered while building content-heavy websites. I found that making a website available online does not mean search engines can reliably discover and understand it.
IndexFlow focuses on the technical layer between websites and search engines:
- Sitemap management
- SEO quality gates
- URL discovery
- Indexing workflows
- Multi-site scheduling
- Quota-aware request handling
The goal is to provide a self-hostable infrastructure layer for developers who care about search engine visibility.
I've reworked the README. The idea was to save Google's crawl budget — site health monitoring matters a lot for new domains. Thanks for the feedback. Had AI tidy up the formatting.
Hi HN,
I built IndexFlow-core, an open-source search engine indexing infrastructure written in Rust.
The project started from problems I encountered while building content-heavy websites. I found that making a website available online does not mean search engines can reliably discover and understand it.
IndexFlow focuses on the technical layer between websites and search engines:
- Sitemap management
- SEO quality gates
- URL discovery
- Indexing workflows
- Multi-site scheduling
- Quota-aware request handling
The goal is to provide a self-hostable infrastructure layer for developers who care about search engine visibility.
Website:
https://www.indexflowing.com
Feedback welcome.
The formatting on the readme makes it difficult to read
Long readme and formatting is hard to read. but project is interesting. will watch on this
Thanks for checking it out. I'll keep working on it — especially the README formatting. More updates coming.
I have no idea what problem the project solves. Maybe you could add a paragraph at the top.
Right now it reads like "something doing something with AI" which is pretty much any project nowadays.
I've reworked the README. The idea was to save Google's crawl budget — site health monitoring matters a lot for new domains. Thanks for the feedback. Had AI tidy up the formatting.