spider-rs
Crawl many URLs with a Rust-based tool. Crawl coverage has not been tested here.
Published test history
No comparable run has been published for this project yet. It is in the inventory so you can find it, not because we have verified its performance.
What it can do
- Crawl or queue pages
- Fetch HTML
Capabilities are catalog notes, not outcomes from the benchmark above.
Project record
- Type
- Crawl many pages
- Ecosystem
- python, rust
- Repo check
- 2026-05-23
- License
- MIT
Repository metadata is a dated snapshot, not a live health guarantee.
See how we validate pages, including what a pass does and does not mean.