Scraping software
Start with the job, then inspect a tool. A listed project is not a tested recommendation.
22 of 22 projects
Python toolkit with request and browser modes. The current 30-site test uses its browser workflow.
Recent field testUse a modified Firefox browser built for automation and anti-detection.
Recent field testA browser built to reduce automation detection. We have not tested it publicly.
Listed, not testedCrawl pages with queues, retries and browser options. The current test measures one-page CheerioCrawler HTTP downloads, not crawling scale.
Recent field testMake HTTP requests with browser connection profiles. The current 30-site pass uses direct Chrome150 mode without JavaScript.
Recent field testA lightweight browser engine for rendering pages. Stealth is not its focus.
Recent field testControl Chromium with Playwright-style code and stealth patches.
Recent field testControl a browser for JavaScript pages and clicks. The current 30-site test uses plain headless Chrome with stock driver defaults.
Recent field testControl Chrome from JavaScript. The current 30-site pass uses plain headless Chrome, stock launch defaults and one navigation per URL.
Recent field testFetch HTML in Python with a simple request. It does not run page JavaScript.
Historical testFetch and parse pages in Python. Its browser modes need separate tests.
Recent field testCrawl sites in Python with queues, parsing and pipelines. The current test measures single-page HTTP downloads, not crawling scale.
Recent field testPython browser automation with helpers and UC mode. The current 30-site pass uses standard headless Chrome with UC off.
Recent field testCrawl many URLs with a Rust-based tool. Crawl coverage has not been tested here.
Listed, not testedFetch pages with browser-like network fingerprints, without launching a browser.
Recent field test