wreq on 30 public websites

30 distinct sites attempted. 13 responses met their required-content checks. One direct navigation per site, with up to three ordinary redirects and no proxy, on 29 September 2026.

This is one dated observation from one network. It is not a reliability estimate or a ranking. Every target stays in the record, including denied requests and pages missing the required content.

Content checks remain frozen. An expected heading or role-text count can fail even when other useful text is present; each saved-body inspection note explains the observed result.

This corrected run supersedes the earlier run that disabled redirects. Earlier run metadata is retained; an unfollowed canonical redirect in that run is not evidence of tool failure.

We Work Remotely followed a normal 302 to its canonical category; the final HTTP 200 page passed the job checks. This rerun also received an eBay 403, so the unchanged total of 13 does not mean the same sites passed both times.

Exact 30-site manifest All attempt metadata Executable Python code

What ran, and what counts

Tool / runtime: wreq 0.12.3 · Python 3.13.13 · Linux-6.17.0-22-generic-x86_64-with-glibc2.39
UTC window: 2026-09-29T19:15:27.643542+00:00 → 2026-09-29T19:16:44.985282+00:00
Request config: Chrome134 emulation · fresh client per site · cookie store off · one at a time · two-second gap · 20-second timeout · 5 MiB body cap.
Network: Local host direct outbound. Configured and system proxies disabled. Normal HTTP redirects followed up to a cap of three, shared by later tools. No login, CAPTCHA solving, paid service, or application retry.
Executed command: /tmp/scrapingevals-wreq-20260929/bin/python public/evidence/wreq-public-30-redirects-20260929/run.py --manifest public/evidence/public-30-v1.json --output runner/data/wreq-public-30-redirects-20260929
Content check: Required text groups, minimum text length, and listing checks defined before the run. Text comes from HTML with head, script, style, template, and noscript removed. Hidden CSS text is not resolved; JavaScript is not executed. This checks fetched content, not browser visibility or complete structured extraction.
Usable result: HTTP 200, a complete body, every required check met, and no matched soft-block phrase. HTTP 200 alone cannot pass. An unmatched phrase does not rule out every possible block.
Private responses: Full third-party bodies remain in ignored runner/data. Only metadata, this manifest, and our code are published. SHA-256 covers the client-decompressed saved body bytes; partial or absent responses are marked explicitly.
Manifest SHA-256: 6ce519c4f7df3c32f5dfda379a8d3b280b7723bdeb48ddf64a1ae10ce6a7914c
Code SHA-256: 6b1ab054546bd4202d55e3f73a85df0aa16b94a88cc69bdd99fbb5d976338959

All 30 attempts

Open any row for the exact URL, required content, UTC time, checks, error, and response hash. Social targets are public NASA organization pages. Normal redirects were followed and recorded; challenges were left alone.

1. Kohl’s · commerceHTTP 403 · http access denied · 0.532 s

Exact target URL: https://www.kohls.com/catalog/mens-tshirts-clothing.jsp?CN=Gender:Mens+Product:T-Shirts+Department:Clothing
Final URL: https://www.kohls.com/catalog/mens-tshirts-clothing.jsp?CN=Gender:Mens+Product:T-Shirts+Department:Clothing
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Men’s T-shirt product listing with prices
Started / finished: 2026-09-29T19:15:27.643555+00:00 / 2026-09-29T19:15:28.178075+00:00 (UTC)
Body: 577 bytes · complete · 227 text characters (minimum 300)
Usable content: No — http access denied
Saved-body inspection: Denied response; no product listing.
Required text groups: t-shirt / tees: missing
men: matched men
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: access denied. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: ada839408540bc6d57359c24e5ab5ad701bb1cee8a55848419ec337abf4b4e36
Attempt link: Link to this attempt

2. Amazon · commerceHTTP 503 · http server error · 0.184 s

Exact target URL: https://www.amazon.com/s?k=laptop
Final URL: https://www.amazon.com/s?k=laptop
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Laptop search results with product prices
Started / finished: 2026-09-29T19:15:30.180775+00:00 / 2026-09-29T19:15:30.365105+00:00 (UTC)
Body: 2,671 bytes · complete · 0 text characters (minimum 500)
Usable content: No — http server error
Saved-body inspection: Service error page; no product listing.
Required text groups: laptop: missing
results: missing
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 470de24561f8fdb4c965acb40542fe9fad14e1843793a497a3bacd906d05544c
Attempt link: Link to this attempt

3. Walmart · commerceHTTP 200 · usable · 5.963 s

Exact target URL: https://www.walmart.com/search?q=laptop
Final URL: https://www.walmart.com/search?q=laptop
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Laptop search results with product prices
Started / finished: 2026-09-29T19:15:32.366914+00:00 / 2026-09-29T19:15:38.330053+00:00 (UTC)
Body: 1,438,101 bytes · complete · 7,237 text characters (minimum 500)
Usable content: Yes — all checks met
Saved-body inspection: Product listing present; 40 price matches in source text.
Required text groups: laptop: matched laptop
Listing checks: [$£€]\s?\d[\d,.]*: 40 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: d05aa75fe86ec3bdd3157defc8f521ee735b72e003d834f50cfe97dde1053bcf
Attempt link: Link to this attempt

4. eBay · commerceHTTP 403 · http access denied · 0.257 s

Exact target URL: https://www.ebay.com/sch/i.html?_nkw=laptop
Final URL: https://www.ebay.com/sch/i.html?_nkw=laptop
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Laptop marketplace listings with prices
Started / finished: 2026-09-29T19:15:40.366497+00:00 / 2026-09-29T19:15:40.623451+00:00 (UTC)
Body: 1,986 bytes · complete · 189 text characters (minimum 500)
Usable content: No — http access denied
Saved-body inspection: Denied response with an error message; no usable marketplace listing in this rerun.
Required text groups: laptop: missing
results: missing
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: d7062ebb5407606e5eb705af9aa98f3cace8812256228e47cfe44ec801570054
Attempt link: Link to this attempt

5. Target · commerceHTTP 200 · missing required content · 1.074 s

Exact target URL: https://www.target.com/s?searchTerm=laptop
Final URL: https://www.target.com/s?searchTerm=laptop
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Laptop search listing with prices
Started / finished: 2026-09-29T19:15:42.625804+00:00 / 2026-09-29T19:15:43.700176+00:00 (UTC)
Body: 129,517 bytes · complete · 286 text characters (minimum 500)
Usable content: No — missing required content
Saved-body inspection: Navigation shell without the required laptop listing or prices.
Required text groups: laptop: missing
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 789857e46575f69b1a482c833a41bf18a2fe051f5428817547d468ae5e51eb72
Attempt link: Link to this attempt

6. Etsy · commerceHTTP 403 · http access denied · 0.125 s

Exact target URL: https://www.etsy.com/search?q=ceramic+mug
Final URL: https://www.etsy.com/search?q=ceramic+mug
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Ceramic mug listings with prices
Started / finished: 2026-09-29T19:15:45.706807+00:00 / 2026-09-29T19:15:45.832176+00:00 (UTC)
Body: 796 bytes · complete · 43 text characters (minimum 500)
Usable content: No — http access denied
Saved-body inspection: Denied page asks for JavaScript; no products fetched.
Required text groups: ceramic: missing
mug: missing
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 8c4151cc99561f5b5c8e63e63e4022087425f5feea7e0a2914f405a9b619e7b7
Attempt link: Link to this attempt

7. Best Buy · commerceHTTP 200 · missing required content · 0.375 s

Exact target URL: https://www.bestbuy.com/site/searchpage.jsp?st=laptop
Final URL: https://www.bestbuy.com/site/searchpage.jsp?st=laptop
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Laptop product listing with prices
Started / finished: 2026-09-29T19:15:47.835021+00:00 / 2026-09-29T19:15:48.210456+00:00 (UTC)
Body: 7,056 bytes · complete · 687 text characters (minimum 500)
Usable content: No — missing required content
Saved-body inspection: Country-selection page instead of laptop listings.
Required text groups: laptop: missing
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 66faa94f59909903b9e35fe4a65300dcc2ddc90260d044f9fccbdc28a8e8a19c
Attempt link: Link to this attempt

8. LinkedIn · organizationHTTP 200 · usable · 0.686 s

Exact target URL: https://www.linkedin.com/company/nasa/
Final URL: https://www.linkedin.com/company/nasa/
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Public NASA organization description and industry/topic
Started / finished: 2026-09-29T19:15:50.213790+00:00 / 2026-09-29T19:15:50.899632+00:00 (UTC)
Body: 356,941 bytes · complete · 12,885 text characters (minimum 500)
Usable content: Yes — all checks met
Saved-body inspection: Public organization description and space/research terms present; no login performed.
Required text groups: nasa / national aeronautics: matched nasa, national aeronautics
space / research / aviation: matched space, research, aviation
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: c05bdbb38d2dacf549956e4432b8199dc80f8f8a03f18c48e21ee7043e29db91
Attempt link: Link to this attempt

9. Instagram · organizationHTTP 200 · missing required content · 0.602 s

Exact target URL: https://www.instagram.com/nasa/
Final URL: https://www.instagram.com/nasa/
Redirect outcome: none · 0 followed hops (cap 3)
Required content: NASA organization profile with follower and post information
Started / finished: 2026-09-29T19:15:52.920896+00:00 / 2026-09-29T19:15:53.522833+00:00 (UTC)
Body: 762,007 bytes · complete · 0 text characters (minimum 150)
Usable content: No — missing required content
Saved-body inspection: Required public profile content missing from the checked HTML text.
Required text groups: nasa: missing
followers: missing
posts: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 3579772738e3b489463f69f82eef9f692d6b3a79d2031da9c5f1e53cfe1239bb
Attempt link: Link to this attempt

10. TikTok · organizationHTTP 200 · missing required content · 0.630 s

Exact target URL: https://www.tiktok.com/@nasa
Final URL: https://www.tiktok.com/@nasa
Redirect outcome: none · 0 followed hops (cap 3)
Required content: NASA organization profile with video and audience information
Started / finished: 2026-09-29T19:15:55.531798+00:00 / 2026-09-29T19:15:56.161974+00:00 (UTC)
Body: 389,428 bytes · complete · 66 text characters (minimum 150)
Usable content: No — missing required content
Saved-body inspection: Organization name and audience figures present, but required profile labels and text length not met.
Required text groups: nasa: matched nasa
followers: missing
videos / likes: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 0a16b54debf2b39a750c62ca2c1e7e722e05b8acf6368538ac4c1bfe910daea9
Attempt link: Link to this attempt

11. G2 · reviewsHTTP 403 · http access denied · 0.235 s

Exact target URL: https://www.g2.com/products/asana/reviews
Final URL: https://www.g2.com/products/asana/reviews
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Asana review listing with review and rating information
Started / finished: 2026-09-29T19:15:58.171809+00:00 / 2026-09-29T19:15:58.406683+00:00 (UTC)
Body: 1,707 bytes · complete · 43 text characters (minimum 500)
Usable content: No — http access denied
Saved-body inspection: Denied page asks for JavaScript; no reviews fetched.
Required text groups: asana: missing
reviews: missing
rating / rated / stars: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 3f9f77cb986b44a058274cbb952fffe658bbe187f98472d042ff906e297aad29
Attempt link: Link to this attempt

12. Trustpilot · reviewsHTTP 403 · http access denied · 0.113 s

Exact target URL: https://www.trustpilot.com/review/www.amazon.com
Final URL: https://www.trustpilot.com/review/www.amazon.com
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Amazon company review listing with ratings
Started / finished: 2026-09-29T19:16:00.409558+00:00 / 2026-09-29T19:16:00.522546+00:00 (UTC)
Body: 991 bytes · complete · 164 text characters (minimum 500)
Usable content: No — http access denied
Saved-body inspection: Browser verification page; no review listing.
Required text groups: amazon: missing
reviews: missing
trustscore / rating / rated: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 92d97ed45d6cc267c657b864c4deee1c2d896cda361adc660bc16538a75700f2
Attempt link: Link to this attempt

13. Tripadvisor · reviewsHTTP 403 · http access denied · 0.230 s

Exact target URL: https://www.tripadvisor.com/Restaurants-g187147-Paris_Ile_de_France.html
Final URL: https://www.tripadvisor.com/Restaurants-g187147-Paris_Ile_de_France.html
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Paris restaurant listing with reviews
Started / finished: 2026-09-29T19:16:02.524880+00:00 / 2026-09-29T19:16:02.754586+00:00 (UTC)
Body: 778 bytes · complete · 43 text characters (minimum 500)
Usable content: No — http access denied
Saved-body inspection: Denied page asks for JavaScript; no restaurant reviews fetched.
Required text groups: paris: missing
restaurants: missing
reviews: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 2734b33ee2dfec8487b809398b4b9183992c79c682342389a1ec2d68dfc4ed9a
Attempt link: Link to this attempt

14. Indeed · jobsHTTP 403 · http access denied · 0.043 s

Exact target URL: https://www.indeed.com/jobs?q=python&l=Remote
Final URL: https://www.indeed.com/jobs?q=python&l=Remote
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Remote Python job listings
Started / finished: 2026-09-29T19:16:04.756813+00:00 / 2026-09-29T19:16:04.799630+00:00 (UTC)
Body: 28,083 bytes · complete · 27 text characters (minimum 500)
Usable content: No — http access denied
Saved-body inspection: Security check response; no job listing.
Required text groups: python: missing
remote: missing
jobs: missing
Listing checks: \b(?:developer|engineer|programmer)\b: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: e2226cfe7db4df4c0ef8db6c7fc9e3e56214c56ceb59750df0ab4aea1cc3fb25
Attempt link: Link to this attempt

15. Remote OK · jobsHTTP 200 · missing required content · 0.609 s

Exact target URL: https://remoteok.com/remote-dev-jobs
Final URL: https://remoteok.com/remote-dev-jobs
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Remote developer job listings
Started / finished: 2026-09-29T19:16:06.802771+00:00 / 2026-09-29T19:16:07.411698+00:00 (UTC)
Body: 59,438 bytes · complete · 5,486 text characters (minimum 500)
Usable content: No — missing required content
Saved-body inspection: Job rows exist in HTML, but the frozen role-text check has fewer than three matches. A strict check failure, not proof that all job data is unusable.
Required text groups: remote: matched remote
developer / engineer: matched developer
jobs: matched jobs
Listing checks: \b(?:developer|engineer|programmer)\b: 2 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 3de38fb9fa13a50666fda88eeff4ace02ed3f3b34a3bae3c2244ff3e7c6cae4e
Attempt link: Link to this attempt

16. We Work Remotely · jobsHTTP 200 · usable · 0.555 s

Exact target URL: https://weworkremotely.com/categories/remote-programming-jobs
Final URL: https://weworkremotely.com/categories/remote-full-stack-programming-jobs
Redirect outcome: followed · 1 followed hops (cap 3)
HTTP 302: https://weworkremotely.com/categories/remote-programming-jobs → https://weworkremotely.com/categories/remote-full-stack-programming-jobs
Required content: Remote programming jobs with actual role descriptions
Started / finished: 2026-09-29T19:16:09.419954+00:00 / 2026-09-29T19:16:09.975331+00:00 (UTC)
Body: 144,403 bytes · complete · 9,661 text characters (minimum 500)
Usable content: Yes — all checks met
Saved-body inspection: A normal HTTP 302 reached the canonical full-stack programming category. The final HTTP 200 content meets the frozen job checks; the redirect is not a failure.
Required text groups: remote: matched remote
programming: matched programming
developer / engineer: matched developer, engineer
Listing checks: \b(?:developer|engineer|programmer)\b: 26 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: d045dd649d1a36c896b6aa045ba00a2af37849d48df4cfeb823fff1ba976ac71
Attempt link: Link to this attempt

17. Wikipedia · contentHTTP 200 · usable · 0.195 s

Exact target URL: https://en.wikipedia.org/wiki/Web_scraping
Final URL: https://en.wikipedia.org/wiki/Web_scraping
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Web scraping article with substantive explanation
Started / finished: 2026-09-29T19:16:11.989806+00:00 / 2026-09-29T19:16:12.185179+00:00 (UTC)
Body: 235,975 bytes · complete · 30,790 text characters (minimum 3000)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: web scraping: matched web scraping
web crawler / data extraction: matched web crawler, data extraction
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: e305b5ea4c4ca2a210ae297f17ad11f2ce4201fd8f5b6247adcfb98f41d017af
Attempt link: Link to this attempt

18. Hacker News · contentHTTP 200 · usable · 0.601 s

Exact target URL: https://news.ycombinator.com/
Final URL: https://news.ycombinator.com/
Redirect outcome: none · 0 followed hops (cap 3)
Required content: News story listing with points and comment links
Started / finished: 2026-09-29T19:16:14.205913+00:00 / 2026-09-29T19:16:14.807252+00:00 (UTC)
Body: 34,693 bytes · complete · 3,895 text characters (minimum 1000)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: hacker news: matched hacker news
points: matched points
comments: matched comments
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: fbb3dea0aeb69f3fb69f1f96206328dbfcc1ee5b3ec2b6defc21eb573500fb37
Attempt link: Link to this attempt

19. BBC · contentHTTP 200 · usable · 0.307 s

Exact target URL: https://www.bbc.com/news
Final URL: https://www.bbc.com/news
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Public news headlines and topic navigation
Started / finished: 2026-09-29T19:16:16.824151+00:00 / 2026-09-29T19:16:17.131244+00:00 (UTC)
Body: 381,002 bytes · complete · 9,639 text characters (minimum 1000)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: bbc: matched bbc
news: matched news
world / business: matched world, business
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 8117a71a84e08a190383621f802430df29903e92a7d469a95720d01713a32a96
Attempt link: Link to this attempt

20. arXiv · contentHTTP 200 · usable · 0.231 s

Exact target URL: https://arxiv.org/list/cs/recent
Final URL: https://arxiv.org/list/cs/recent
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Recent Computer Science papers with subject metadata
Started / finished: 2026-09-29T19:16:19.149774+00:00 / 2026-09-29T19:16:19.380645+00:00 (UTC)
Body: 97,480 bytes · complete · 16,898 text characters (minimum 1500)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: computer science: matched computer science
subjects:: matched subjects:
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: b1de1feefecddc4ea113b631684531e8e98358cc55f85f080167f7d0fe78a275
Attempt link: Link to this attempt

21. Project Gutenberg · contentHTTP 200 · usable · 0.623 s

Exact target URL: https://www.gutenberg.org/ebooks/1342
Final URL: https://www.gutenberg.org/ebooks/1342
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Pride and Prejudice book description with author
Started / finished: 2026-09-29T19:16:21.398459+00:00 / 2026-09-29T19:16:22.021726+00:00 (UTC)
Body: 24,862 bytes · complete · 2,588 text characters (minimum 500)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: pride and prejudice: matched pride and prejudice
jane austen: matched jane austen
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 94b755665adca2f5f4b060287f9fecb33d596f61d6bd41457db899c6347b7923
Attempt link: Link to this attempt

22. GOV.UK · contentHTTP 200 · usable · 0.367 s

Exact target URL: https://www.gov.uk/bank-holidays
Final URL: https://www.gov.uk/bank-holidays
Redirect outcome: none · 0 followed hops (cap 3)
Required content: UK bank holiday dates for England and Wales
Started / finished: 2026-09-29T19:16:24.027781+00:00 / 2026-09-29T19:16:24.395209+00:00 (UTC)
Body: 175,904 bytes · complete · 17,613 text characters (minimum 500)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: uk bank holidays: matched uk bank holidays
england and wales: matched england and wales
christmas day: matched christmas day
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 9f0211a543241b66b58cfa7a431db8c6bb93f2e7a1b309990fdd0c3a8c2bc98d
Attempt link: Link to this attempt

23. Python documentation · contentHTTP 200 · usable · 0.165 s

Exact target URL: https://docs.python.org/3/library/urllib.request.html
Final URL: https://docs.python.org/3/library/urllib.request.html
Redirect outcome: none · 0 followed hops (cap 3)
Required content: urllib.request documentation with API explanation
Started / finished: 2026-09-29T19:16:26.420089+00:00 / 2026-09-29T19:16:26.585639+00:00 (UTC)
Body: 216,525 bytes · complete · 53,833 text characters (minimum 3000)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: urllib.request: matched urllib.request
urlopen: matched urlopen
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 7690190ba74d1d6c2e247423f3fe194a5101667392c9de03bbe53296bd7a45b7
Attempt link: Link to this attempt

24. Quotes to Scrape · javascriptHTTP 200 · missing required content · 0.800 s

Exact target URL: https://quotes.toscrape.com/js/
Final URL: https://quotes.toscrape.com/js/
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Quote text and author after JavaScript rendering
Started / finished: 2026-09-29T19:16:28.618918+00:00 / 2026-09-29T19:16:29.418595+00:00 (UTC)
Body: 5,808 bytes · complete · 74 text characters (minimum 300)
Usable content: No — missing required content
Saved-body inspection: Navigation shell; required quote and author absent outside scripts.
Required text groups: the world as we have created it: missing
albert einstein: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: a9067d4438044d45a1a895ed6939df4fa4d0487e17b82053dd694ad425466074
Attempt link: Link to this attempt

25. ScrapingCourse · javascriptHTTP 200 · missing required content · 1.135 s

Exact target URL: https://www.scrapingcourse.com/javascript-rendering
Final URL: https://www.scrapingcourse.com/javascript-rendering
Redirect outcome: none · 0 followed hops (cap 3)
Required content: JavaScript product listing with named products and prices
Started / finished: 2026-09-29T19:16:31.421916+00:00 / 2026-09-29T19:16:32.556653+00:00 (UTC)
Body: 29,640 bytes · complete · 72 text characters (minimum 300)
Usable content: No — missing required content
Saved-body inspection: HTML requests JavaScript; no required product text or prices.
Required text groups: chaz kangeroo hoodie / teton pullover hoodie: missing
Listing checks: [$£€]\s?\d[\d,.]*: 0 matches; needs 3
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: b9daac7e24122000dbc457ed0e4ed24b43b89593db88eac038e98499db93292a
Attempt link: Link to this attempt

26. Web Scraping Dev · javascriptHTTP 200 · missing required content · 0.831 s

Exact target URL: https://web-scraping.dev/reviews
Final URL: https://web-scraping.dev/reviews
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Review text loaded by the JavaScript review interface
Started / finished: 2026-09-29T19:16:34.561906+00:00 / 2026-09-29T19:16:35.392612+00:00 (UTC)
Body: 14,727 bytes · complete · 244 text characters (minimum 300)
Usable content: No — missing required content
Saved-body inspection: Review interface shell; required review text absent outside scripts.
Required text groups: unique flavor and great energy boost / excellent energy drink for gamers: missing
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 77a5e13ddd2d8d9d65ba531340293d16870224866f7d52bbf7377f113b514665
Attempt link: Link to this attempt

27. Example Domain · controlHTTP 200 · missing required content · 0.032 s

Exact target URL: https://example.com/
Final URL: https://example.com/
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Example Domain heading and documentation explanation
Started / finished: 2026-09-29T19:16:37.396784+00:00 / 2026-09-29T19:16:37.429164+00:00 (UTC)
Body: 713 bytes · complete · 167 text characters (minimum 100)
Usable content: No — missing required content
Saved-body inspection: Documentation explanation present, but expected heading absent from body text. Target-content mismatch, not evidence of an anti-bot block.
Required text groups: example domain: missing
documentation examples: matched documentation examples
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 7d3e61f8f627c8cc640c209ba0777db95f198a64e766f47484c321d5eb5e0962
Attempt link: Link to this attempt

28. HTTPBingo · controlHTTP 200 · usable · 0.263 s

Exact target URL: https://httpbingo.org/html
Final URL: https://httpbingo.org/html
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Moby-Dick HTML sample
Started / finished: 2026-09-29T19:16:39.432392+00:00 / 2026-09-29T19:16:39.695831+00:00 (UTC)
Body: 3,742 bytes · complete · 3,594 text characters (minimum 300)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: herman melville: matched herman melville
moby-dick: matched moby-dick
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: e250a7975d53801ed8c35271780a15a1da36a8a5383327cb706dea252b340d48
Attempt link: Link to this attempt

29. Scrape This Site · controlHTTP 200 · usable · 1.220 s

Exact target URL: https://www.scrapethissite.com/pages/simple/
Final URL: https://www.scrapethissite.com/pages/simple/
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Country records including Andorra and population
Started / finished: 2026-09-29T19:16:41.698773+00:00 / 2026-09-29T19:16:42.918809+00:00 (UTC)
Body: 203,361 bytes · complete · 18,132 text characters (minimum 1000)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: countries of the world: matched countries of the world
andorra: matched andorra
population: matched population
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 4c68c2a54000607a0fa51ea5a57a20bbe4324dee74c442559185a1da364bd87b
Attempt link: Link to this attempt

30. IANA · controlHTTP 200 · usable · 0.034 s

Exact target URL: https://www.iana.org/domains/reserved
Final URL: https://www.iana.org/domains/reserved
Redirect outcome: none · 0 followed hops (cap 3)
Required content: Reserved-domain reference and example domains
Started / finished: 2026-09-29T19:16:44.948906+00:00 / 2026-09-29T19:16:44.982758+00:00 (UTC)
Body: 10,499 bytes · complete · 2,727 text characters (minimum 500)
Usable content: Yes — all checks met
Saved-body inspection: Saved HTML inspection confirmed required content and matching checks.
Required text groups: iana-managed reserved domains: matched iana-managed reserved domains
example.com: matched example.com
Listing checks: No additional regex check
Soft-block check: No checked phrase matched. All checked phrases are in the metadata.
Login / consent check: No checked gate phrase matched
Error: No transport/body error
Body SHA-256: 720e5cce9016212d2d28777356d2844fb0ca9e19a32636eb232f8653360dc450
Attempt link: Link to this attempt

Reproduce this run

From a repository checkout, use Python 3.11 or newer. Choose a new private output directory; the script refuses to overwrite an existing run. Repeating it starts 30 more public navigations, plus any ordinary redirect hops. Follow the same manifest when testing another tool.

uv venv /tmp/wreq-public-30
uv pip install --python /tmp/wreq-public-30/bin/python wreq==0.12.3
/tmp/wreq-public-30/bin/python public/evidence/wreq-public-30-redirects-20260929/run.py \
  --manifest public/evidence/public-30-v1.json \
  --output runner/data/wreq-public-30-new-run

API configuration was checked against the installed 0.12.3 package and the wreq Python repository. The manifest is frozen; these results do not imply that other catalog tools have completed this 30-site set.