GET /v1/web/scrape with HTTP status 502. Requests that end in this error are not billed.
Reasons and how to fix
The page is broken on the website itself
Open the URL in a private/incognito browser window. If you see an error page there too, the site is down or the page is broken for everyone, and there is nothing to scrape until the site owner fixes it. To fix this:- Retry later; sites often recover within minutes or hours
- Check whether a different URL for the same content works (for example the canonical product or article URL instead of a deep link)
- Avoid tight retry loops: each attempt runs the full scraping chain and will keep returning
upstream-erroruntil the site recovers