Online crawler
Screaming Frog online: is there a web version?
No. Screaming Frog has no online version. The SEO Spider is a desktop program for Windows, macOS and Linux, and its free edition crawls up to 500 URLs.
If what you want is a crawler that runs in the browser, with nothing to install, this is one: enter a domain and it crawls up to 5,000 pages on our servers, free. It is a different tool from a different company, and the differences are set out below.
What running online changes
Nothing to install or update. It works on a locked-down work laptop, a Chromebook, a tablet or a phone.
The crawl does not use your computer. It runs on a server, so it keeps going when you close the lid, and it does not take your memory or your connection for an hour.
The result is a link. You get a private address for the results the moment the crawl starts. Send it to a colleague or a client instead of exporting files.
Crawls are kept. A finished crawl stays where it is, and you can download the whole of it as a SQLite database. In the free desktop edition a crawl is gone when you close the program.
It can run on a schedule. With a free account a site is crawled again every day, week or month, and you are e-mailed only when something changed.
What an online crawler cannot do
It cannot reach what the internet cannot. A site on your own machine, a staging server behind a firewall or an intranet is invisible to a crawler running elsewhere. A desktop crawler sits inside your network and reaches all three.
It cannot sign in. Pages behind a login are not crawled. The desktop tool can crawl with your credentials.
It identifies itself. The crawler here announces its own name and obeys robots.txt, and you cannot make it pretend to be something else. Screaming Frog lets you set the user agent.
It has a ceiling. 5,000 pages a crawl. With a licence, the desktop tool is limited only by your machine.
If any of those four matter to your work, the desktop program is the right tool and worth its price.
The two free versions, briefly
| Feature | DIY SEO Hub, free | Screaming Frog, free |
|---|---|---|
| Runs in | A browser tab | A desktop program |
| Crawl limit | 5,000 pages | 500 URLs |
| Saves the crawl | Yes | No |
| JavaScript rendering | Yes, switched on per scan | No |
| Crawls localhost and intranets | No | Yes |
| Account needed | No | No |
Their column was read from their pricing page on 17 October 2026; check it before deciding anything that matters. The full list, with every row where their tool wins, is on the row-by-row comparison.
What the crawl here gives you
39 checks over the stored crawl: broken links, redirects, titles and descriptions, indexability, sitemap coverage, hreflang, structured data, near-duplicate pages, orphan pages and the rest, with a health score, a list of fixes grouped by cause, and an interactive map of the internal links. The site crawler page describes all of it.
Questions people ask
- Is there an online version of Screaming Frog?
- No. The Screaming Frog SEO Spider is a program you download and run on Windows, macOS or Linux. There is no web app and no browser extension; the crawl runs on your own computer.
- Is Screaming Frog free?
- Partly. The free edition crawls up to 500 URLs and leaves out saving crawls, scheduling, JavaScript rendering and several other features. The licence that removes the limit was £199 a year per user when we read their pricing page on 17 October 2026.
- Can I use Screaming Frog on a Chromebook, a tablet or a phone?
- Not directly: it needs a desktop operating system. An online crawler works on anything with a browser, because the crawling happens on a server.
- Is this site connected to Screaming Frog?
- No. Screaming Frog is the product and trademark of Screaming Frog Ltd. This is a separate, independent crawler, and nothing here is endorsed by them. Their tool is a good one; this page exists because people look for a web version of it and there is not one.
- What does the online crawler here cost?
- Nothing, for up to 5,000 pages a crawl, with no account. There is no paid tier that raises the limit.
Crawl a site in your browser
Read next
- Orphan page checker — pages that answer 200 and that no other page links to, found through your sitemap, your redirects and your Search Console export.
- Internal link checker — links in and out of every page, click depth, anchor text, where on the page each link sits, and an internal PageRank score.
- Noindex checker — every page carrying noindex or another robots directive, in a meta tag or an X-Robots-Tag header, across the whole site.
- The free site crawler — the crawl all of these checks read from, and what else it records.