Crawlie

Scan your website for link errors, missing pages, bad CSS/JavaScript URLs, RSS feeds and more. This tool is perfect for web developers, allowing you to quickly run checks on the integrity of a website before publishing updates, or to simply check for bad links periodically.

1. Enter a Starting URL
The crawl begins here, Crawlie will fetch the file and scan for more.

2. Sit Back and Relax...
As each URL is fetched, any additional URLs found are added to the queue.

3. Watch the Live Results
Watch the result of the crawl in real-time, complete with detailed statistics.

- detailed statistics updated and shown in real time
- check links of all types: images, scripts, stylesheets, feeds and more
- customisable crawl options, including recursion, external domains and query parameter checking
- add delays to each request to prevent overloading a webserver
- see each request's HTTP response code and explanation
- response times are logged to millisecond precision
- quickly view which page a bad link was found on