Screaming Frog is an SEO spider. It’s a bot that crawls all over your site and looks for problems. It’s primarily used for large established sites. However, you can use it to analyse competitor sites.
Overview of Screaming Frog
Screaming Frog tracks:
- Crawl level
- Internal and Outbound links per-page
- Keyword elements like Title and Description and their lengths.
- HTTP status codes
Screaming Frog SEO Spider collects the vital SEO elements for each page during the crawl: title, description, keywords, H1, h2 etc. This makes it easy to examine the whole website and see what needs to be updated. You want to make sure that every page has unique title and descriptions and also see if the H1 tags are used and the meta keyword is not being abused.
Find and fix broken links within a website. Websites, especially older and larger websites, often have many interior links that are broken. It also makes it easy to find pages that are generating 404 errors and then it shows you every page on the website that links to that 404 page so you can fix all the links.
Find and fix broken links pointing to external websites. Conduct a website audit reports and see external links and their http status. This allows you to fix all 301 redirects and especially in links resulting in a 404 page.
Try Screaming Frog
The industry leading website crawler for Windows, MacOS and Ubuntu, trusted by thousands of SEOs and agencies worldwide for technical SEO audits.