


To work with a specific selection of subdomains and subdirectories, you can use RegEx to setup include or exclude settings for specific elements in the “Configuration” menuĪn example below shows, how all pages of the website except for “About” pages in every separate subdomain were selected for scanning (exclusion). How to scan a selection of specific subdomains or subdirectories?.If you want to start the scanning from a specific folder, but then move on to the analysis of the rest of the subdomain, first go to the Spider’s “Configuration” section and select the option “Crawl Outside of Start Folder” before beginning the work. If you made adjustments to the default settings, they can be reset from the “File” menu. If you want to limit the scanning to a specific folder, just enter the URL and click the “Start” button without adjusting the default parameters. To speed-up the scanning process, don’t use images, CSS, JavaScript, SWF or external links. By choosing an option “Crawl All Subdomains” you can ensure that Spider will analyze all links available on your website’s subdomains.

In order to scan additional subdomains, it is necessary to make adjustments in the Spider configuration menu. Any additional subdomain Spider determines is recognized as an external link. Instructions below are aimed at the demonstration of various ways of using Screaming Frog for the website audit, analysis of keywords and competition market, increasing the reference weight and other tasks of SEO, PPC, and other marketing professionals.īy default, Screaming Frog only scans the subdomain that you visit. User-friendly interface of Screaming Frog provides for quick and easy operation? however multiple configuration and functional options may complicate one’s first experience with the software during the early stages of its use. General website audit is a hard and labor intensive task for most people, however such tool as Screaming Frog SEO Spider (SEO Spider) can make it much easier both for amateurs and professionals.
