#Frog seo spider update#

These phrases are now commonplace within SEO, but the community hasn’t got an exact definition of what they mean. With this added into the Spider, every URL is either ‘Indexable’ or ‘Non-Indexable’. This isn’t a massive change in how the SEO Spider works, but the concept of indexability is important for any SEO. There’s a lot of potential for this feature and we’re sure some techy users will think up some new & unique ways to utilise this tool. Screaming Frog have put together a full list of commands you can use in the command line here.

#Frog seo spider update#

This update makes our life so much easier, we can set up our clients to be crawled automatically once a month to keep an eye on everything going on with our clients sites.įull Command Line Interface & -Headless ModeĪnother great feature here, with the new Screaming Frog update you can now operate the SEO Spider entirely via command line. This feature is something Myself & Richard have been praying for for a while now, the ability to set up crawls to run automatically, this only gets better when you realise that you can set it to automatically save the crawl data.

(If you want a more in-depth breakdown of the features purpose & functionality, I’d recommend checking out Screaming Frog’s blog post about it here) Scheduling We’ll look at the new features added and let you know what we think of them.

For this update (Codenamed Liger) there are a lot of exciting new features being added for us to breakdown. What a time to be alive.Īnyway, now I’m done freaking out about Bugs Bunny setting up LeBron for an Alley-Oop, we can get onto Screaming Frog! If you have worked with us here at Bulldog or have been keeping track of our blogs, you’ll know that Screaming Frog’s SEO Spider is one of our favourite tools to use on the SEO team. Firstly Space Jam after all the talk is officially happening and secondly, one of our favourite tools has had a game-changing update. So yesterday was a great day to be a millennial in Digital Marketing with 2 very big bits of news coming out.