A new Website Crawler & Domain Migration Tool in the cloud capable of crawling millions of pages.
The purpose of this website crawler is to crawl really large websites with millions of pages in order to get hold of a complete url structure. This is a difficult task and many seo’s and webdevelopers struggle with tools like Screaming frog (which is a great tool) but it’s not capable nor suitable for crawling hundreds of thousands or maybe even millions of urls.
That is where Elite Crawler comes into play. Elite Crawler is a cloud based crawler which means you do not have to download any software to your computer. This crawler runs from a server (in the cloud).
Currently this tool is in Alpha version, which means it’s not ready for live user testing.