I’ll also be using my trusty Homestead Improved environment for a clean project, so I can experiment in a VM that’s dedicated to this project and this project alone.

Source: Crawling and Searching Entire Domains with Diffbot