We've added an addition setup step to help make sure we crawl sites that are actually signed up for CloudSh!
The CloudSh crawler now requires a meta tag on the home page of your site.
This is to make sure you own the site you're trying to crawl.
On your home page, add the following tag. You can get your TOKEN from the
CloudSh dashboard.
<head>
...
<meta name="csh" content="TOKEN"/>
...
</head>Please reach out with any questions!