Crescontent

CrescontentBot

CrescontentBot is the web crawler used by Crescontent, a service that helps website owners write help pages for their own websites. It identifies itself with the user agent:

CrescontentBot/1.0 (+https://crescontent.com/bot)

When it visits

Only when the owner of a website has added it to Crescontent, proved they control it (with a meta tag or DNS record), and asked us to draft help topics. It does not crawl the web generally.

What it does

Blocking it

To stop it reading your site, add this to your robots.txt:

User-agent: CrescontentBot
Disallow: /

Contact

Questions or concerns: info@crescodigo.com. Crescontent is operated by Crescodigo Limited (company number 17569621). See our Privacy Notice.