State of Digital UK 2023
A crawler, also known as a spider or a bot, is the software Comscore uses to visit and access the content of webpages.
The Comscore crawler:
Here are answers to the most common questions. If you need to know more, please contact us.
Mozilla/5.0 (compatible; proximic; +https://www.comscore.com/Web-Crawler)
User-agent: proximic Disallow:
User-agent: proximic Disallow: /path/
User-agent: proximicCrawl-Delay: 2