We're updating our knowledge graph! All services are available, but you may observe increased latency.

CobaltmetricsBot

Last updated on June 07, 2019

CobaltmetricsBot is the bot that we send out to discover and index citation data.

How Cobaltmetrics Crawls the Web

For the sake of reproducibility, there is currently a limited list of websites that Cobaltmetrics crawls. See our page on data sources for a complete list. More information about how often we crawl these websites is coming soon.

While CobaltmetricsBot is both harmless and beneficial, you might want to prevent it from accessing some resources on your website. The best way to do so is to update the robots.txt configuration of your website, see http://www.robotstxt.org/ for more information.

The full user-agent string is CobaltmetricsBot/1.0 (+https://cobaltmetrics.com). Where several user-agents are recognized in the robots.txt file, CobaltmetricsBot will follow the most specific.

Support

If you think that CobaltmetricsBot does not obey your robots.txt configuration, please contact us with your URLs, the logs showing CobaltmetricsBot accessing pages that it was not supposed to, and we will work with you to fix the issue.