In this blog post “Blocking My Crawl” by Martin Eve, he discusses the challenges he faces while crawling websites to gather statistics about Crossref members’ compliance with display guidelines as part of his Labs work. This post offers insights into the technical aspects of web crawling and the ongoing battle against detection techniques used by scholarly publishers.
