Bots and crawlers

Web Crawler IP address tag

General-purpose crawler or automated page-fetching infrastructure.

Current IP examples

These addresses currently have the Web Crawler tag in IP Lens. Tag data can change as network roles and observations change.

How to interpret this tag

Web Crawler belongs to the Bots and crawlers category: Automated agents, crawlers, and fetchers that retrieve or interact with online content.

Report an incorrect tag

Include the result URL, address, tag, relevant dates, and evidence showing the address or range's current role. Use the IP Lens Contact page.