| User Agent | Count |
| Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) | 794 |
| Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/) | 405 |
| Mozilla/5.0 (compatible; MJ12bot/v2.0.2; http://mj12bot.com/) | 314 |
| Mozilla/5.0 | 114 |
| ZoominfoBot (zoominfobot at zoominfo dot com) | 101 |
| Mozilla/5.0 (compatible; CMS-Checker/1.0; +https://example.com) | 65 |
| Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) | 62 |
| Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) | 57 |
| Mozilla/5.0 (compatible; Dataprovider.com) | 51 |
| Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/) | 49 |
| Go-http-client/1.1 | 46 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/116.0.1938.76 Safari/537.36 | 43 |
| Hello from Palo Alto Networks, find out more about our scans in https://docs-cortex.paloaltonetworks.com/r/1/Cortex-Xpanse/Scanning-activity | 37 |
| Mozilla/5.0 (compatible; MJ12bot/v2.0.5; http://mj12bot.com/) | 34 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36 | 28 |
| YisouSpider | 24 |
| Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) | 21 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) | 17 |
| SEMrushBot | 17 |
| Mozilla/5.0 (compatible; BLEXBot/1.0; +https://help.seranking.com/en/blex-crawler) | 17 |
| Mozilla/5.0 (compatible; InternetMeasurement/1.0; +https://internet-measurement.com/) | 16 |
| Expanse, a Palo Alto Networks company, searches across the global IPv4 space multiple times per day to identify customers' presences on the Internet. If you would like to be excluded from our scans, please send IP addresses/domains to: scaninfo@paloaltonetworks.com | 15 |
| Apache-HttpClient/4.5.2 (Java/1.8.0_161) | 14 |
| Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot) | 14 |
| Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) | 13 |
| Mozilla/5.0 (compatible; SemrushBot-BA; +http://www.semrush.com/bot.html) | 13 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.3; +https://openai.com/gptbot) | 12 |
| Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) | 12 |
| Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) | 12 |
| Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org) | 10 |
| CCBot/2.0 (https://commoncrawl.org/faq/) | 9 |
| Mozilla/5.0 Firefox/35.0 | 9 |
| Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) | 9 |
| Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.3 | 9 |
| python-requests/2.32.3 | 9 |
| Scrapy/2.11.2 (+https://scrapy.org) | 9 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.6312.86 Safari/537.36 BitSightBot/1.0 | 8 |
| Python/3.8 aiohttp/3.9.5 | 8 |
| TerraCotta https://github.com/CeramicTeam/CeramicTerracotta | 8 |
| Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com) | 8 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot) | 7 |
| Mozilla/5.0 (Android 14; Mobile; rv:123.0) Gecko/123.0 Firefox/123 | 7 |
| serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com) | 7 |
| python-requests/2.32.4 | 7 |
| panscient.com | 6 |
| python-requests/2.27.1 | 6 |
| curl/7.61.1 | 6 |
| CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) | 5 |
| Mozilla/5.0 (compatible; BitSightBot/1.0) | 5 |
| OpenTheBoxBot/1.0 | 5 |
| python-requests/2.32.5 | 5 |
| Apache-HttpClient/4.5.2 (Java/1.8.0_151) | 5 |
| python-urllib3/2.2.3 | 4 |
| Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) | 4 |
| Python/3.11 aiohttp/3.11.11 | 4 |
| Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) | 4 |
| Pandalytics/2.0 (https://domainsbot.com/pandalytics/) | 4 |
| 2ip bot/1.1 (+http://2ip.io) | 4 |
| 2ip bot/1.1 (+https://2ip.io) | 4 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0 | 4 |
| python-requests/2.25.1 | 4 |
| Mozilla/5.0 zgrab/0.x | 4 |
| Mozilla/5.0 (compatible; SeekportBot; +https://bot.seekport.com) | 3 |
| curl/8.7.1 | 3 |
| Mozilla/5.0 (compatible; ips-agent) | 3 |
| python-requests/2.31.0 | 3 |
| curl/7.88.1 | 3 |
| Screaming Frog SEO Spider/19.8 | 3 |
| DnBCrawler-Analytics | 2 |
| libcurl-agent/1.0 | 2 |
| Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/) | 2 |
| CATExplorador/1.0beta (sistemes at domini dot cat; https://domini.cat/catexplorador/) | 2 |
| Chrome | 2 |
| Python/3.8 aiohttp/3.8.4 | 2 |
| python-httpx/0.28.1 | 2 |
| Mozilla/5.0 (compatible; Website-info.net-Robot; https://website-info.net/robot) | 2 |
| Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com) | 2 |
| Twitterbot/1.0 | 2 |
| Embarcadero URI Client/1.0 | 2 |
| Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com) | 2 |
| Mozilla/5.0 (MeeGo; NokiaN9) AppleWebKit/534.13 (KHTML, like Gecko) NokiaBrowser/8.5.0 Mobile Safari/534.13 | 1 |
| Offline Explorer/2.5 | 1 |
| python-requests/2.28.1 | 1 |
| Mozilla/5.0 (compatible; AcmeInc/9.0) | 1 |
| Mozilla/5.0 (SymbianOS 9.4; Series60/5.0 NokiaN97-1/10.0.052; Profile/MIDP-2.1 Configuration/CLDC-1.1; en-us) AppleWebKit/525 (KHTML, like Gecko) WicKed/7.1.12344 | 1 |
| Mozilla/5.0 (X11; CrOS x86_64 14541.0.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36 | 1 |
| Apache-HttpClient/4.5.2 (Java/1.8.0_202) | 1 |
| Burst5000TitleFetcher/1.0 | 1 |
| Mozilla/5.0 (Android; Mobile; rv:35.0) Gecko/35.0 Firefox/35.0 | 1 |
| Mozilla/5.0 (compatible; scanner/1.0) | 1 |
| Mozilla/5.0 (Windows Mobile 10; Android 10.0; Microsoft; Lumia 950XL) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/520.0.0.0 Mobile Safari/537.36 Edge/40.65254.603 | 1 |
| Mozilla/5.0 (X11; CrOS x86_64 6680.78.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.102 Safari/537.36 | 1 |
| Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) | 1 |
| meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) | 1 |
| curl/8.10.0 | 1 |
| Mozilla/5.0 (compatible; t3versionsBot/1.0; +https://www.t3versions.com/bot) | 1 |
| Opera/9.5 (Microsoft Windows; PPC; Opera Mobi; U) SonyEricssonX1i/R2AA Profile/MIDP-2.0 Configuration/CLDC-1.1 | 1 |
| Opera/9.80 (MAUI Runtime; Opera Mini/9.4.73576/191.376; U; en) Presto/2.12.413 Version/12.16 | 1 |
| sqalix-geral-worker/1.0 | 1 |
| python-urllib3/1.26.20 | 1 |
| Mozilla/5.0 (compatible; GoParserBot/1.0) | 1 |
| WanScannerBot/1.0 | 1 |
| SEC-SGHX210/1.0 UP.Link/6.3.1.13.0 | 1 |
| t3versionsBot/1.1; +https://www.t3versions.com/bot | 1 |
| fasthttp | 1 |
| Mozilla/5.0 (Windows 7 Enterprise; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.6099.71 Safari/537.36 | 1 |
| Mozilla/5.0 (X11; CrOS x86_84 12239.92.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.136 Safari/537.36 | 1 |
| Mozilla/5.0 (SymbianOS/9.4; U; Series60/5.0 SonyEricssonP100/01; Profile/MIDP-2.1 Configuration/CLDC-1.1) AppleWebKit/525 (KHTML, like Gecko) Version/3.0 Safari/525 | 1 |
| Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html) | 1 |
| Opera/9.80 (Android; Opera Mini/46.0.2254/174.78; U; en) Presto/2.12.423 Version/12.16 | 1 |
| 合計 | 2696 |
|---|