| User Agent | Count |
| Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) | 794 |
| Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/) | 405 |
| Mozilla/5.0 (compatible; MJ12bot/v2.0.2; http://mj12bot.com/) | 314 |
| Mozilla/5.0 | 114 |
| ZoominfoBot (zoominfobot at zoominfo dot com) | 101 |
| Mozilla/5.0 (compatible; CMS-Checker/1.0; +https://example.com) | 65 |
| Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) | 62 |
| Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) | 57 |
| Mozilla/5.0 (compatible; Dataprovider.com) | 51 |
| Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/) | 49 |
| Go-http-client/1.1 | 46 |
| Hello from Palo Alto Networks, find out more about our scans in https://docs-cortex.paloaltonetworks.com/r/1/Cortex-Xpanse/Scanning-activity | 37 |
| Mozilla/5.0 (compatible; MJ12bot/v2.0.5; http://mj12bot.com/) | 34 |
| YisouSpider | 24 |
| Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) | 21 |
| Mozilla/5.0 (compatible; BLEXBot/1.0; +https://help.seranking.com/en/blex-crawler) | 17 |
| SEMrushBot | 17 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) | 17 |
| Mozilla/5.0 (compatible; InternetMeasurement/1.0; +https://internet-measurement.com/) | 16 |
| Dalvik/2.1.0 (Linux; U; Android 9.0; ZTE BA520 Build/MRA58K) | 16 |
| Expanse, a Palo Alto Networks company, searches across the global IPv4 space multiple times per day to identify customers' presences on the Internet. If you would like to be excluded from our scans, please send IP addresses/domains to: scaninfo@paloaltonetworks.com | 15 |
| Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot) | 14 |
| Apache-HttpClient/4.5.2 (Java/1.8.0_161) | 14 |
| Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) | 13 |
| Mozilla/5.0 (compatible; SemrushBot-BA; +http://www.semrush.com/bot.html) | 13 |
| Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) | 12 |
| Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) | 12 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.3; +https://openai.com/gptbot) | 12 |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 | 11 |
| Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org) | 10 |
| Mozilla/5.0 (Linux; Android 5.1.1; SM-J111F) | 9 |
| Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) | 9 |
| CCBot/2.0 (https://commoncrawl.org/faq/) | 9 |
| python-requests/2.32.3 | 9 |
| Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title=URL_server_crawler) KStandBot/1.0 | 9 |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) Chrome/120.0.0.0 | 9 |
| Python/3.8 aiohttp/3.9.5 | 8 |
| Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com) | 8 |
| Scrapy/2.11.2 (+https://scrapy.org) | 8 |
| TerraCotta https://github.com/CeramicTeam/CeramicTerracotta | 8 |
| python-requests/2.32.4 | 7 |
| serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com) | 7 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot) | 7 |
| panscient.com | 6 |
| python-requests/2.27.1 | 6 |
| curl/7.61.1 | 6 |
| python-requests/2.32.5 | 5 |
| Mozilla/5.0 (compatible; BitSightBot/1.0) | 5 |
| OpenTheBoxBot/1.0 | 5 |
| Apache-HttpClient/4.5.2 (Java/1.8.0_151) | 5 |
| CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) | 5 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0 | 4 |
| Pandalytics/2.0 (https://domainsbot.com/pandalytics/) | 4 |
| Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) | 4 |
| Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) | 4 |
| Mozilla/5.0 zgrab/0.x | 4 |
| 2ip bot/1.1 (+https://2ip.io) | 4 |
| python-requests/2.25.1 | 4 |
| Python/3.11 aiohttp/3.11.11 | 4 |
| python-urllib3/2.2.3 | 4 |
| 2ip bot/1.1 (+http://2ip.io) | 4 |
| curl/7.88.1 | 3 |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) | 3 |
| curl/8.7.1 | 3 |
| python-requests/2.31.0 | 3 |
| Screaming Frog SEO Spider/19.8 | 3 |
| Mozilla/5.0 (compatible; ips-agent) | 3 |
| Mozilla/5.0 (X11; Linux x86_64; rv:109) | 3 |
| Mozilla/5.0 (compatible; SeekportBot; +https://bot.seekport.com) | 3 |
| Embarcadero URI Client/1.0 | 2 |
| Twitterbot/1.0 | 2 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 26_1 like Mac OS X; zh-CN) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/23B85 UCBrowser/18.3.8.2815 Mobile AliApp(TUnionSDK/0.1.20.4) | 2 |
| Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com) | 2 |
| Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/) | 2 |
| libcurl-agent/1.0 | 2 |
| python-httpx/0.28.1 | 2 |
| DnBCrawler-Analytics | 2 |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 Chrome/121.0.0.0 | 2 |
| CATExplorador/1.0beta (sistemes at domini dot cat; https://domini.cat/catexplorador/) | 2 |
| Python/3.8 aiohttp/3.8.4 | 2 |
| Mozilla/5.0 (compatible; Website-info.net-Robot; https://website-info.net/robot) | 2 |
| Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com) | 2 |
| Chrome | 2 |
| Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; SV1) | 1 |
| Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) | 1 |
| WanScannerBot/1.0 | 1 |
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Flipboard/4.2.142 | 1 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 11_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E216 MicroMessenger/6.7.1 NetType/4G Language/zh_CN | 1 |
| meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) | 1 |
| Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.33729; .NET4.0C; .NET4.0E; rv 10.0) like Gecko | 1 |
| php7.4 | 1 |
| Opera/9.80 (MAUI Runtime; Opera Mini/9.4.73576/191.376; U; en) Presto/2.12.413 Version/12.16 | 1 |
| Mozilla/5.0 (SymbianOS 9.4; Series60/5.0 NokiaN97-1/10.0.052; Profile/MIDP-2.1 Configuration/CLDC-1.1; en-us) AppleWebKit/525 (KHTML, like Gecko) WicKed/7.1.12344 | 1 |
| Burst5000TitleFetcher/1.0 | 1 |
| iCab/2.5.2 (Macintosh; I; PPC) | 1 |
| Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko | 1 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15G77 MicroMessenger/6.6.6 NetType/4G Language/zh_CN | 1 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 14_0 like Mac OS X) | 1 |
| Mozilla/5.0 (X11; U; Linux armv6l; rv 1.8.1.5pre) Gecko/20070619 Minimo/0.020 | 1 |
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0 | 1 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 14_1_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/22B91 Instagram 365.0.0.33.88 (iPhone14,5; iOS 18_1_1; en_US; en; scale=3.00; 1170x2532; 690008027; IABMV/1) | 1 |
| Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html) | 1 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 16_1_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/20B101 Instagram 365.0.0.33.88 (iPhone14,5; iOS 16_1_1; en_GB; en-GB; scale=3.00; 2170x2532; 690008027; IABMV/1) | 1 |
| Mozilla/5.0 (compatible; t3versionsBot/1.0; +https://www.t3versions.com/bot) | 1 |
| Apache-HttpClient/4.5.2 (Java/1.8.0_202) | 1 |
| python-urllib3/1.26.20 | 1 |
| Opera/9.27 (X11; Linux i686; U; fr) | 1 |
| Offline Explorer/2.5 | 1 |
| sqalix-geral-worker/1.0 | 1 |
| curl/8.10.0 | 1 |
| Mozilla/5.0 (compatible; AcmeInc/9.0) | 1 |
| Mozilla/5.0 (iPhone; CPU iPhone OS 15_1 like Mac OS X; zh-cn) AppleWebKit/601.1.46 (KHTML, like Gecko) Mobile/19B74 Quark/5.4.8.1256 Mobile | 1 |
| Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko | 1 |
| Mozilla/5.0 (compatible; GoParserBot/1.0) | 1 |
| Mozilla/5.0 (compatible; Konqueror/3.5; Linux; en_US) KHTML/3.5.6 (like Gecko) (Kubuntu) | 1 |
| SEC-SGHX210/1.0 UP.Link/6.3.1.13.0 | 1 |
| fasthttp | 1 |
| Opera/5.11 (Windows 98; U) [en] | 1 |
| Opera/9.80 (Android; Opera Mini/46.0.2254/174.78; U; en) Presto/2.12.423 Version/12.16 | 1 |
| Opera/9.80 (X11; Linux i686; U; en-GB) Presto/2.5.24 Version/10.53 | 1 |
| t3versionsBot/1.1; +https://www.t3versions.com/bot | 1 |
| Mozilla/5.0 (compatible; scanner/1.0) | 1 |
| Opera/9.5 (Microsoft Windows; PPC; Opera Mobi; U) SonyEricssonX1i/R2AA Profile/MIDP-2.0 Configuration/CLDC-1.1 | 1 |
| python-requests/2.28.1 | 1 |
| 合計 | 2666 |
|---|