| User Agent | Count |
|---|
| Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/) | 736 |
|---|
| Mozilla/5.0 (compatible; MJ12bot/v2.0.5; http://mj12bot.com/) | 526 |
|---|
| Hello from Palo Alto Networks, find out more about our scans in https://docs-cortex.paloaltonetworks.com/r/1/Cortex-Xpanse/Scanning-activity | 121 |
|---|
| Mozilla/5.0 | 119 |
|---|
| Mozilla/5.0 (compatible; MJ12bot/v2.0.4; http://mj12bot.com/) | 117 |
|---|
| Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) | 109 |
|---|
| Mozilla/5.0 (compatible; CMS-Checker/1.0; +https://example.com) | 98 |
|---|
| ZoominfoBot (zoominfobot at zoominfo dot com) | 62 |
|---|
| Go-http-client/1.1 | 59 |
|---|
| Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/) | 55 |
|---|
| Mozilla/5.0 (compatible; Dataprovider.com) | 53 |
|---|
| Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) | 50 |
|---|
| YisouSpider | 48 |
|---|
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 | 33 |
|---|
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot) | 28 |
|---|
| Mozilla/5.0 (compatible; SERankingBacklinksBot/1.0; +https://seranking.com/backlinks-crawler) | 26 |
|---|
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) | 23 |
|---|
| Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) | 21 |
|---|
| SEMrushBot | 18 |
|---|
| python-requests/2.32.5 | 18 |
|---|
| Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html) | 16 |
|---|
| Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/) | 16 |
|---|
| Mozilla/5.0 (compatible; WP-Safe-Scanner/1.0) | 16 |
|---|
| Mozilla/5.0 (compatible; InternetMeasurement/1.0; +https://internet-measurement.com/) | 15 |
|---|
| Apache-HttpClient/4.5.2 (Java/1.8.0_161) | 15 |
|---|
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.3; +https://openai.com/gptbot) | 14 |
|---|
| Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) | 13 |
|---|
| Dalvik/2.1.0 (Linux; U; Android 9.0; ZTE BA520 Build/MRA58K) | 13 |
|---|
| Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko | 11 |
|---|
| 2ip bot/1.1 (+https://2ip.io/bot/) | 11 |
|---|
| Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot) | 10 |
|---|
| Mozilla/5.0 (compatible; DotBot/1.2; +https://opensiteexplorer.org/dotbot; help@moz.com) | 10 |
|---|
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) Chrome/120.0.0.0 | 10 |
|---|
| Mozilla/5.0 (Windows NT 6.1; Win64; x64; +http://url-classification.io/wiki/index.php?title=URL_server_crawler) KStandBot/1.0 | 9 |
|---|
| serpstatbot/2.1 (advanced backlink tracking bot; https://serpstatbot.com/; abuse@serpstatbot.com) | 8 |
|---|
| RootEvidence/1.0 | 8 |
|---|
| Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org) | 7 |
|---|
| curl/7.61.1 | 7 |
|---|
| panscient.com | 6 |
|---|
| TerraCotta https://github.com/CeramicTeam/CeramicTerracotta | 6 |
|---|
| Mozilla/5.0 (compatible; VelenPublicWebCrawler/1.0; +https://velen.io) | 5 |
|---|
| eMClient/10.4.5326.0 | 5 |
|---|
| CCBot/2.0 (https://commoncrawl.org/faq/) | 5 |
|---|
| Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) | 4 |
|---|
| Embarcadero URI Client/1.0 | 4 |
|---|
| meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) | 4 |
|---|
| Mozilla/5.0 (compatible; DomainScores/2.1; +https://www.domainscores.net/headers) | 4 |
|---|
| Mozilla/5.0 (compatible; ips-agent) | 4 |
|---|
| 2ip bot/1.1 (+https://2ip.io) | 4 |
|---|
| Apache-HttpClient/4.5.2 (Java/1.8.0_202) | 4 |
|---|
| Mozilla/5.0 (compatible; Website-info.net-Robot; https://website-info.net/robot) | 4 |
|---|
| cve-2026-87902-poc/1.0 | 4 |
|---|
| Python/3.12 aiohttp/3.13.5 | 3 |
|---|
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) | 3 |
|---|
| curl/8.7.1 | 3 |
|---|
| Mozilla/5.0 (l9scan/2.0.430313e2031313e20373e2631323; +https://leakix.net) | 3 |
|---|
| Mozilla/5.0 (X11; Linux x86_64; rv:109) | 3 |
|---|
| CyotekWebCopy/1.9 CyotekHTTP/6.4 | 3 |
|---|
| python-requests/2.27.1 | 3 |
|---|
| Mozilla/5.0 (compatible; DomainCheck/1.0) | 3 |
|---|
| CATExplorador/1.0beta (sistemes at domini dot cat; https://domini.cat/catexplorador/) | 3 |
|---|
| python-requests/2.32.3 | 3 |
|---|
| Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com) | 3 |
|---|
| python-urllib3/2.2.3 | 3 |
|---|
| Python/3.8 aiohttp/3.9.5 | 2 |
|---|
| Pandalytics/2.0 (https://domainsbot.com/pandalytics/) | 2 |
|---|
| Mozilla/5.0 (compatible; PisarBot/1.0) | 2 |
|---|
| python-requests/2.31.0 | 2 |
|---|
| Mozilla/5.0 (iPhone; CPU iPhone OS 26_1 like Mac OS X; zh-CN) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/23B85 UCBrowser/18.3.8.2815 Mobile AliApp(TUnionSDK/0.1.20.4) | 2 |
|---|
| Apache-HttpClient/5.3.1 (Java/25.0.3) | 2 |
|---|
| Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko | 2 |
|---|
| Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html) | 2 |
|---|
| Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) | 2 |
|---|
| Python/3.11 aiohttp/3.13.3 | 2 |
|---|
| Mozilla/5.0 (compatible; AonsightMetaBot/1.0; +https://aonsight.com/bot) | 2 |
|---|
| Apache-HttpClient/4.5.2 (Java/1.8.0_151) | 2 |
|---|
| Python/3.11 aiohttp/3.12.13 | 2 |
|---|
| Mozilla/5.0 (compatible; SeekportBot; +https://bot.seekport.com) | 2 |
|---|
| CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html) | 2 |
|---|
| python-requests/2.25.1 | 2 |
|---|
| Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/) | 2 |
|---|
| python-requests/2.34.2 | 2 |
|---|
| AIWebIndex/2.0 (+https://lyrenth.com/bot; AI-readable web index) | 2 |
|---|
| DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) | 2 |
|---|
| Mozilla/5.0 Chrome/125 | 2 |
|---|
| wp2shell-rce/1.0 | 1 |
|---|
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) | 1 |
|---|
| curl/7.29.0 | 1 |
|---|
| python-requests/2.32.4 | 1 |
|---|
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0 | 1 |
|---|
| Scrapy/2.16.0 (+https://scrapy.org) | 1 |
|---|
| SuperBot/4.4.0.60 (Windows XP) | 1 |
|---|
| Mozilla/5.0 (iPhone; CPU iPhone OS 18_7 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 | 1 |
|---|
| wp2shell | 1 |
|---|
| Python/3.12 aiohttp/3.14.3 | 1 |
|---|
| SonyEricssonK750i/R1CA Browser/SEMC-Browser/4.2 Profile/MIDP-2.0 Configuration/CLDC-1.1 | 1 |
|---|
| Mozilla/5.0 (compatible; DefaultsExposed/1.0; +https://defaults.exposed/headers) | 1 |
|---|
| Mozilla/5.0 (compatible; MixRankBot; crawler@mixrank.com) | 1 |
|---|
| Pandalytics/2.0 (+https://domainsbot.com/network-crawler-pandalytics-kdc68dhsbd/) | 1 |
|---|
| Mozilla/5.0 (compatible; enrichment-prefilter/1.0) | 1 |
|---|
| curl-proxy/1.0 | 1 |
|---|
| Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.33729; .NET4.0C; .NET4.0E; rv 10.0) like Gecko | 1 |
|---|
| Mozilla/5.0 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) | 1 |
|---|
| LG-LX550 AU-MIC-LX550/2.0 MMP/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 | 1 |
|---|
| Opera/9.80 (MAUI Runtime; Opera Mini/9.4.73576/191.376; U; en) Presto/2.12.413 Version/12.16 | 1 |
|---|
| Python/3.12 aiohttp/3.13.3 | 1 |
|---|
| Mozilla/5.0 (Symbian/3; Series60/5.2 NokiaE7-00/010.016; Profile/MIDP-2.1 Configuration/CLDC-1.1 ) AppleWebKit/525 (KHTML, like Gecko) Version/3.0 BrowserNG/7.2.7.3 3gpp-gba | 1 |
|---|
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148;super/4.12.6/iOS/18.1.1 | 1 |
|---|
| Mozilla/5.0 (SymbianOS 9.4; Series60/5.0 NokiaN97-1/10.0.052; Profile/MIDP-2.1 Configuration/CLDC-1.1; en-us) AppleWebKit/525 (KHTML, like Gecko) WicKed/7.1.12344 | 1 |
|---|
| iCab/2.5.2 (Macintosh; I; PPC) | 1 |
|---|
| Mozilla/5.0 (Windows NT 10.0; Win64; x64) AliveDeadChecker/1.2 | 1 |
|---|
| Gaisbot/3.0 (robot@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php) | 1 |
|---|
| Mozilla/5.0 (compatible; website-business-research/1.0) | 1 |
|---|
| Mozilla/5.0 (compatible; PublicWWWBot/1.0; +https://publicwww.com/bot.html) | 1 |
|---|
| WDG_Validator/1.6.2 | 1 |
|---|
| HoujinMapBot/0.1 (+https://houjinmap.hanashinotane.jp/; contact: k.takagi0727@gmail.com) | 1 |
|---|
| Opera/9.80 (X11; Linux x86_64; U; en-GB) Presto/2.2.15 Version/10.01 | 1 |
|---|
| DwightBot/0.1 (+https://example.com/bot; B2B outreach research; contact: ops@example.com) | 1 |
|---|
| Mozilla/5.0 (compatible; Barcada/1.0) | 1 |
|---|
| Mozilla/5.0 (iPhone; CPU iPhone OS 14_0 like Mac OS X) | 1 |
|---|
| Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com) | 1 |
|---|
| cms-scanner/2.0 (research) | 1 |
|---|
| Mozilla/5.0 (iPhone; CPU iPhone OS 14_1_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/22B91 Instagram 365.0.0.33.88 (iPhone14,5; iOS 18_1_1; en_US; en; scale=3.00; 1170x2532; 690008027; IABMV/1) | 1 |
|---|
| Mozilla/5.0 (iPhone; CPU iPhone OS 15_1_1 like Mac OS X; zh-CN) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/19B81 UCBrowser/13.7.2.1636 Mobile AliApp(TUnionSDK/0.1.20.4) dv(iPh13,3);pr(UCBrowser/13.7.2.1636);ov(15_1_1);ss(390x844);bt(UC);pm(0);bv(0);nm(0);im(0);nt(2); | 1 |
|---|
| NetAPI v1 | 1 |
|---|
| PragmaticSecurity-Scanner/2.0 (+https://www.domainscores.net/headers; check your domain security free) | 1 |
|---|
| Mozilla/5.0 (Windows NT 6.1; Trident/7.0; ATT; rv:11.0) like Gecko | 1 |
|---|
| Mozilla/5.0 (iPhone; CPU iPhone OS 16_1_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/20B101 Instagram 365.0.0.33.88 (iPhone14,5; iOS 16_1_1; en_GB; en-GB; scale=3.00; 2170x2532; 690008027; IABMV/1) | 1 |
|---|
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/bot) | 1 |
|---|
| Mozilla/5.0 (Windows NT; Windows NT 10.0; ru-RU) WindowsPowerShell/5.1.20348.1 | 1 |
|---|
| Avant Browser/1.2.789rel1 (http://www.avantbrowser.com) | 1 |
|---|
| Offline Explorer/2.5 | 1 |
|---|
| Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 5.1; Trident/3.1) | 1 |
|---|
| Mozilla/5.0 (compatible; Cotoyogi/4.0; +https://ds.rois.ac.jp/center8/crawler/) | 1 |
|---|
| Python/3.13 aiohttp/3.12.15 | 1 |
|---|
| python-httpx/0.28.1 | 1 |
|---|
| GeneralCrawlBot/0.1 | 1 |
|---|
| Mozilla/5.0 (compatible; AcmeInc/9.0) | 1 |
|---|
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:0.9.3) Gecko/20010801 | 1 |
|---|
| curl/7.83.1 | 1 |
|---|
| Mozilla/5.0 (compatible; FormDiscovery/2.0) | 1 |
|---|
| Opera/9.80 (Windows NT 6.1; WOW64; U; pt) Presto/2.10.229 Version/11.62 | 1 |
|---|
| SEC-SGHE900/1.0 NetFront/3.2 Profile/MIDP-2.0 Configuration/CLDC-1.1 Opera/8.01 (J2ME/MIDP; Opera Mini/2.0.4509/1378; nl; U; ssr) | 1 |
|---|
| Opera/9.12 (X11; Linux i686; U; en) (Ubuntu) | 1 |
|---|
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; KeenableBot/1.0; +https://keenable.ai/) | 1 |
|---|
| Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 | 1 |
|---|
| Mozilla/5.0 (Windows NT 6.3; WOW64; Trident/7.0; rv:11.0) like Gecko | 1 |
|---|
| CorporateDirectoryBot/1.0 (+https://github.com/FallseF/form-outreach) | 1 |
|---|
| POLARIS/6.01(BREW 3.1.5;U;en-us;LG;LX265;POLARIS/6.01/WAP;)MMP/2.0 profile/MIDP-201 Configuration /CLDC-1.1 | 1 |
|---|
| Mozilla/5.0 (compatible; Konqueror/3.5; Linux; en_US) KHTML/3.5.6 (like Gecko) (Kubuntu) | 1 |
|---|
| Opera/10.61 (J2ME/MIDP; Opera Mini/5.1.21219/19.999; en-US; rv:1.9.3a5) WebKit/534.5 Presto/2.6.30 | 1 |
|---|
| fasthttp | 1 |
|---|
| Python/3.10 aiohttp/3.14.1 | 1 |
|---|
| ct-sender-poc/1.0 (stage 3 fetch) | 1 |
|---|
| Opera/5.11 (Windows 98; U) [en] | 1 |
|---|
| t3versionsBot/1.1; +https://www.t3versions.com/bot | 1 |
|---|
| Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 | 1 |
|---|
| SofyaBot/1.0 (+https://sofya.co/bot) | 1 |
|---|
| Najdu (Vyhledavac sluzeb (hlavicka) najdu.s.holubem.eu) | 1 |
|---|
| YuDofu-Website-Audit/1.0 (public homepage audit) | 1 |
|---|
| Mozilla/5.0 (compatible; scanner/1.0) | 1 |
|---|
| Mozilla/5.0 (compatible; t3versionsBot/1.2; +https://www.t3versions.com/bot) | 1 |
|---|
| Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 | 1 |
|---|
| JPCompanyDirectoryBot/1.0 (+https://jp-company-directory-bot.pages.dev/) | 1 |
|---|
| 合計 | 2749 |
|---|