| JayBizzle/Crawler-Detect |
1,842 |
|
477 |
110 |
over 2 years ago |
156 |
July 21, 2023 |
6 |
mit |
PHP |
| 🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent |
| timwhitez/crawlergo_x_XRAY |
915 |
|
0 |
0 |
over 4 years ago |
0 |
|
3 |
|
Python |
| 360/0Kee-Team/crawlergo动态爬虫结合长亭XRAY扫描器的被动扫描功能 |
| omrilotan/isbot |
778 |
|
568 |
119 |
over 2 years ago |
104 |
November 14, 2023 |
0 |
unlicense |
TypeScript |
| 🤖/👨🦰 Detect bots/crawlers/spiders using the user agent string |
| AccordBox/awesome-scrapy |
450 |
|
0 |
0 |
over 3 years ago |
0 |
|
2 |
|
|
| A curated list of awesome packages, articles, and other cool resources from the Scrapy community. |
| fanfank/phpfetcher |
281 |
|
0 |
0 |
over 8 years ago |
0 |
|
10 |
|
HTML |
| A PHP web crawler framework |
| alibaba/nginx-http-user-agent |
155 |
|
0 |
0 |
almost 7 years ago |
0 |
|
1 |
|
C |
| A nginx module to match browsers and crawlers |
| loadkpi/crawler_detect |
106 |
|
0 |
0 |
over 2 years ago |
23 |
September 05, 2021 |
4 |
mit |
Ruby |
| Ruby gem to detect bots and crawlers via the user agent |
| abola/CrawlerPack |
99 |
|
51 |
0 |
over 9 years ago |
9 |
December 10, 2016 |
0 |
apache-2.0 |
Java |
| Java 網路資料爬蟲包 |
| antoinevastel/bots-zoo |
90 |
|
0 |
0 |
over 2 years ago |
0 |
|
0 |
mit |
JavaScript |
| JefferyHus/es6-crawler-detect |
88 |
|
0 |
4 |
over 2 years ago |
15 |
January 06, 2022 |
1 |
mit |
JavaScript |
| :spider: This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent. |
