Stars
80
Forks
33
Language
Python
Last Updated
May 08, 2024
Similar Repos
| Repo | Language | Stars | Description | Updated At |
|---|---|---|---|---|
| Python | 39 | A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components … | Aug 23, 2022 | |
| Python | 44 | Distributed crawling/scraping, Kafka And Redis based components for Scrapy | Jun 22, 2022 | |
| Python | 5162 | Redis-based components for Scrapy. | Sep 02, 2022 | |
| Python | 14 | Scrapy and Kafka | Jul 05, 2022 | |
| Python | 46 | Redis-based components for scrapy that allows distributed crawling | Mar 19, 2022 | |
| Python | 29 | Scrapy extension which writes crawled items to Kafka | Jul 05, 2022 | |
| Python | 2 | Based on Scrapy | Apr 18, 2021 | |
| Python | 8 | 整理后的爬虫，scrapy + db + kafka + redis | Jul 19, 2020 | |
| Jupyter Notebook | 45 | Crochet-based blocking API for Scrapy. | May 19, 2022 | |
| Clojure | 5 | Kafka producer and consumer components for systems-toolbox | Jan 15, 2020 | |
| Python | 16 | Scrapy based Bangumi spider | Dec 28, 2021 | |
| Kotlin | 2 | Repository for sample Kotlin implementations for Apache Kafka components | Aug 29, 2022 | |
| Go | 20 | Text-Based UI for Kafka | Sep 03, 2020 | |
| Java | 34 | Kafka-based storage for Zipkin. | Mar 28, 2022 | |
| Python | 93 | Scrapy-based Crawlers for news of Taiwan | May 24, 2022 | |
| Python | 4 | crawler based on Python-scrapy | Jul 20, 2020 | |
| Scala | 271 | Kafka-based message queue | Aug 18, 2022 | |
| Java | 25 | Kafka Streams based microservice | Aug 23, 2022 | |
| Python | 2 | A scraper for Stocktwits.com based on python-scrapy | Jan 13, 2021 | |
| Python | 4 | Thoth investigator is a Kafka based component that consumes all messages produced by Thoth components. | Aug 11, 2022 | |
| Python | 10 | a image spider based on scrapy | Aug 18, 2019 | |
| Python | 12 | Here are some spiders based scrapy. | Apr 17, 2021 | |
| Python | 2 | Scrapy-based cyber security news finder | Nov 01, 2021 | |
| Python | 16 | Scrapy based crawler which crawls newspaper. | Mar 31, 2022 | |
| Python | 150 | A scrapy-based Hacker News crawler. | Sep 22, 2020 | |
| Python | 7 | Short video crawler based on scrapy | Nov 14, 2023 | |
| Python | 12 | SpiderMan Based on Scrapy, scrapyd, scrapy-API, tornado spider distributed management framework. | Apr 02, 2021 | |
| Go | 7 | kafka based knative channel implementation without kafka admin rights | Jul 26, 2021 | |
| Scala | 22 | Custom Spark Kafka consumer based on Kafka SimpleConsumer API. | Jan 30, 2023 | |
| Scala | 10 | A Kafka mirroring service based on Akka Streams Kafka | Mar 21, 2022 | |
| Java | 113 | Camel Kafka Connector allows you to use all Camel components as Kafka Connect connectors | Aug 19, 2022 | |
| Kotlin | 4 | Kafka Connect connector for CØSMOS based blockchains. | Jun 11, 2022 | |
| Go | 2 | Kafka-based RPC Middleware for Ethereum Services | Sep 07, 2023 | |
| Python | 4 | Redis-based scheduler and Message queue Spider for Scrapy, Provide more flexible and practical ways for … | Dec 14, 2022 | |
| Java | 2 | An example about online merchant monitor based on Kafka, Kafka Stream, Kafka Connect,KSQL | Feb 02, 2023 | |
| Java | 71 | Legacy Couchbase to Kafka connector, superseded by Kafka Connect based. | Aug 28, 2020 | |
| Java | 3 | Components that help with light-4j and Kafka integration | Aug 06, 2022 | |
| Scala | 21 | Common components used across the datamountaineer kafka connect connectors | Mar 15, 2023 | |
| TypeScript | 2 | Components for graphin based on @antv/graphin-components | Oct 30, 2023 | |
| Python | 77 | Scrapy spider example for Scrapy Tutorial Series | Jun 20, 2022 | |
| Python | 2 | Web crawler based on Python Scrapy framework | Apr 21, 2019 | |
| Python | 164 | A dynamic configurable news crawler based Scrapy | Sep 03, 2022 | |
| Python | 6 | Yet another tumblr downloader based on Scrapy | Mar 20, 2022 | |
| Go | 10 | Docker based example for Kafka using Go client | Jul 12, 2022 | |
| C# | 2 | Simple .net client for Kafka based on Confluent.Kafka | Dec 22, 2022 | |
| Vue | 4 | Bootstrap based components for vuejs | Feb 14, 2020 | |
| Lua | 2 | Class-based components for Fusion | Jul 09, 2022 | |
| JavaScript | 18 | Vue.js based components for vtk.js | Jul 11, 2022 | |
| Python | 5 | Python scrapy-based repository for mining information associated with MountainProject | Oct 19, 2021 | |
| Python | 6 | A python-based web scraper for www.rateyourmusic.com, powered by scrapy | Apr 08, 2020 |