Stars
330
Forks
68
Language
Rust
Last Updated
May 25, 2024
Similar Repos
| Repo | Language | Stars | Description | Updated At |
|---|---|---|---|---|
| None | 4 | Demo of Structured Streaming with Delta Lake | Jan 02, 2022 | |
| Python | 6 | Spark Structured Streaming + Kafka + Delta pipeline. | Oct 04, 2023 | |
| Jupyter Notebook | 2 | Migrate data from MongoDB Atlas to Databricks Delta Lake | Apr 28, 2023 | |
| TSQL | 46 | Data Engineering with Spark and Delta Lake | Aug 02, 2022 | |
| Java | 2 | Streaming Data Lake with RSocket | May 05, 2021 | |
| Python | 2 | Kafka streaming job from iomete. This streaming job copies data from Kafka to Iceberg. | Jun 17, 2022 | |
| Rust | 2 | A native Rust library for Delta Lake, with bindings into Python | Jan 23, 2024 | |
| Python | 2 | Enriching Streaming Data from Kafka with Python | Apr 01, 2024 | |
| Go | 4 | native Go library for Delta Lake | May 03, 2022 | |
| None | 5 | Delta Lake native library for .NET | May 24, 2023 | |
| Java | 5 | Data streaming apps - kafka | Apr 07, 2023 | |
| JavaScript | 3 | Hackolade plugin for Delta Lake on Databricks | Mar 25, 2023 | |
| Rust | 545 | A native Rust library for Delta Lake, with bindings into Python and Ruby. | Aug 12, 2022 | |
| Rust | 3 | A native Rust library for Delta Lake, with bindings into Python and Ruby. | Jan 26, 2024 | |
| Java | 2 | Example Kafka source connector, streaming Wikipedia edits into Kafka | Mar 11, 2024 | |
| JavaScript | 43 | Streaming data from MongoDB into MySQL | May 06, 2022 | |
| TypeScript | 3 | Reads and processes the data from stopforumspam.com, optimizing it for efficient delta upgrades. | Nov 03, 2022 | |
| C | 1507 | Change data capture from PostgreSQL into Kafka | Aug 04, 2022 | |
| C | 3 | Change data capture from PostgreSQL into Kafka | Nov 24, 2022 | |
| JavaScript | 362 | Elegant, highly efficient data validation for JavaScript. | Feb 11, 2023 | |
| Java | 4 | Near real-time data ingestion that continuously pulls JSON data from Kafka and loads it into … | Feb 21, 2023 | |
| Java | 28 | Simple kafka producer that ingest data from Twitter Streaming API to a Kafka broker | Jan 28, 2023 | |
| Java | 9 | Spark in Action, 2nd edition - chapter 16 - exporting data, using delta lake | May 06, 2023 | |
| Python | 69 | A packaged Data Lake solution, that builds a highly functional Data Lake, with a data … | Aug 02, 2022 | |
| None | 11 | Make TIDB into the Data Lake easier | Feb 21, 2022 | |
| Python | 11 | Efficient streaming data ingestion, transformation & activation | Apr 13, 2023 | |
| None | 2 | Efficient Data Ingestion with Glue Concurrency: Using a Single Template for Multiple S3 Tables into … | Apr 14, 2023 | |
| C# | 2 | POC for mirroring external tables, starting with Delta Lake tables. | Sep 30, 2022 | |
| Scala | 11 | Data Generators -> Kafka -> Spark Streaming -> PostgreSQL -> Grafana | Apr 12, 2023 | |
| JavaScript | 3 | Realtime streaming data with Socket.io and Kafka. | Apr 20, 2022 | |
| Python | 2 | Take data from EPICS and whack it into Kafka | Jan 10, 2022 | |
| Python | 25 | Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python | May 14, 2023 | |
| Java | 3 | Apache Kafka Streams streaming data analytics demonstration using Streaming Synthetic Sales Data Generator | Nov 03, 2022 | |
| Java | 4 | Reading Dalta Lake data from Beam | Dec 12, 2021 | |
| Go | 2 | Ingest kafka data into databend | Sep 15, 2023 | |
| Haskell | 4 | Proxies for streaming data into vectors | Dec 05, 2019 | |
| Python | 16 | Utility for streaming rows from SQL Server Change Data Capture (CDC) to Kafka topics | Apr 16, 2023 | |
| C++ | 8 | An efficient delta compression algorithm for Node.js | Oct 15, 2022 | |
| Scala | 5163 | This connector allows Apache Spark™ to read from and write to Delta Lake. | Aug 21, 2022 | |
| Java | 11 | This repository contains a Kafka Connect source connector for copying data from RabbitMQ into Apache … | Apr 06, 2022 | |
| Java | 2 | Kafka Connect Azure Event Hub consists of the Sink Connector for streaming data from Kafka … | Dec 02, 2021 | |
| Scala | 19 | Simple way to copy data from relational databases into kafka. | Jan 29, 2021 | |
| Java | 22 | Ingress data from kafka topic into clickhouse table (JSON format) | Dec 25, 2022 | |
| Java | 7 | Apache Flink/Apache Kafka streaming data analytics demonstration using Streaming Synthetic Sales Data Generator | Apr 12, 2023 | |
| Python | 196 | A Data Streaming Library for Efficient Neural Network Training | Apr 22, 2023 | |
| C++ | 7 | Highly Efficient FFT for Exascale | Mar 13, 2023 | |
| Java | 49 | :baseball: Streaming left joins in Kafka for change data capture | Jan 24, 2023 | |
| Jupyter Notebook | 3 | How to read data from Apache Kafka on HDInsight using Spark Structured Streaming. | Oct 25, 2021 | |
| HCL | 2 | Example to sync Kafka Topics on MSK with S3 Bucket for Data Lake creations | Sep 26, 2022 | |
| Python | 29 | Deeper look into access control and data lake configuration | Aug 03, 2022 |