-
Using Spark
Hudi Streamer Options Using hudi-utilities bundle jars Concurrency Control Checkpointing Transformers SQL Query Transformer SQL File Transformer Flattening Transformer Chai... -
FAQs
Why should I install a computing engine like Spark or Flink? I have a question, and I cannot solve it by myself How do I declare a variable? How do I write a configuration item ... -
Table Configuration
Locality Groups Managing Locality Groups via the Shell Managing Locality Groups via the Client API Constraints Bloom Filters Iterators Setting Iterators via the Shell Setting... -
Platform Deployment
Environmental requirements Hadoop Kubernetes Build & Deploy Environmental requirements install streampark Initialize table structure Modify the configurat... -
Apache Kafka Connector
依赖 Kafka Source (Consumer) 基础消费示例 高级配置参数 消费多个Kafka实例 消费多个Topic Topic 发现 配置开始消费的位置 指定分区Offset 指定deserializer 返回记录KafkaRecord 指定strategy Kafka Sink (Producer) 容错和语义 多实例k... -
Apache Kafka Connector
Dependencies Kafka Source (Consumer) example Advanced configuration parameters Consume multiple Kafka instances Consume multiple topics Topic dynamic discovery Consume from t... -
Metadata Table
Metadata Table Supporting Multi-Modal Index in Hudi Metadata table indices Enable Hudi Metadata Table and Multi-Modal Index in write side Use metadata indices for query side im... -
Architecture
Kyuubi Architecture Introduction Architecture Overview Unified Interface Runtime Resource Resiliency High Availability & Load Balance Authentication & Authorization Conclusio... -
Storage
Does Hudi support cloud storage/object stores? What is the difference between copy-on-write (COW) vs merge-on-read (MOR) table types? How do I migrate my data to Hudi? How to co... -
Docker Demo
A Demo using Docker containers Prerequisites Setting up Docker Cluster Build Hudi Bringing up Demo Cluster Demo Step 1 : Publish the first batch to Kafka Step 2: Incrementall...
