-
Apache Kafka Connector
Dependencies Kafka Source (Consumer) example Advanced configuration parameters Consume multiple Kafka instances Consume multiple topics Topic dynamic discovery Consume from t... -
Using Spark
Hudi Streamer Options Using hudi-utilities bundle jars Concurrency Control Checkpointing Transformers SQL Query Transformer SQL File Transformer Flattening Transformer Chai... -
FAQs
Why should I install a computing engine like Spark or Flink? I have a question, and I cannot solve it by myself How do I declare a variable? How do I write a configuration item ... -
Configurations
Environments Kyuubi Configurations Authentication Backend Batch Credentials Ctl Delegation Engine Event Frontend Ha Kinit Kubernetes Lineage Metadata Metrics Operat... -
JDBC Connector
JDBC 信息配置 semantic 语义配置 EXACTLY_ONCE AT_LEAST_ONCE && NONE 其他配置 JDBC 读取数据 queryFunc获取一条sql resultFunc 处理查询到的数据 JDBC 读取写入 根据数据流生成目标SQL 设置写入批次大小 多实例 JDBC 支持 手动指定 JDBC 连接信... -
Docker Demo
A Demo using Docker containers Prerequisites Setting up Docker Cluster Build Hudi Bringing up Demo Cluster Demo Step 1 : Publish the first batch to Kafka Step 2: Incrementall... -
Writing Tables
What are some ways to write a Hudi table? How is a Hudi writer job deployed? Can I implement my own logic for how input records are merged with record on storage? How do I delet... -
Basic Configurations
Hudi Table Config Hudi Table Basic Configs Spark Datasource Configs Read Options Write Options Flink Sql Configs Flink Options Write Client Configs Common Configurations Me... -
Introduction
Architecture Supported table formats Supported engines Iceberg format Paimon format Mixed format User cases Self-managed streaming Lakehouse Stream-and-batch-fused data pipe... -
General
When is Hudi useful for me or my organization? What are some non-goals for Hudi? What is incremental processing? Why does Hudi docs/talks keep talking about it? How is Hudi opti...