-
Using Spark
Hudi Streamer Options Using hudi-utilities bundle jars Concurrency Control Checkpointing Transformers SQL Query Transformer SQL File Transformer Flattening Transformer Chai... -
Kerberos
Overview Within Hadoop Delegation Tokens Configuring Accumulo Servers Generate Principal and Keytab Server Configuration KerberosAuthenticator Administrative User Verifying ... -
Storage
Does Hudi support cloud storage/object stores? What is the difference between copy-on-write (COW) vs merge-on-read (MOR) table types? How do I migrate my data to Hudi? How to co... -
JDBC Connector
JDBC 信息配置 semantic 语义配置 EXACTLY_ONCE AT_LEAST_ONCE && NONE 其他配置 JDBC 读取数据 queryFunc获取一条sql resultFunc 处理查询到的数据 JDBC 读取写入 根据数据流生成目标SQL 设置写入批次大小 多实例 JDBC 支持 手动指定 JDBC 连接信... -
CLI
Local set up Hudi CLI Bundle setup Using hudi-cli Inspecting Commits Drilling Down to a specific Commit FileSystem View Statistics Archived Commits Compactions Validate Com... -
Writing Tables
What are some ways to write a Hudi table? How is a Hudi writer job deployed? Can I implement my own logic for how input records are merged with record on storage? How do I delet... -
开发指南
环境要求 clone源码 构建项目 打开项目 解压缩包 复制路径 启动后台服务 启动前端服务 演示调试代码 环境要求 要求 版本 是否必须 其他事项 操作系统 Linux 支持 Windows, 推荐使用 Mac/Linux. IDE Intellij IDEA 推荐使用 Intellij I... -
Spark Quick Start
Setup Spark 3 Support Matrix Spark Shell/SQL Setup project Create Table Insert data Query data Update data Merging Data Delete data Time Travel Query Incremental query ... -
Basic Configurations
Hudi Table Config Hudi Table Basic Configs Spark Datasource Configs Read Options Write Options Flink Sql Configs Flink Options Write Client Configs Common Configurations Me... -
HTTP Connector
HTTP 异步写入 Apache StreamPark™ 方式写入 http异步写入支持类型 http异步写入配置参数列表 http异步写入数据 其他配置 一些后台服务通过 HTTP 请求接收数据，这种场景下 Apache Flink 可以通过 HTTP 请求写入结果数据，目前 Apache Flink 官方未提供通过 HTTP 请求写入 数据...