-
Docker Demo
A Demo using Docker containers Prerequisites Setting up Docker Cluster Build Hudi Bringing up Demo Cluster Demo Step 1 : Publish the first batch to Kafka Step 2: Incrementall... -
编程模型
架构 编程模型 DataStream Flink Sql TableEnvironment StreamTableEnvironment RunTime Context StreamingContext TableContext StreamTableContext 生命周期 生命周期之 — init 生命周期之 — config 生... -
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
Clustering
Background How is compaction different from clustering? Clustering Architecture Overall, there are 2 steps to clustering Schedule clustering Execute clustering Clustering Use... -
安全中心（权限系统）
安全中心（权限系统） 创建队列 添加租户 创建普通用户 编辑用户信息 修改用户密码 创建告警组 令牌管理 授予权限 Worker 分组 新增 / 更新 worker 分组 环境管理 集群管理 命名空间管理 安全中心（权限系统） 安全中心只有管理员账户才有权限操作，分别有队列管理、租户管理、用户管理、告警组管理、worker分... -
JDBC Connector
JDBC 信息配置 semantic 语义配置 EXACTLY_ONCE AT_LEAST_ONCE && NONE 其他配置 JDBC 读取数据 queryFunc获取一条sql resultFunc 处理查询到的数据 JDBC 读取写入 根据数据流生成目标SQL 设置写入批次大小 多实例 JDBC 支持 手动指定 JDBC 连接信... -
CLI
Local set up Hudi CLI Bundle setup Using hudi-cli Inspecting Commits Drilling Down to a specific Commit FileSystem View Statistics Archived Commits Compactions Validate Com... -
1. Kyuubi On Apache Kudu
Kyuubi On Apache Kudu What is Apache Kudu Why Kyuubi on Kudu Kudu Integration with Apache Spark Kudu Integration with Kyuubi Install Kudu Spark Dependency Start Kyuubi Start B... -
Deployment
Deploying Hudi Streamer Spark Datasource Writer Jobs Upgrading Downgrading Migrating This section provides all the help you need to deploy and operate Hudi tables at scale. ...
