-
Apache Hudi Stack
Lake Storage File Formats Transactional Database Layer Table Format Indexes Table Services Clustering Compaction Cleaning Indexing Concurrency Control Lake Cache* Metase... -
JDBC Connector
JDBC 信息配置 semantic 语义配置 EXACTLY_ONCE AT_LEAST_ONCE && NONE 其他配置 JDBC 读取数据 queryFunc获取一条sql resultFunc 处理查询到的数据 JDBC 读取写入 根据数据流生成目标SQL 设置写入批次大小 多实例 JDBC 支持 手动指定 JDBC 连接信... -
Using Spark
Hudi Streamer Options Using hudi-utilities bundle jars Concurrency Control Checkpointing Transformers SQL Query Transformer SQL File Transformer Flattening Transformer Chai... -
FAQs
Why should I install a computing engine like Spark or Flink? I have a question, and I cannot solve it by myself How do I declare a variable? How do I write a configuration item ... -
Docker Demo
A Demo using Docker containers Prerequisites Setting up Docker Cluster Build Hudi Bringing up Demo Cluster Demo Step 1 : Publish the first batch to Kafka Step 2: Incrementall... -
Configurations
Environments Kyuubi Configurations Authentication Backend Batch Credentials Ctl Delegation Engine Event Frontend Ha Kinit Kubernetes Lineage Metadata Metrics Operat... -
HTTP Connector
HTTP 异步写入 Apache StreamPark™ 方式写入 http异步写入支持类型 http异步写入配置参数列表 http异步写入数据 其他配置 一些后台服务通过 HTTP 请求接收数据，这种场景下 Apache Flink 可以通过 HTTP 请求写入结果数据，目前 Apache Flink 官方未提供通过 HTTP 请求写入 数据... -
Writing Tables
What are some ways to write a Hudi table? How is a Hudi writer job deployed? Can I implement my own logic for how input records are merged with record on storage? How do I delet... -
Apache Doris Connector
Apache StreamPark™ 方式写入 配置信息 写入 Doris Apache Doris 是一款基于大规模并行处理技术的分布式 SQL 数据库，主要面向 OLAP 场景。 Apache StreamPark 基于 Doris 的 stream load 封装了 DoirsSink 用于向 Doris 实时写入数据。 Apache ... -
Introduction
Architecture Supported table formats Supported engines Iceberg format Paimon format Mixed format User cases Self-managed streaming Lakehouse Stream-and-batch-fused data pipe...