-
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
Hadoop Resource Integration
Using Apache Hadoop resource in Flink on Kubernetes 1. Apache HDFS 1.1 Add the shaded jar 1.2. add core-site.xml and hdfs-site.xml 2. Apache Hive 2.1. Add Hive-related jars 2... -
Elasticsearch Connector
Dependency of elastic writing Write data to Elasticsearch based on the official Using Apache StreamPark™ writes to Elasticsearch 1. 配置策略和连接信息 2. 写入Elasticsearch Other configur... -
1. Kyuubi On Apache Kudu
Kyuubi On Apache Kudu What is Apache Kudu Why Kyuubi on Kudu Kudu Integration with Apache Spark Kudu Integration with Kyuubi Install Kudu Spark Dependency Start Kyuubi Start B... -
Deployment
Deploying Hudi Streamer Spark Datasource Writer Jobs Upgrading Downgrading Migrating This section provides all the help you need to deploy and operate Hudi tables at scale. ... -
CDC Ingestion
Ingest into one table Iceberg format Mixed-Iceberg format Ingest Into multiple tables Iceberg format Mixed-Iceberg format CDC stands for Change Data Capture, which is a broa... -
Hive Metastore
Spark Data Source example Query using HiveQL Use partition extractor properly Hive Sync Tool Hive Sync Configuration Sync modes HMS JDBC HIVEQL Flink Setup Install Hive E... -
准备设置本地存储库
步骤 RHEL/CentOS/Oracle/Amazon Linux: SLES: Debian/Ubuntu: 下一步 更多信息 在设置本地存储库之前，您必须满足某些要求。 选择集群中或可访问的运行受支持操作系统的现有服务器。 启用集群中所有主机对镜像服务器的网络访问。 确保镜像服务器安装了包管理器，例如 yum（适用于 RHEL、Cen... -
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :...