-
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :... -
Compaction
Background Why MOR tables need compaction? Compaction Architecture Strategies in Compaction Scheduling Trigger Strategies Compaction Strategies Ways to trigger Compaction Inl... -
Bootstrapping
Approaches Use Hudi for new partitions alone Convert existing table to Hudi Using Hudi Streamer Using Spark Datasource Writer Using Spark SQL CALL Procedure Using Hudi CLI C... -
Vertica
Description Support Those Engines Using Dependency For Spark/Flink Engine For SeaTunnel Zeta Engine Key Features Supported DataSource Info Data Type Mapping Source Options ... -
Snowflake
Support Those Engines Key Features Description Supported DataSource list Database dependency Data Type Mapping Options tips Task Example simple: CDC(Change data capture) e... -
OssJindoFile
Description Key features Options path [string] bucket [string] access_key [string] access_secret [string] endpoint [string] custom_filename [boolean] file_name_expression [... -
Java Custom Catalog
Custom table operations implementation Custom file IO implementation Custom location provider implementation Custom IcebergSource It’s possible to read an iceberg table either... -
HdfsFile
Support Those Engines Key Features Description Supported DataSource Info Source Options delimiter/field_delimiter [string] compress_codec [string] encoding [string] Tips T... -
CosFile
Description Key Features Options path [string] bucket [string] secret_id [string] secret_key [string] region [string] custom_filename [boolean] file_name_expression [string... -
SftpFile
Support Those Engines Key Features Description Supported DataSource Info Data Type Mapping Source Options file_format_type [string] compress_codec [string] encoding [string]...
