-
Metadata Indexing
Setup Async Indexing Configurations Schedule indexing Execute Indexing Drop Index Caveats Related Resources Hudi maintains a scalable metadata that has some auxiliary data... -
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :... -
Catalogs
Introduce multi-catalog How to use Future work Introduce multi-catalog A catalog is a metadata namespace that stores information about databases, tables, views, indexes, users... -
Hive Metastore
Syncing to Hive Metastore Pre-requisites Steps Running sync Register the target table in Hive Metastore Conclusion Syncing to Hive Metastore This document walks through the... -
SQL Procedures
Usage Named arguments Positional arguments help Commit management show_commits show_commits_metadata show_commit_extra_metadata show_archived_commits show_archived_commits_... -
Connector Release Status
Connector V2 Health SeaTunnel uses a grading system for connectors to help you understand what to expect from a connector: Alpha Beta General Availability (GA) Expec... -
Record Payload
Background Configs Existing Payloads OverwriteWithLatestAvroPayload DefaultHoodieRecordPayload EventTimeAvroPayload OverwriteNonDefaultsWithLatestAvroPayload PartialUpdateAvr... -
Unity Catalog
Syncing to Unity Catalog Pre-requisites Steps Running sync Register the target table in Unity Catalog Validating the results Conclusion Syncing to Unity Catalog This docum... -
Key Generation
Key Generators SimpleKeyGenerator ComplexKeyGenerator NonpartitionedKeyGenerator CustomKeyGenerator Bring your own implementation TimestampBasedKeyGenerator Timestamp is GMT ... -
Overview
Table format (aka. format) was first proposed by Iceberg, which can be described as follows: It defines the relationship between tables and files, and any engine can query and r...