-
Schema Evolution
Schema Evolution on Write Type Promotions Schema Evolution on read Adding Columns Altering Columns Deleting Columns Renaming columns Schema Evolution in Action Related Reso... -
Notion
Description Key features Options url [String] password [String] version [String] method [String] params [Map] body [String] poll_interval_millis [int] retry [int] retry_b... -
Table Watermark
Table freshness Table watermark Table freshness Data freshness represents timeliness, and in many discussions, freshness is considered one of the important indicators of data q... -
HiveJdbc
Support Hive Version Support Those Engines Key Features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Tips Task Example Simple... -
Procedures
Spark Procedures To use Iceberg in Spark, first configure Spark catalogs . Stored procedures are only available when using Iceberg SQL extensions in Spark 3. Usage Procedures c... -
SSO Integration
Background SSO login workflow How to enable SSO login Note Background As an enterpise practice, it’s common to apply Single sign-on (SSO) across all applications, so that use... -
DataHub
Configurations Example DataHub is a rich metadata platform that supports features like data discovery, data obeservability, federated governance, etc. Since Hudi 0.11.0, you c... -
FakeSource
Support Those Engines Description Key Features Source Options Task Example Simple: Random Generation Customize the data content Simple: Specified Data number Simple: Templa... -
Trino
Iceberg format Paimon format Mixed format Install Support SQL statement Query Table Query BaseStore of Table Query ChangeStore of Table Trino and Amoro Type Mapping: Trino ... -
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow...
