-
Hudi
Support Those Engines Key Features Description Supported DataSource Info Data Type Mapping Source Options Task Example Simple: Changelog 2.2.0-beta 2022-09-26 Hudi sour... -
Marker Mechanism
Purpose of Markers Marker structure Marker Writing Options Direct Write Markers Timeline Server Markers (Default) Marker Configuration Parameters Purpose of Markers A write... -
Building
Build with Apache Maven Build shaded jar with Apache Maven Build against Different Apache Spark Versions Build against Different Apache Ranger Versions Test with ScalaTest Mave... -
JDBC
JDBC Catalog Configurations Examples Spark Java API JDBC Catalog Iceberg supports using a table in a relational database to manage Iceberg tables through JDBC. The database ... -
Aggregation Functions
Data Setup min Using min() with Lists max stDev stDevP percentileCont percentileDisc count Using count(expression) to return the number of values Counting non-null value... -
Rollback Mechanism
Handling partially failed commits Rolling back partially failed commits for a single writer Rolling back of partially failed commits w/ multi-writers Heartbeats Related Resourc... -
Features and Limitations
Features Limitations and Compatibility Notes General Hudi Delta Features OneTable provides users with the ability to translate metadata from one table format to another. On... -
Assert
Description Key Features Options rules [ConfigMap] field_rules [ConfigList] field_name [string] field_type [string | ConfigMap] field_value [ConfigList] rule_type [string] ... -
Http
Support Those Engines Key Features Description Supported DataSource Info Sink Options Example Changelog 2.2.0-beta 2022-09-26 Http sink connector Support Those Engine... -
Function
always comparator compose construct curry useWith flip groupBy identity invoker nAry once pipe tap binary unary always a → (* → a) Parameters valThe value to...
