-
Configuration
Spark Configuration Catalogs Spark adds an API to plug in table catalogs that are used to load, create, and manage Iceberg tables. Spark catalogs are configured by setting Spark ... -
Branching and Tagging
Branching and Tagging Overview Iceberg table metadata maintains a snapshot log, which represents the changes applied to a table. Snapshots are fundamental in Iceberg as they are ... -
Logic
and isEmpty not or cond ifElse allPass anyPass defaultTo both complement either propSatisfies unless when pathSatisfies until and a → b → a | b Added in v0.1.... -
State Management and Watermarks
Managing Watermarks in a Job Basics Task Failures Multi-Dataset Jobs Gobblin State Deep Dive State class hierarchy How States are Used in a Gobblin Job This page has two p... -
Schedulers
Introduction Quartz Azkaban Oozie Launching Gobblin in Local Mode Example Config Files Uploading Files to HDFS Adding Gobblin jar Dependencies Launching the Job Launching ... -
Logic
and isEmpty not or cond ifElse allPass anyPass defaultTo both complement either and a → b → a | b Added in v0.1.0 Returns the first argument if it is falsy, other... -
Logic
and isEmpty not or cond ifElse allPass anyPass defaultTo both complement either propSatisfies unless when and a → b → a | b Added in v0.1.0 Returns the first a... -
Retention
Introduction Design Overview of Gobblin Config Management Library Retention Constructs DatasetCleaner DatasetFinder ManagedCleanableDatasetFinder ConfigurableCleanableDataset ... -
Logic
and isEmpty not or cond ifElse allPass anyPass defaultTo both complement either and a → b → a | b Added in v0.1.0 Returns the first argument if it is falsy, other... -
Command usage
Command Entrypoint Options Example Command Entrypoint Spark 2 bin / start - seatunnel - spark - 2 - connector - v2 . sh Spark 3 bin / start - seatunnel - spark - 3...
