-
Logic
and isEmpty not or cond and a → b → a | b Added in v0.1.0 Returns the first argument if it is falsy, otherwise the second argument. Acts as the boolean and statement if... -
Gobblin CLI
Gobblin Commands & Execution Modes Gobblin Commands The Distcp Quick App The OneShot Quick App Developing quick apps for the CLI Implementing new Gobblin commands Gobblin Ser... -
Getting Started
Introduction Getting a Gobblin Release Building a Distribution Run Your First Job Steps Running Gobblin as a Daemon Preliminary Steps Other Example Jobs Introduction Thi... -
Procedures
Spark Procedures To use Iceberg in Spark, first configure Spark catalogs . Stored procedures are only available when using Iceberg SQL extensions in Spark 3. Usage Procedures c... -
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow... -
Flink Writes
Flink Writes Iceberg support batch and streaming writes With Apache Flink ‘s DataStream API and Table API. Writing with SQL Iceberg support both INSERT INTO and INSERT OVERWRIT... -
Gobblin on Yarn
Introduction Architecture Overview The Role of Apache Helix Gobblin Yarn Application Launcher YarnAppSecurityManager LogCopier Gobblin ApplicationMaster YarnService GobblinH... -
Configuration Glossary
Table of Contents Properties File Format Creating a Basic Properties File Job Launcher Properties Common Job Launcher Properties SchedulerDaemon Properties CliMRJobLauncher Pr... -
Job Configuration Files
Job Configuration Basics Hierarchical Structure of Job Configuration Files Password Encryption Adding or Changing Job Configuration Files Scheduled Jobs One Time Jobs Disable... -
Fork Operator
Overview of the ForkOperator Using the ForkOperator Basics of Usage Per-Fork Configuration Failure Semantics Performance Tuning Comparison with PartitionedDataWriter Writing...
