-
Kafka Connect
Kafka Connect Kafka Connect is a popular framework for moving data in and out of Kafka via connectors. There are many different connectors available, such as the S3 sink for writ... -
Type
is type isNil propIs is (* → {*}) → a → Boolean Parameters ctorA constructor valThe value to test Returns Boolean Added in v0.3.0 See if an object (i.e. val ) is a... -
Type
is type isNil is (* → {*}) → a → Boolean Parameters ctorA constructor valThe value to test Returns Boolean Added in v0.3.0 See if an object (i.e. val ) is an instan... -
Creating your first interoperable table
Creating your first interoperable table Using Apache XTable™ (Incubating) to sync your source tables in different target format involves running sync on your current dataset usi... -
Getting Started
Introduction Getting a Gobblin Release Building a Distribution Run Your First Job Steps Running Gobblin as a Daemon Preliminary Steps Other Example Jobs Introduction Thi... -
Gobblin CLI
Gobblin Commands & Execution Modes Gobblin Commands The Distcp Quick App The OneShot Quick App Developing quick apps for the CLI Implementing new Gobblin commands Gobblin Ser... -
Procedures
Spark Procedures To use Iceberg in Spark, first configure Spark catalogs . Stored procedures are only available when using Iceberg SQL extensions in Spark 3. Usage Procedures c... -
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow... -
Hive Metastore
Syncing to Hive Metastore This document walks through the steps to register an Apache XTable™ (Incubating) synced table on Hive Metastore (HMS). Pre-requisites Source table(s) ... -
Flink Writes
Flink Writes Iceberg support batch and streaming writes With Apache Flink ‘s DataStream API and Table API. Writing with SQL Iceberg support both INSERT INTO and INSERT OVERWRIT...
