Advantages of Migrating to Gobblin Kafka Ingestion Related Job Config Properties Config properties for pulling Kafka topics Config properties for compaction Deployment and Chec...
Writing with SQL INSERT OVERWRITE INSERT INTO Upsert to table with primary keys. DELETE FROM UPDATE MERGE INTO Writing with DataFrames Appending data Overwriting data Crea...
Flink Configuration Catalog Configuration A catalog is created and named by executing the following query (replace <catalog_name> with your catalog name and <config_key> =<confi...
Description Key features Options service_account_key [string] sheet_id [string] sheet_name [string] range [string] schema [config] fields [config] Example Changelog next ...
Syncing to Unity Catalog This document walks through the steps to register an Apache XTable™ (Incubating) synced Delta table in Unity Catalog on Databricks and open-source Unity C...
Spark DDL To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. CREATE TABLE Spark...