Rewrite files action. Rewrite files action. Iceberg provides API to rewrite small files into large files by submitting Flink batch jobs. The behavior of this Flink action is the...
Syncing to BigLake Metastore This document walks through the steps to register an Apache XTable™ (Incubating) synced Iceberg table in BigLake Metastore on GCP. Pre-requisites S...
Support Connector Version Support Those Engines Description Key Features Options Task Example Simple: Multiple Sources Simple: Console Sample Data Console sink connector...
Spark DDL To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. CREATE TABLE Spark...
Engine Management Details This engine UI is able to help you understand status of the engine behind Kyuubi servers. Engine Management Details The Engine UI offers an Engine Man...
Features Usage Hive Dialect plugin aims to provide Hive Dialect support to Spark’s JDBC source. It will auto registered to Spark and applied to JDBC sources with url prefix of j...
Getting Started The latest version of Iceberg is 1.8.1 . Spark is currently the most feature-rich compute engine for Iceberg operations. We recommend you to get started with Spar...
Hive Connector Integration Dependencies Configurations Hive Connector Operations The Kyuubi Hive Connector is a datasource for both reading and writing Hive table, It is imple...
Iceberg Dell Integration Dell ECS Integration Iceberg can be used with Dell’s Enterprise Object Storage (ECS) by using the ECS catalog since 0.15.0. See Dell ECS for more infor...
Writing with SQL INSERT OVERWRITE INSERT INTO Upsert to table with primary keys. DELETE FROM UPDATE MERGE INTO Writing with DataFrames Appending data Overwriting data Crea...