-
Configuration
Catalogs Catalog configuration Using catalogs Replacing the session catalog Using catalog specific Hadoop configuration values Loading a custom catalog SQL Extensions Runtim... -
Getting Started
Using Iceberg in Spark 3 Adding catalogs Creating a table Writing Reading Next steps The latest version of Iceberg is 1.5.2 . Spark is currently the most feature-rich compu... -
Maintenance
Recommended Maintenance Expire Snapshots Remove old metadata files Delete orphan files Optional Maintenance Compact data files Rewrite manifests Maintenance operations req... -
Apache Iceberg
Support Iceberg Version Support Those Engines Key features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Task Example Simple: ... -
Overview
Table format (aka. format) was first proposed by Iceberg, which can be described as follows: It defines the relationship between tables and files, and any engine can query and r... -
Catalogs
Introduce multi-catalog How to use Future work Introduce multi-catalog A catalog is a metadata namespace that stores information about databases, tables, views, indexes, users... -
Hive Metastore
Syncing to Hive Metastore Pre-requisites Steps Running sync Register the target table in Hive Metastore Conclusion Syncing to Hive Metastore This document walks through the... -
Configurations
Multi-level configuration management Self-optimizing configurations Data-cleaning configurations Mixed Format configurations Reading configurations Writing configurations LogS... -
Partitioning
What is partitioning? What does Iceberg do differently? Partitioning in Hive Problems with Hive partitioning Iceberg’s hidden partitioning What is partitioning? Partitioning... -
Java Custom Catalog
Custom table operations implementation Custom file IO implementation Custom location provider implementation Custom IcebergSource It’s possible to read an iceberg table either...
