-
SQL Lineage Support
Introduction Example Lineage specific identification SQL type support Query Command Building Build with Apache Maven Build against Different Apache Spark Versions Test with... -
Configuration
Catalogs Catalog configuration Using catalogs Replacing the session catalog Using catalog specific Hadoop configuration values Loading a custom catalog SQL Extensions Runtim... -
Hive Metastore
Syncing to Hive Metastore Pre-requisites Steps Running sync Register the target table in Hive Metastore Conclusion Syncing to Hive Metastore This document walks through the... -
Catalogs
Introduce multi-catalog How to use Future work Introduce multi-catalog A catalog is a metadata namespace that stores information about databases, tables, views, indexes, users... -
Overview
What is Apache Hudi Core Concepts to Learn Getting Started Connect With The Community Join in on discussions Come to Office Hours for help Community Calls Contribute Welco... -
LocalFile
Support Those Engines Key features Description Options path [string] file_format_type [string] read_columns [list] delimiter/field_delimiter [string] parse_partition_from_pa... -
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam... -
Overview
Table format (aka. format) was first proposed by Iceberg, which can be described as follows: It defines the relationship between tables and files, and any engine can query and r... -
Getting Started
Using Iceberg in Spark 3 Adding catalogs Creating a table Writing Reading Next steps The latest version of Iceberg is 1.5.2 . Spark is currently the most feature-rich compu... -
Configurations
Multi-level configuration management Self-optimizing configurations Data-cleaning configurations Mixed Format configurations Reading configurations Writing configurations LogS...
