-
Building
Build with Apache Maven Build shaded jar with Apache Maven Build against Different Apache Spark Versions Build against Different Apache Ranger Versions Test with ScalaTest Mave... -
Hive
Description Key features Options table_name [string] metastore_uri [string] hdfs_site_path [string] read_partitions [list] krb5_path [string] kerberos_principal [string] ke... -
Marker Mechanism
Purpose of Markers Marker structure Marker Writing Options Direct Write Markers Timeline Server Markers (Default) Marker Configuration Parameters Purpose of Markers A write... -
AWS S3
AWS configs AWS Credentials AWS Libs AWS S3 Versioned Bucket In this page, we explain how to get your Hudi spark job to store into AWS S3. AWS configs There are two configur... -
Iceberg
Iceberg Integration Dependencies Configurations Iceberg Operations Apache Iceberg is an open table format for huge analytic datasets. Iceberg adds tables to compute engines in... -
JDBC
JDBC Catalog Configurations Examples Spark Java API JDBC Catalog Iceberg supports using a table in a relational database to manage Iceberg tables through JDBC. The database ... -
AWS Glue Data Catalog
Configurations Avoid creating excessive versions Glue Data Catalog specific configs Other references Running AWS Glue Catalog Sync for Spark DataSource Running AWS Glue Catalog... -
Kyuubi Migration Guide
Upgrading from Kyuubi 1.8 to 1.9 Upgrading from Kyuubi 1.8.0 to 1.8.1 Upgrading from Kyuubi 1.7 to 1.8 Upgrading from Kyuubi 1.7.1 to 1.7.2 Upgrading from Kyuubi 1.7.0 to 1.7.1... -
Kyuubi v.s. HiveServer2
Kyuubi v.s. HiveServer2 Introduction Hive on Spark Differences Between Kyuubi and HiveServer2 Performance References Kyuubi v.s. HiveServer2 Introduction HiveServer2 is a ... -
Oracle Cloud Infrastructure
OCI Configs Configuring the HDFS Connector Libraries Construct an OCI HDFS URI The Oracle Object Storage system provides strongly-consistent operations on all buckets in all ...
