-
Deploy Kyuubi On Kubernetes
Requirements Kyuubi Official Docker Image Build Kyuubi Docker Image Deploy [Optional] ServiceAccount Config Connect TODO Requirements To deploy Kyuubi on Kubernetes, you’... -
Rabbitmq
Description Key features Options host [string] port [int] virtual_host [string] username [string] password [string] url [string] queue_name [string] schema [Config] fields... -
Kyuubi v.s. HiveServer2
Kyuubi v.s. HiveServer2 Introduction Hive on Spark Differences Between Kyuubi and HiveServer2 Performance References Kyuubi v.s. HiveServer2 Introduction HiveServer2 is a ... -
AWS S3
AWS configs AWS Credentials AWS Libs AWS S3 Versioned Bucket In this page, we explain how to get your Hudi spark job to store into AWS S3. AWS configs There are two configur... -
Flink DDL
Create catalogs Flink SQL YAML configuration CREATE statement CREATE DATABASE CREATE TABLE PARTITIONED BY CREATE TABLE LIKE DROP statement DROP DATABASE DROP TABLE SHOW ... -
Post-commit Callback
HTTP Endpoints Kafka Endpoints Pulsar Endpoints Bring your own implementation Apache Hudi provides the ability to post a callback notification about a write commit. This may b... -
Hudi
Support Those Engines Key Features Description Supported DataSource Info Data Type Mapping Source Options Task Example Simple: Changelog 2.2.0-beta 2022-09-26 Hudi sour... -
AWS Glue Data Catalog
Configurations Avoid creating excessive versions Glue Data Catalog specific configs Other references Running AWS Glue Catalog Sync for Spark DataSource Running AWS Glue Catalog... -
Marker Mechanism
Purpose of Markers Marker structure Marker Writing Options Direct Write Markers Timeline Server Markers (Default) Marker Configuration Parameters Purpose of Markers A write... -
Google BigQuery
Iceberg tables Using Iceberg JSON metadata file to create the Iceberg BigLake tables : Steps to add additional configurations to the Hudi writers: Using BigLake Metastore to crea...
