-
Indexing
Indexing Multi-modal Indexing Index Types in Hudi Global and Non-Global Indexes Configs Spark based configs Flink based configs Indexing Strategies Workload 1: Late arriving... -
How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
The Basics of AQE Dynamically Switch Join Strategies Dynamically Coalesce Shuffle Partitions Other Tips for Best Practises How to set spark.sql.adaptive.advisoryPartitionSizeInByt... -
How to read this book
References It is recommended that readers have a basic understanding of R Markdown. Chapter 2 of R Markdown: The Definitive Guide [@rmarkdown2018] provides an overview of the ba... -
Creating your first interoperable table
Pre-requisites Steps Initialize a pyspark shell Create dataset Running sync Conclusion Next steps Using OneTable to sync your source tables in different target format invo... -
How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
The Basics of Dynamic Resource Allocation How to Enable Dynamic Resource Allocation Dynamic Resource Allocation w/ External Shuffle Service Dynamic Allocation w/o External Shuffl... -
On Disk Encryption
Configuration Encrypting All Tables Per Table Encryption Disabling Crypto Custom Crypto Things to keep in mind Utilities need access to encryption properties Some data will b... -
Using the SpotBugs Ant task
Installing the Ant task Modifying build.xml Executing the task Parameters This chapter describes how to integrate SpotBugs into a build script for Ant, which is a popular Java... -
Hive
Feature support Enabling Iceberg support in Hive Hive 4.0.0-beta-1 Hive 4.0.0-alpha-2 Hive 4.0.0-alpha-1 Hive 2.3.x, Hive 3.1.x Loading runtime jar Enabling support Hadoop con... -
Ogg Format
Format Options How to use Ogg format Kafka uses example Oracle GoldenGate (a.k.a ogg) is a managed service providing a real-time data mesh platform, which uses replication to ... -
config
Intro to config file Example Config file structure hocon multi-line support json env source transform sink Other Config variable substitution What’s More Intro to co...
