-
Solution for Big Result Sets
Incremental collection Use in single connections Change incremental collection mode in session Typically, when a user submits a SELECT query to Spark SQL engine, the Driver cal... -
Configuration
Spark Configuration Catalogs Spark adds an API to plug in table catalogs that are used to load, create, and manage Iceberg tables. Spark catalogs are configured by setting Spark ... -
Choose Services
Steps Next Step More Information Based on the Stack chosen during the Select Stack step, you are presented with the choice of Services to install into the cluster. A Stack com... -
Manage Applications against Extra Cluster Managers
Build A Custom Application Operation Enable Custom Application Operation New in version 1.6.0. unstable Inside Kyuubi, the Kyuubi server uses the ApplicationManager module... -
Event Listener
Introduction Support Those Engines API Event Data API Event Listener API Event Collect API Configuration Listener Zeta Engine Flink Engine Spark Engine Introduction The... -
IBM Cloud
IBM COS configs IBM Cloud Object Storage Credentials IBM Cloud Object Storage Libs In this page, we explain how to get your Hudi spark job to store into IBM Cloud Object Storag... -
Spark Configuration
Catalogs configuration Using Mixed-Format in a standalone catalog Using Mixed-Format in session catalog The high availability configuration Catalogs configuration Using Mixe... -
Gluten
Building(with velox Backend) Build gluten velox backend package Usage Installing Configure Gluten is a Spark plugin developed by Intel, designed to accelerate Apache Spark w... -
Writes
Spark Writes To use Iceberg in Spark, first configure Spark catalogs . Some plans are only available when using Iceberg SQL extensions in Spark 3. Iceberg uses Apache Spark’s D... -
Batch Reads
Spark DataSource API Daft Spark DataSource API The hudi-spark module offers the DataSource API to read a Hudi table into a Spark DataFrame. A time-travel query example: val ...
