-
Write Operations
Operation Types UPSERT INSERT BULK_INSERT DELETE BOOTSTRAP INSERT_OVERWRITE INSERT_OVERWRITE_TABLE DELETE_PARTITION Configs Writing path Related Resources It may be he... -
2. Deploy Kyuubi engines on Kubernetes
Deploy Kyuubi engines on Kubernetes Requirements Configurations Master Docker Image Test Cluster ServiceAccount Volumes PodTemplateFile Other Deploy Kyuubi engin... -
My Hours
Support Those Engines Key Features Description Key features Supported DataSource Info Source Options How to Create a My Hours Data Synchronization Jobs Parameter Interpretat... -
Apache Iceberg
Support Iceberg Version Support Those Engines Key features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Task Example Simple: ... -
Integration with Hive Metastore
Requirements Default Behavior Related Configurations Remote Metastore Database Remote Metastore Server Activate Configurations Via kyuubi-defaults.conf Via hive-site.xml Via... -
Bootstrapping
Approaches Use Hudi for new partitions alone Convert existing table to Hudi Using Hudi Streamer Using Spark Datasource Writer Using Spark SQL CALL Procedure Using Hudi CLI C... -
Google BigQuery
Sync Modes Manifest File Benefits of using the new manifest approach: View Over Files (Legacy) Configurations Partition Handling Example Hudi tables can be queried from Goo... -
Datasource SPI
DolphinScheduler Datasource SPI 主要设计 如何使用数据源？ 如何进行数据源插件开发？ 未来计划 DolphinScheduler Datasource SPI 主要设计 如何使用数据源？ 数据源中心默认支持POSTGRESQL、HIVE/IMPALA、SPARK、CLICKHOUSE、SQLSERVER数据源。... -
1. Deploy Kyuubi engines on Yarn
Deploy Kyuubi engines on Yarn Requirements Configurations Environment Spark Properties Master Queue Sizing Tuning Others Kerberos Deploy Kyuubi engines on Yarn ... -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ...