-
Spark
SPARK节点 综述 创建任务 任务参数 任务样例 spark submit 执行 WordCount 程序 在 DolphinScheduler 中配置 Spark 环境 上传主程序包 配置 Spark 节点 spark sql 执行 DDL 和 DML 语句 注意事项： SPARK节点 综述 Spark 任务类型用于执行... -
1. Terminologies
Kyuubi JDBC Apache Hive Apache Thrift Server ServerSpace Engine EngineSpace Apache Spark Multi Tenancy High Availability / Load Balance Apache Zookeeper Apache Curator ... -
扩/缩容
DolphinScheduler扩容/缩容 文档 1. DolphinScheduler扩容文档 1.1. 基础软件安装(必装项请自行安装) 1.2. 获取安装包 1.3. 创建部署用户 1.4. 修改配置 1.4. 重启集群&验证 2. 缩容 2.1 停止缩容节点上的服务 2.2 修改配置文件 DolphinScheduler扩容/... -
SQL
SQL 综述 创建数据源 创建任务 任务参数 任务样例 Hive表创建示例 在hive中创建临时表并写入数据 运行该任务成功之后在hive中查询结果 使用前置sql和后置sql示例 注意事项 SQL 综述 SQL任务类型，用于连接数据库并执行相应SQL。 创建数据源 可参考 数据源配置 数据源中心 。 创建任务 点击项... -
Spark Quick Start
Setup Spark 3 Support Matrix Spark Shell/SQL Setup project Create Table Insert data Query data Update data Merging Data Delete data Time Travel Query Incremental query ... -
Kyuubi Hive JDBC Driver
Referencing the JDBC Driver Libraries Using the Driver in Java Code Maven sbt Gradle Using the Driver in a JDBC Application Registering the Driver Class Building the Connect... -
3. Integration with Hive Metastore
Integration with Hive Metastore Requirements Default Behavior Related Configurations Remote Metastore Database Remote Metastore Server Activate Configurations Via kyuubi-defau... -
Writing Tables
What are some ways to write a Hudi table? How is a Hudi writer job deployed? Can I implement my own logic for how input records are merged with record on storage? How do I delet... -
Introduction
Architecture Supported table formats Supported engines Iceberg format Paimon format Mixed format User cases Self-managed streaming Lakehouse Stream-and-batch-fused data pipe... -
Concurrency Control
Deployment models with supported concurrency controls Model A: Single writer with inline table services Single Writer Guarantees Model B: Single writer with async table services ...
