-
Setup
User Manual (2.x and 3.x) Master/Manager naming Setup for testing or development Setup for Production Configuring Accumulo Initialization Run Accumulo Run individual Accumulo... -
任务结构
Shell节点 SQL节点 PROCEDURE[存储过程]节点 SPARK节点 MapReduce(MR)节点 Python节点 Flink节点 HTTP节点 DataX节点 Sqoop节点 条件分支节点 子流程节点 依赖(DEPENDENT)节点 在dolphinscheduler中创建的所有任务都保存在t_ds_process... -
Hadoop 资源集成
在 Flink on Kubernetes 上使用 Apache Hadoop 资源 1. Apache HDFS 1.1 添加 shade jar 1.2、添加 core-site.xml 和 hdfs-site.xml 2、Apache Hive i、添加 hive 相关的 jar 2.1. 添加 hive 的配置文件（hive-site.x... -
Nessie
Enabling Nessie Catalog Spark SQL Extensions Nessie Catalog Nessie and Iceberg Loosely coupled transactions Experimentation Further use cases Example Future Improvements ... -
SQL DDL
Spark SQL Create table Create non-partitioned table Create partitioned table Create table with record keys and ordering fields Create table from an external location Create Ta... -
Design
Background Data Model Architecture Components Tablet Server Garbage Collector Manager Tracer Monitor Compactor (experimental) Compaction Coordinator (experimental) Scan S... -
Using Plugins
Introduction Official plugins Plugin type Build Prerequisites Command Build docker image with plugin from answer base image Third-party plugin Usage Upgrade Develop and c... -
CLI
Local set up Hudi CLI Bundle setup Using hudi-cli Inspecting Commits Drilling Down to a specific Commit FileSystem View Statistics Archived Commits Compactions Validate Com... -
告警通知
webapi.conf server.conf 夜莺告警通知，内置支持邮件、钉钉机器人、企微机器人、飞书机器人多种方式作为发送通道，也支持调用自定义脚本和Webhook，给用户自定义发送通道的能力。相关配置在 webapi.conf 和 server.conf 中都有涉及。这里分别讲解。 webapi.conf [[ NotifyChannels ... -
Apache Iceberg
Support Iceberg Version Support Those Engines Description Supported DataSource Info Database Dependency Data Type Mapping Sink Options Task Example Simple: Hive Catalog: H...
