-
参数优先级
参数优先级 例子 参数优先级 DolphinScheduler 中所涉及的参数值的定义可能来自三种类型： 项目级别参数 ：在项目管理中定义的项目级别参数 全局参数 ：在工作流保存页面定义时定义的变量 启动参数 ：在工作流启动页面定义的变量 上游任务传递的参数 ：上游任务传递过来的参数 本地参数 ：节点的自有变量，用户在“自定义参数”定义的变量，并... -
PyDolphinScheduler
PyDolphinScheduler PyDolphinScheduler PyDolphinScheduler 是 Apache DolphinScheduler 的 Python API，它允许您通过 Python 代码定义您的工作流，也称为 workflow-as-codes。 更多信息请参考PyDolphinScheduler -
State Management and Watermarks
Managing Watermarks in a Job Basics Task Failures Multi-Dataset Jobs Gobblin State Deep Dive State class hierarchy How States are Used in a Gobblin Job This page has two p... -
FAQs
Gobblin General Questions What is Gobblin? What programming languages does Gobblin support? Does Gobblin require any external software to be installed? What Hadoop versions can ... -
Microsoft Azure
Disclaimer Supported Storage System Verified Combination of Spark and storage system HDInsight Spark2.4 on Azure Data Lake Storage Gen 2 Databricks Spark2.4 on Azure Data Lake S... -
Socket
Support Those Engines Key features Description Sink Options Task Example Changelog 2.2.0-beta 2022-09-26 Socket sink connector Support Those Engines Spark Flink SeaTu... -
Streaming Reads
Spark Streaming Spark Streaming Structured Streaming reads are based on Hudi’s Incremental Query feature, therefore streaming read can return data for which commits and base fil... -
Phoenix
Description Key features Options driver [string] url [string] common options Example Changelog 2.2.0-beta 2022-09-26 Phoenix sink connector Description Write Phoenix... -
Configure Kyuubi to use Custom EventHandler
Build A Custom EventHandler Enable Custom EventHandler Kyuubi provide event processing mechanism, it can help us to record some events. Beside the builtin JsonLoggingEventHandle... -
Configuring a Database Instance for Ranger
A MySQL, Oracle, PostgreSQL, or Amazon RDS database instance must be running and available to be used by Ranger. The Ranger installation will create two new users (default names: ...
