-
How To Use Spark Dynamic Resource Allocation (DRA) in Kyuubi
The Basics of Dynamic Resource Allocation How to Enable Dynamic Resource Allocation Dynamic Resource Allocation w/ External Shuffle Service Dynamic Allocation w/o External Shuffl... -
3. Trouble Shooting
Trouble Shooting Common Issues java.lang.UnsupportedClassVersionError .. Unsupported major.minor version 52.0 org.apache.spark.SparkException: When running with master ‘yarn’ eith... -
任务结构
Shell节点 SQL节点 PROCEDURE[存储过程]节点 SPARK节点 MapReduce(MR)节点 Python节点 Flink节点 HTTP节点 DataX节点 Sqoop节点 条件分支节点 子流程节点 依赖(DEPENDENT)节点 在dolphinscheduler中创建的所有任务都保存在t_ds_process... -
MySQL
Support Mysql Version Support Those Engines Description Using Dependency For Spark/Flink Engine For SeaTunnel Zeta Engine Key Features Supported DataSource Info Data Type M... -
Kafka
Support Those Engines Key Features Description Supported DataSource Info Sink Options Parameter Interpretation Topic Formats Semantics Partition Key Fields Assign Partition... -
Hive
Feature support Enabling Iceberg support in Hive Hive 4.0.0-beta-1 Hive 4.0.0-alpha-2 Hive 4.0.0-alpha-1 Hive 2.3.x, Hive 3.1.x Loading runtime jar Enabling support Hadoop con... -
Kafka
Support Those Engines Key Features Description Supported DataSource Info Source Options Task Example Simple Regex Topic AWS MSK SASL/SCRAM AWS MSK IAM Kerberos Authenticat... -
Self-Optimizing
Introduction Self-optimizing mechanism Self-optimizing scheduling policy Quota Balanced Introduction Lakehouse is characterized by its openness and loose coupling, with data... -
OssFile
Support Those Engines Usage Dependency For Spark/Flink Engine For SeaTunnel Zeta Engine Key features Data Type Mapping Orc File Type Parquet File Type Options path [string]... -
Delta Lake with Microsoft Azure Blob Storage
Registration And Configuration Register An Account And Log In Create Storage Container Get Access Key Deploy Spark Download Spark Package Config Spark Copy Dependencies To Sp...
