-
名词解释
名词解释 模块介绍 在对 Apache DolphinScheduler 了解之前，我们先来认识一下调度系统常用的名词 名词解释 DAG： 全称 Directed Acyclic Graph，简称 DAG。工作流中的 Task 任务以有向无环图的形式组装起来，从入度为零的节点进行拓扑遍历，直到无后继节点为止。举例如下图： 流程定义 ：通过拖... -
Metadata Indexing
Setup Async Indexing Configurations Schedule indexing Execute Indexing Drop Index Caveats Related Resources Hudi maintains a scalable metadata that has some auxiliary data... -
LocalFile
Support Those Engines Key features Description Options path [string] file_format_type [string] read_columns [list] delimiter/field_delimiter [string] parse_partition_from_pa... -
Performance
Optimized DFS Access Performance Optimizations Write Path Bulk Insert Upserts Indexing Read Path Data Skipping Optimized DFS Access Hudi also performs several key storage... -
OceanBase
Support Those Engines Key Features Description Supported DataSource Info Database Dependency Data Type Mapping Mysql Mode Oracle Mode Source Options Tips Task Example Sim... -
Configurations
Multi-level configuration management Self-optimizing configurations Data-cleaning configurations Mixed Format configurations Reading configurations Writing configurations LogS... -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ... -
Write Operations
Operation Types UPSERT INSERT BULK_INSERT DELETE BOOTSTRAP INSERT_OVERWRITE INSERT_OVERWRITE_TABLE DELETE_PARTITION Configs Writing path Related Resources It may be he... -
Doris
Support Doris Version Support Those Engines Key Features Description Sink Options schema_save_mode[Enum] data_save_mode[Enum] save_mode_create_template Data Type Mapping Su... -
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam...
