-
任务结构
Shell节点 SQL节点 PROCEDURE[存储过程]节点 SPARK节点 MapReduce(MR)节点 Python节点 Flink节点 HTTP节点 DataX节点 Sqoop节点 条件分支节点 子流程节点 依赖(DEPENDENT)节点 在dolphinscheduler中创建的所有任务都保存在t_ds_process... -
CLI
Local set up Hudi CLI Bundle setup Using hudi-cli Inspecting Commits Drilling Down to a specific Commit FileSystem View Statistics Archived Commits Compactions Validate Com... -
Apache Iceberg
Support Iceberg Version Support Those Engines Description Supported DataSource Info Database Dependency Data Type Mapping Sink Options Task Example Simple: Hive Catalog: H... -
Introduction
Architecture Supported table formats Supported engines Iceberg format Paimon format Mixed format User cases Self-managed streaming Lakehouse Stream-and-batch-fused data pipe... -
SQL DDL
Spark SQL Create table Create non-partitioned table Create partitioned table Create table with record keys and ordering fields Create table from an external location Create Ta... -
Clustering
Background How is compaction different from clustering? Clustering Architecture Overall, there are 2 steps to clustering Schedule clustering Execute clustering Clustering Use... -
Kyuubi Hive JDBC Driver
Referencing the JDBC Driver Libraries Using the Driver in Java Code Maven sbt Gradle Using the Driver in a JDBC Application Registering the Driver Class Building the Connect... -
1. Terminologies
Kyuubi JDBC Apache Hive Apache Thrift Server ServerSpace Engine EngineSpace Apache Spark Multi Tenancy High Availability / Load Balance Apache Zookeeper Apache Curator ... -
Deployment
Deploying Hudi Streamer Spark Datasource Writer Jobs Upgrading Downgrading Migrating This section provides all the help you need to deploy and operate Hudi tables at scale. ... -
AWS
Enabling AWS Integration Spark Flink HTTP Client Configurations URL Connection HTTP Client Configurations Apache HTTP Client Configurations Run Iceberg on AWS Amazon Athena ...