-
Amazon EMR
Amazon EMR 综述 任务参数 任务样例 创建EMR集群并运行Steps 向运行中的EMR集群添加Step 注意事项： Amazon EMR 综述 Amazon EMR 任务类型，用于在AWS上操作EMR集群并执行计算任务。 后台使用 aws-java-sdk 将JSON参数转换为任务对象，提交到AWS，目前支持两种程序类型： ... -
特性
简单易用 丰富的使用场景 High Reliability High Scalability 简单易用 可视化 DAG : 用户友好的，通过拖拽定义工作流的，运行时控制工具 模块化操作 : 模块化有助于轻松定制和维护。 丰富的使用场景 支持多种任务类型 : 支持Shell、MR、Spark、SQL等10余种任务类型，支持跨语言，易于扩展 ... -
Branching and Tagging
Branching and Tagging Overview Iceberg table metadata maintains a snapshot log, which represents the changes applied to a table. Snapshots are fundamental in Iceberg as they are ... -
Gluten
Building(with velox Backend) Build gluten velox backend package Usage Installing Configure Gluten is a Spark plugin developed by Intel, designed to accelerate Apache Spark w... -
Batch Reads
Spark DataSource API Daft Spark DataSource API The hudi-spark module offers the DataSource API to read a Hudi table into a Spark DataFrame. A time-travel query example: val ... -
1. Building Kyuubi
Building Kyuubi Building Kyuubi with Apache Maven Building a Submodule Individually Building Submodules Individually Skipping Some modules Building Kyuubi against Different Apa... -
Building A Runnable Distribution
To create a Kyuubi distribution like those distributed by Kyuubi Release Page , and that is laid out to be runnable, use ./build/dist in the project root directory. For more inf... -
Slack
Support Those Engines Key features Description Data Type Mapping Options Task Example Simple: Changelog new version Slack sink connector Support Those Engines Spark... -
AmazonSqs
Support Those Engines Description Key Features Sink Options Task Example Amazon SQS sink connector Support Those Engines Spark Flink SeaTunnel Zeta Description Writ... -
Socket
Support Those Engines Key features Description Data Type Mapping Options How to Create a Socket Data Synchronization Jobs Socket source connector Support Those Engines ...
