-
Integrations
Does AWS GLUE support Hudi ? How to override Hudi jars in EMR? Does AWS GLUE support Hudi ? AWS Glue jobs can write, read and update Glue Data Catalog for hudi tables. In order... -
Job Env Config
Common Parameter job.name jars job.mode checkpoint.interval parallelism job.retry.times shade.identifier Flink Engine Parameter Spark Engine Parameter This document desc... -
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow... -
Speed Control
Introduction Support Those Engines Configuration Introduction The SeaTunnel provides a powerful speed control feature that allows you to manage the rate at which data is synch... -
Hudi
Support Those Engines Key Features Description Supported DataSource Info Data Type Mapping Source Options Task Example Simple: Changelog 2.2.0-beta 2022-09-26 Hudi sour... -
Procedures
Spark Procedures To use Iceberg in Spark, first configure Spark catalogs . Stored procedures are only available when using Iceberg SQL extensions in Spark 3. Usage Procedures c... -
Phoenix
Description Key features Options driver [string] url [string] common options Example Changelog 2.2.0-beta 2022-09-26 Phoenix source connector Description Read Phoeni... -
Feishu
Support Those Engines Key Features Description Data Type Mapping Sink Options Task Example Simple: Changelog 2.2.0-beta 2022-09-26 Feishu sink connector Support Thos... -
Kafka-HDFS Ingestion
Getting Started Standalone MapReduce Job Constructs Source and Extractor Writer and Publisher Job Config Properties Metrics and Events Task Level Metrics Task Level Events ... -
Publishing Data to S3
Introduction Hadoop and S3 The s3a File System The s3 File System Getting Gobblin to Publish to S3 Signing Up For AWS Setting Up EC2 Launching an EC2 Instance EC2 Package I...
