-
Gobblin CLI
Gobblin Commands & Execution Modes Gobblin Commands The Distcp Quick App The OneShot Quick App Developing quick apps for the CLI Implementing new Gobblin commands Gobblin Ser... -
Google BigQuery
Iceberg tables Using Iceberg JSON metadata file to create the Iceberg BigLake tables : Steps to add additional configurations to the Hudi writers: Using BigLake Metastore to crea... -
Publishing Data to S3
Introduction Hadoop and S3 The s3a File System The s3 File System Getting Gobblin to Publish to S3 Signing Up For AWS Setting Up EC2 Launching an EC2 Instance EC2 Package I... -
Klaviyo
Description Key features Options url [String] private_key [String] revision [String] method [String] params [Map] body [String] poll_interval_millis [int] retry [int] ret... -
Kafka-HDFS Ingestion
Getting Started Standalone MapReduce Job Constructs Source and Extractor Writer and Publisher Job Config Properties Metrics and Events Task Level Metrics Task Level Events ... -
JuiceFS
JuiceFS configs Creating JuiceFS file system Download JuiceFS client Install JuiceFS client Format a JuiceFS file system Adding JuiceFS configuration for Hudi Adding JuiceFS H... -
DDL
CREATE TABLE PARTITIONED BY ALTER TABLE ... WRITE DISTRIBUTED BY PARTITION ALTER TABLE ... SET IDENTIFIER FIELDS ALTER TABLE ... DROP IDENTIFIER FIELDS Branching and Taggi... -
Procedures
Spark Procedures To use Iceberg in Spark, first configure Spark catalogs . Stored procedures are only available when using Iceberg SQL extensions in Spark 3. Usage Procedures c... -
远程日志存储
远程日志存储（Remote Logging） 开启远程日志存储 将任务日志写入 阿里云对象存储（OSS） 将任务日志写入 Amazon S3 将任务日志写入 Google Cloud Storage (GCS) 将任务日志写入 Azure Blob Storage (ABS) 注意事项 远程日志存储（Remote Logging） ... -
Gitlab
Description Key features Options url [String] access_token [String] method [String] params [Map] body [String] poll_interval_millis [int] retry [int] retry_backoff_multipl...
