-
Gobblin CLI
Gobblin Commands & Execution Modes Gobblin Commands The Distcp Quick App The OneShot Quick App Developing quick apps for the CLI Implementing new Gobblin commands Gobblin Ser... -
OpenMldb
Description Key features Options cluster_mode [string] sql [string] database [string] host [string] port [int] zk_host [string] zk_path [string] session_timeout [int] req... -
Procedures
Spark Procedures To use Iceberg in Spark, first configure Spark catalogs . Stored procedures are only available when using Iceberg SQL extensions in Spark 3. Usage Procedures c... -
Flink Writes
Flink Writes Iceberg support batch and streaming writes With Apache Flink ‘s DataStream API and Table API. Writing with SQL Iceberg support both INSERT INTO and INSERT OVERWRIT... -
Publishing Data to S3
Introduction Hadoop and S3 The s3a File System The s3 File System Getting Gobblin to Publish to S3 Signing Up For AWS Setting Up EC2 Launching an EC2 Instance EC2 Package I... -
在 Postgres 中配置 SAM 和 Schema Registry 元数据存储
关于此任务 步骤 关于此任务 如果您已经安装了 MySQL 并使用 MySQL 配置了 SAM 和架构注册表元数据存储，则无需在 Postgres 中配置其他元数据存储。 步骤 登录Postgres： sudo su postgres psql 创建一个名为 registry 的数据库，密码为 registry ： ... -
Kafka-HDFS Ingestion
Getting Started Standalone MapReduce Job Constructs Source and Extractor Writer and Publisher Job Config Properties Metrics and Events Task Level Metrics Task Level Events ... -
GoogleSheets
Description Key features Options service_account_key [string] sheet_id [string] sheet_name [string] range [string] schema [config] fields [config] Example Changelog next ... -
SQL
Description Options source_table_name [string] query [string] Example Struct query Job Config Example Changelog new version SQL transform plugin Description Use SQL ... -
Configuring SAM and Schema Registry Metadata Stores in MySQL
Steps Steps Launch the MySQL monitor: mysql - u root - p Create the database for Schema Registry and SAM metastore: create database registry ; create database str...
