-
Gobblin Metrics Performance
Generalities How to interpret these numbers What if I need larger QPS? Update Metrics Performance Multiple metric updates per iteration Multi-threading Running Performance Tes... -
Google BigQuery
Querying from Google BigQuery Iceberg tables To read an Apache XTable™ (Incubating) synced Iceberg table from BigQuery , you have two options: Using Iceberg JSON metadata file ... -
Template
Overview How to Use Templates Available Templates How to Create Your Own Template How does Template Work in Gobblin Overview The job configuration template is implemented fo... -
Connectors
Connectors Connector Source Sink CloudEvents Implements Technical Solution Structure and process Design Detail Description Worker Connector ConnectorRecord with CloudEvent... -
Snowflake
Querying from Snowflake Currently, Snowflake supports Iceberg tables through External Tables and also Native Iceberg Tables . Iceberg on Snowflake is currently supported in pub... -
Logic
and isEmpty not or cond ifElse allPass anyPass and a → b → a | b Added in v0.1.0 Returns the first argument if it is falsy, otherwise the second argument. Acts as the... -
Server-Side Scripting
LUA Scripting Redisson provides RScript object to execute Lua script. It has atomicity property and used to process data on Redis or Valkey side. Script could be executed in two ... -
Parquet HDFS
Description Usage Example Pipeline Configuration Configuration Developer Notes Description An extension to FsDataWriter that writes in Parquet format in the form of either... -
Run Java SDK Demo
Run Java SDK Demo 1. TCP 1.1 ASYNC 1.2 BROADCAST 2 HTTP 2.1 ASYNC 3 GRPC 3.1 ASYNC Publish & Webhook Subscribe 3.2 SYNC Publish & Stream Subscribe 3.3 Publish BATCH Message ... -
Gobblin Compliance Design
Introduction Design Onboarding Purger Gobblin constructs Hive operations Retention Restore Introduction The Gobblin Compliance module allows for data purging to meet reg...
