-
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow... -
PersistenceManager
Persist Objects Retrieve Objects Update Objects Delete Objects Making an object transient Any JDO-enabled application will require at least one PersistenceManager (PM). This ... -
Elasticsearch
Description Key features Options hosts [array] index [string] index_type [string] primary_keys [list] key_delimiter [string] username [string] password [string] max_retry_... -
JDO v JPA
There are several competing persistence technologies available for Java. Two of these are “standardised” (via the JCP). When developing your application you need to choose the mos... -
FakeSource
Support Those Engines Description Key Features Source Options Task Example Simple: Random Generation Customize the data content Simple: Specified Data number Simple: Templa... -
Trino
Iceberg format Paimon format Mixed format Install Support SQL statement Query Table Query BaseStore of Table Query ChangeStore of Table Trino and Amoro Type Mapping: Trino ... -
File Sizing
Auto-sizing during writes File sizing for Copy-On-Write (COW) and Merge-On-Read (MOR) tables More details about file sizing for Merge-On-Read(MOR) tables Configs Auto-Sizing Wi... -
Getting Started
Introduction Getting a Gobblin Release Building a Distribution Run Your First Job Steps Running Gobblin as a Daemon Preliminary Steps Other Example Jobs Introduction Thi... -
Function
always comparator compose construct curry useWith flip groupBy identity invoker nAry once pipe tap binary unary ap empty of constructN converge curryN alway... -
Using Logstore
Real-Time data in LogStore Overview Prerequisites for using LogStore Double write LogStore and FileStore Due to the limitations of traditional offline data warehouse architect...
