-
Source schema and Converters
Source schema Converters Converters available in Gobblin Schema specification Supported data types by different converters Primitive types Complex types Array Map Record En... -
Code Style Guide
Overview Guideline Code Style Template File Overview The code formatting standard in this project is based on the Oracle/Sun Code Convention and Google Java Style . Guide... -
Gobblin Modules
Introduction How it works gobblin-modules/ Gobblin flavor Current flavors and modules What’s next Introduction Gobblin-modules is a way to support customization of the gobb... -
Gobblin as a Library
Using Gobblin as a Library Creating an Embedded Gobblin instance Configuring Embedded Gobblin Running Embedded Gobblin Extending Embedded Gobblin Using Gobblin as a Library ... -
Daft
Daft Daft is a distributed query engine written in Python and Rust, two fast-growing ecosystems in the data engineering and machine learning industry. It exposes its flavor of t... -
Writing ORC Data
Introduction Hive SerDe Integration Writing to an ORC File Data Flow Extending Gobblin’s SerDe Integration Introduction Gobblin is capable of writing data to ORC files by le... -
Getting Started
1. Add dependency Maven <dependency> <groupId> org.redisson </groupId> <artifactId> redisson </artifactId> <version> xVERSIONx </version> </dependency> ... -
Parquet HDFS
Description Usage Example Pipeline Configuration Configuration Developer Notes Description An extension to FsDataWriter that writes in Parquet format in the form of either... -
High Level Consumer
Problem Statement New Design & Details Problem Statement Current Gobblin Kafka High Level Consumer uses Kafka Consumer (0.8) APIs and gobblin support for them will be depreca... -
Quick Start
Quick Start Metric Contexts Metrics Events Reporters Gobblin Metrics is a metrics library for emitting metrics and events instrumenting java applications. Metrics and events...
