-
Java Custom Catalog
Custom Catalog It’s possible to read an iceberg table either from an hdfs path or from a hive table. It’s also possible to use a custom metastore in place of hive. The steps to do... -
Source schema and Converters
Source schema Converters Converters available in Gobblin Schema specification Supported data types by different converters Primitive types Complex types Array Map Record En... -
Publishing Data to S3
Introduction Hadoop and S3 The s3a File System The s3 File System Getting Gobblin to Publish to S3 Signing Up For AWS Setting Up EC2 Launching an EC2 Instance EC2 Package I... -
Kafka-HDFS Ingestion
Getting Started Standalone MapReduce Job Constructs Source and Extractor Writer and Publisher Job Config Properties Metrics and Events Task Level Metrics Task Level Events ... -
Gobblin as a Library
Using Gobblin as a Library Creating an Embedded Gobblin instance Configuring Embedded Gobblin Running Embedded Gobblin Extending Embedded Gobblin Using Gobblin as a Library ... -
Distributed counters
Id generator Redis or Valkey based Java Id generator RIdGenerator generates unique numbers but not monotonically increased. At first request, batch of id numbers is allocated and... -
Hive Registration
How Hive Registration Works in Gobblin HiveSpec HiveRegistrationPolicy HiveSerDeManager Predicate and Activity How to Use Hive Registration in Your Gobblin Job Hive Regist... -
GitHub 趋势日报 (2025年04月10日)
📈 今日整体趋势 Top 10 📊 分语言趋势 Top 5 Go C++ Ruby Jupyter Notebook Kotlin Java C PHP Shell MDX Rust C TypeScript HTML Lua JavaScript Vim Script Python Batchfile Markdow... -
GitHub 趋势日报 (2025年04月08日)
📈 今日整体趋势 Top 10 📊 分语言趋势 Top 5 C++ Ruby C Go PHP TypeScript Java Kotlin Lua HTML 本日报由 TrendForge 系统生成 https://trendforge.devlive.org/ 📈 今日整体趋势 Top 10 排名 项目名称 ... -
JDBC
Gobblin JDBC writer & publisher Proposed design Requirements Design summary Design detail WriterInitializer JdbcWriterInitializer AvroFieldsPickConverter AvroToJdbcEntryConve...
