-
Queries
Spark Queries To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Querying with S... -
Evolution
Evolution Iceberg supports in-place table evolution . You can evolve a table schema just like SQL — even in nested structures — or change partition layout when data volume chang... -
Deployment
Gobblin Execution Modes Overview One important feature of Gobblin is that it can be run on different platforms. Currently, Gobblin can run in standalone mode (which runs on a sing... -
Docker Integration
Introduction Docker Docker Repositories Run the docker image with simple wikipedia jobs Use Gobblin Standalone on Docker for Kafka and HDFS Ingestion Run Gobblin as a Service ... -
CloudEvents Integration
CloudEvents Integration Introduction Requirements Functional Requirements Performance Requirements Design Details Pluggable Protocols Process of CloudEvents under EventMesh Fo... -
Hive Distcp
Introduction Configure Hive Distcp Job Source and target metastores Database and tables to copy Target path computation Conflicting table and partitions treatment Deregisterin... -
Writing ORC Data
Introduction Hive SerDe Integration Writing to an ORC File Data Flow Extending Gobblin’s SerDe Integration Introduction Gobblin is capable of writing data to ORC files by le... -
Commands mapping
Redis or Valkey command Sync / Async APIRedisson.create(config) Reactive APIredisson.reactive() RxJava3 APIredisson.rxJava() AUTH Config.setPassword() - - APPEND ... -
Gobblin Compliance Design
Introduction Design Onboarding Purger Gobblin constructs Hive operations Retention Restore Introduction The Gobblin Compliance module allows for data purging to meet reg... -
Contributing
Contributing to Gobblin Code Contributions Documentation Contributions Contributing to Gobblin You can contribute to Gobblin in multiple ways. For resources and guides, please...
