-
Building A Runnable Distribution
To create a Kyuubi distribution like those distributed by Kyuubi Release Page , and that is laid out to be runnable, use ./build/dist in the project root directory. For more inf... -
JDBC
Gobblin JDBC writer & publisher Proposed design Requirements Design summary Design detail WriterInitializer JdbcWriterInitializer AvroFieldsPickConverter AvroToJdbcEntryConve... -
Overview
Redisson is the Java Client and Real-Time Data Platform for Redis or Valkey . Providing the most convenient and easiest way to work with Redis or Valkey. Redisson objects provide ... -
DDL
Spark DDL To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. CREATE TABLE Spark... -
Introduction to EventMesh
Introduction to EventMesh Features Introduction to EventMesh Apache EventMesh is a fully serverless platform used to build distributed event-driven applications. ... -
Metrics for Gobblin ETL
Configuring Metrics and Event emission Operational Metrics Extractor Metrics Converter Metrics Fork Operator Metrics Row Level Policy Metrics Data Writer Metrics Runtime Eve... -
Distributed locks and synchronizers
Lock Redis or Valkey based distributed reentrant Lock object for Java and implements Lock interface. Uses pub/sub channel to notify other threads across all Redisson instances w... -
Distributed counters
Id generator Redis or Valkey based Java Id generator RIdGenerator generates unique numbers but not monotonically increased. At first request, batch of id numbers is allocated and... -
Daft
Daft Daft is a distributed query engine written in Python and Rust, two fast-growing ecosystems in the data engineering and machine learning industry. It exposes its flavor of t... -
Distributed publish/subscribe
Topic Java RTopic object implements Publish / Subscribe mechanism based on Redis Pub/Sub or Valkey Pub/Sub . It allows to subscribe on events published with multiple instances o...
