-
Distributed publish/subscribe
Topic Java RTopic object implements Publish / Subscribe mechanism based on Redis Pub/Sub or Valkey Pub/Sub . It allows to subscribe on events published with multiple instances o... -
Features and Limitations
Features and Limitations Features Apache XTable™ (Incubating) provides users with the ability to translate metadata from one table format to another. Apache XTable™ (Incubatin... -
Docker Integration
Introduction Docker Docker Repositories Run the docker image with simple wikipedia jobs Use Gobblin Standalone on Docker for Kafka and HDFS Ingestion Run Gobblin as a Service ... -
Gobblin as a Library
Using Gobblin as a Library Creating an Embedded Gobblin instance Configuring Embedded Gobblin Running Embedded Gobblin Extending Embedded Gobblin Using Gobblin as a Library ... -
Standalone Redisson node
Overview Redisson offers ability to run as standalone node and participate in distributed computing. Such Nodes are used to run MapReduce , ExecutorService , ScheduledExecutorServ... -
Queries
Spark Queries To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Querying with S... -
Gobblin Metrics Performance
Generalities How to interpret these numbers What if I need larger QPS? Update Metrics Performance Multiple metric updates per iteration Multi-threading Running Performance Tes... -
Connectors
Connectors Connector Source Sink CloudEvents Implements Technical Solution Structure and process Design Detail Description Worker Connector ConnectorRecord with CloudEvent... -
High Level Consumer
Problem Statement New Design & Details Problem Statement Current Gobblin Kafka High Level Consumer uses Kafka Consumer (0.8) APIs and gobblin support for them will be depreca... -
Data partitioning
All Redisson Java objects are Redis or Valkey cluster compatible, but their state isn’t scaled/partitioned to multiple master nodes in cluster. Redisson PRO offers data partitioni...
