-
DataStream Connector
Apache Kafka Connector JDBC Connector ClickHouse Connector Apache Doris Connector Elasticsearch Connector Apache HBase Connector HTTP Connector Redis Connector -
Config Management
Introduction Dataset Config Management Requirement Data Model Versioning Client library Config Store Current Dataset Config Management Implementation Data model Client appli... -
Structured Streaming
Spark Structured Streaming Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Spark DSv2 is an evolving API with different levels of support... -
JDBC
Gobblin JDBC writer & publisher Proposed design Requirements Design summary Design detail WriterInitializer JdbcWriterInitializer AvroFieldsPickConverter AvroToJdbcEntryConve... -
Flink Configuration
Flink Configuration Catalog Configuration A catalog is created and named by executing the following query (replace <catalog_name> with your catalog name and <config_key> =<confi... -
RisingWave
RisingWave RisingWave is a Postgres-compatible SQL database designed for real-time event streaming data processing, analysis, and management. It can ingest millions of events per... -
CloudEvents Integration
CloudEvents Integration Introduction Requirements Functional Requirements Performance Requirements Design Details Pluggable Protocols Process of CloudEvents under EventMesh Fo... -
EventMesh Stream
EventMesh Stream Overview of Event Streaming Requirements Functional Requirements Design Details Architecture Design EventMesh-Stream Component Event Event Channel Event End... -
Hive Registration
How Hive Registration Works in Gobblin HiveSpec HiveRegistrationPolicy HiveSerDeManager Predicate and Activity How to Use Hive Registration in Your Gobblin Job Hive Regist... -
Client-Side Caching
Native implementation Client Side caching is implemented using client tracking listener through RESP3 protocol available in Redis or Valkey. It’s used to speed up read operation...
