-
Deployment
Gobblin Execution Modes Overview One important feature of Gobblin is that it can be run on different platforms. Currently, Gobblin can run in standalone mode (which runs on a sing... -
RisingWave
RisingWave RisingWave is a Postgres-compatible SQL database designed for real-time event streaming data processing, analysis, and management. It can ingest millions of events per... -
Hive Distcp
Introduction Configure Hive Distcp Job Source and target metastores Database and tables to copy Target path computation Conflicting table and partitions treatment Deregisterin... -
Flink DDL
DDL commands CREATE Catalog Hive catalog This creates an Iceberg catalog named hive_catalog that can be configured using 'catalog-type'='hive' , which loads tables from Hive m... -
Home
Over the years, LinkedIn’s data infrastructure team built custom solutions for ingesting diverse data entities into our Hadoop eco-system. At one point, we were running 15 t... -
Hive Registration
How Hive Registration Works in Gobblin HiveSpec HiveRegistrationPolicy HiveSerDeManager Predicate and Activity How to Use Hive Registration in Your Gobblin Job Hive Regist... -
Commands mapping
Redis or Valkey command Sync / Async APIRedisson.create(config) Reactive APIredisson.reactive() RxJava3 APIredisson.rxJava() AUTH Config.setPassword() - - APPEND ... -
JDBC
Iceberg JDBC Integration JDBC Catalog Iceberg supports using a table in a relational database to manage Iceberg tables through JDBC. The database that JDBC connects to must suppo... -
Connectors
Connectors Connector Source Sink CloudEvents Implements Technical Solution Structure and process Design Detail Description Worker Connector ConnectorRecord with CloudEvent... -
Common methods
1. Object name Name of Redisson object stored as a key in Redis or Valkey. Example: RMap map = redisson . getMap ( "mymap" ); map . getName (); // = mymap 2. Commo...
