-
Job Configuration Files
Job Configuration Basics Hierarchical Structure of Job Configuration Files Password Encryption Adding or Changing Job Configuration Files Scheduled Jobs One Time Jobs Disable... -
Overview
Redisson is the Java Client and Real-Time Data Platform for Redis or Valkey . Providing the most convenient and easiest way to work with Redis or Valkey. Redisson objects provide ... -
Observability
Metrics This feature is available only in Redisson PRO Monitoring systems integration Redisson provides integration the most popular monitoring systems through Micrometer fram... -
Config Management
Introduction Dataset Config Management Requirement Data Model Versioning Client library Config Store Current Dataset Config Management Implementation Data model Client appli... -
Flink Queries
Flink Queries Iceberg support streaming and batch read With Apache Flink ‘s DataStream API and Table API. Reading with SQL Iceberg support both streaming and batch read in Flink... -
BigLake Metastore
Syncing to BigLake Metastore This document walks through the steps to register an Apache XTable™ (Incubating) synced Iceberg table in BigLake Metastore on GCP. Pre-requisites S... -
Distributed objects
Object holder Java implementation of Redis or Valkey based RBucket object is a holder for any type of object. Size is limited to 512Mb. Code example: RBucket < AnyObject > buc... -
FAQs
Gobblin General Questions What is Gobblin? What programming languages does Gobblin support? Does Gobblin require any external software to be installed? What Hadoop versions can ... -
State Management and Watermarks
Managing Watermarks in a Job Basics Task Failures Multi-Dataset Jobs Gobblin State Deep Dive State class hierarchy How States are Used in a Gobblin Job This page has two p... -
Home
Over the years, LinkedIn’s data infrastructure team built custom solutions for ingesting diverse data entities into our Hadoop eco-system. At one point, we were running 15 t...
