-
Streaming Reads
Spark Streaming Spark Streaming Structured Streaming reads are based on Hudi’s Incremental Query feature, therefore streaming read can return data for which commits and base fil... -
State Management and Watermarks
Managing Watermarks in a Job Basics Task Failures Multi-Dataset Jobs Gobblin State Deep Dive State class hierarchy How States are Used in a Gobblin Job This page has two p... -
JVM 监控
进程级监控 埋点方式 本讲介绍JVM监控相关知识。 进程级监控 Java类的程序，如果只是监控端口存活性，可以直接使用 Categraf 的 net_response 插件，如果只是监控进程存活性，以及进程的CPU、内存等使用率，这个和C的程序、Go的程序没有本质区别，使用 Categraf 的 procstat 插件。 procstat 插... -
第五章：synchronized关键字
学习目标 1. 对象锁与类锁的概念 1.1 对象锁（实例锁） 1.2 类锁（静态锁） 1.3 对象锁与类锁的对比 2. synchronized修饰方法与代码块的区别 2.1 修饰方法 vs 修饰代码块 2.2 不同锁对象的选择 3. synchronized的底层实现原理 3.1 Monitor监视器 3.2 字节码层面的实现 3.3 ... -
Monitoring
Overview Metrics Collecting and Reporting Metrics Reporting Metrics collection JVM Metrics Pre-defined Job Execution Metrics Job Execution History Store Email Notifications ... -
Couchbase
Introduction Record format Configuration General configuration values Authentication No credentials Using certificates Using bucket password Document level expiration 1 - Ex... -
Distributed locks and synchronizers
Lock Redis or Valkey based distributed reentrant Lock object for Java and implements Lock interface. Uses pub/sub channel to notify other threads across all Redisson instances w... -
Deployment
Gobblin Execution Modes Overview One important feature of Gobblin is that it can be run on different platforms. Currently, Gobblin can run in standalone mode (which runs on a sing... -
Distributed publish/subscribe
Topic Java RTopic object implements Publish / Subscribe mechanism based on Redis Pub/Sub or Valkey Pub/Sub . It allows to subscribe on events published with multiple instances o... -
Gobblin as a Library
Using Gobblin as a Library Creating an Embedded Gobblin instance Configuring Embedded Gobblin Running Embedded Gobblin Extending Embedded Gobblin Using Gobblin as a Library ...
