-
Docker Integration
Introduction Docker Docker Repositories Run the docker image with simple wikipedia jobs Use Gobblin Standalone on Docker for Kafka and HDFS Ingestion Run Gobblin as a Service ... -
EventMesh Schema Registry (OpenSchema)
EventMesh Schema Registry (OpenSchema) Overview of Schema and Schema Registry Schema Schema Registry Comparison of Schema Registry in Different Projects Overview of OpenSchema ... -
Config File
config.yaml description We use yaml configuration file. It will be created automatically after answer init command. The default path is /data/conf/config.yaml config.yaml... -
Hive Registration
How Hive Registration Works in Gobblin HiveSpec HiveRegistrationPolicy HiveSerDeManager Predicate and Activity How to Use Hive Registration in Your Gobblin Job Hive Regist... -
RisingWave
RisingWave RisingWave is a Postgres-compatible SQL database designed for real-time event streaming data processing, analysis, and management. It can ingest millions of events per... -
File Layouts
Configs The following describes the general file layout structure for Apache Hudi. Please refer the tech spec for a more detailed description of the file layouts. Hudi orga... -
Environment Variables
Installation For auto install Log Installation INSTALL_PORT : specifies the port to boot when installation, default is 80 . AUTO_INSTALL : if set to true , the installation w... -
Google Cloud
GCS Configs GCS Credentials GCS Libs For Hudi storage on GCS, regional buckets provide an DFS API with strong consistency. GCS Configs There are two configurations required ... -
Snowflake
Querying from Snowflake Currently, Snowflake supports Iceberg tables through External Tables and also Native Iceberg Tables . Iceberg on Snowflake is currently supported in pub... -
EventMesh Metrics (OpenTelemetry and Prometheus)
EventMesh Metrics (OpenTelemetry and Prometheus) Introduction An overview of OpenTelemetry An overview of Prometheus Requirements Functional Requirements Design Details Appe...
