-
Features and Limitations
Features and Limitations Features Apache XTable™ (Incubating) provides users with the ability to translate metadata from one table format to another. Apache XTable™ (Incubatin... -
Metrics for Gobblin ETL
Configuring Metrics and Event emission Operational Metrics Extractor Metrics Converter Metrics Fork Operator Metrics Row Level Policy Metrics Data Writer Metrics Runtime Eve... -
Query based
Introduction Constructs QueryBasedSource QueryBasedExtractor build readRecord Configuration Introduction QueryBasedSource represents a category of sources whose data... -
Hive Registration
How Hive Registration Works in Gobblin HiveSpec HiveRegistrationPolicy HiveSerDeManager Predicate and Activity How to Use Hive Registration in Your Gobblin Job Hive Regist... -
13. Tools
13.1. Cluster management tool 13.1.1 Cluster management tool. Create Redis cluster 13.1.2 Cluster management tool. Remove Redis node 13.1.3 Cluster management tool. Move slots be... -
Hive Distcp
Introduction Configure Hive Distcp Job Source and target metastores Database and tables to copy Target path computation Conflicting table and partitions treatment Deregisterin... -
Daft
Daft Daft is a distributed query engine written in Python and Rust, two fast-growing ecosystems in the data engineering and machine learning industry. It exposes its flavor of t... -
Gobblin Modules
Introduction How it works gobblin-modules/ Gobblin flavor Current flavors and modules What’s next Introduction Gobblin-modules is a way to support customization of the gobb... -
Queries
Spark Queries To use Iceberg in Spark, first configure Spark catalogs . Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Querying with S... -
Writing ORC Data
Introduction Hive SerDe Integration Writing to an ORC File Data Flow Extending Gobblin’s SerDe Integration Introduction Gobblin is capable of writing data to ORC files by le...
