-
Github
Description Key features Options url [String] access_token [String] method [String] params [Map] body [String] poll_interval_millis [int] retry [int] retry_backoff_multipl... -
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow... -
文件参数传递
文件参数 使用方式 配置文件参数 输出文件给下游任务 获取上游任务的文件 其他 备注 样例 文件参数 通过配置文件参数，在同一工作流实例中，可以将上游任务工作目录下的文件(或文件夹，下统一以文件 代替)传递给下游任务。 如以下场景可能使用到 在ETL任务中，将多个上游任务处理好的数据文件一起传递给特定的下游任务。 在机器学习场景中，将... -
3. Operations execution
3.1. Async way 3.2. Reactive way Redisson instances are fully thread-safe. Objects with synchronous/asynchronous methods could be reached via RedissonClient interface.Reactive... -
Iceberg
Iceberg Integration Dependencies Configurations Iceberg Operations Apache Iceberg is an open table format for huge analytic datasets. Iceberg adds tables to compute engines in... -
TiDB
TiDB Integration Dependencies Configurations TiDB Operations TiDB is an open-source NewSQL database that supports Hybrid Transactional and Analytical Processing (HTAP) workloa... -
Iceberg
Iceberg Integration Dependencies Iceberg Operations Apache Iceberg is an open table format for huge analytic datasets. Iceberg adds tables to compute engines including Spark, T... -
Why JDO?
The majority of applications need to persist (or store) data during their lifecycle. There are many ways of doing this with an application written in Java. If your datastore is ... -
Queries
Querying with SQL Querying with DataFrames Catalogs with DataFrameReader Time travel SQL DataFrame Incremental read Inspecting tables History Metadata Log Entries Snapshot... -
Glue Data Catalog
Syncing to Glue Data Catalog Pre-requisites Steps Running sync Register the target table in Glue Data Catalog Validating the results Conclusion Syncing to Glue Data Catalo...
