-
Elasticsearch
Description Key features Options hosts [array] username [string] password [string] index [string] source [array] array_column [array] query [json] scroll_time [String] sc... -
FakeSource
Support Those Engines Description Key Features Source Options Task Example Simple: Random Generation Customize the data content Simple: Specified Data number Simple: Templa... -
Jira
Description Key features Options url [String] email [String] api_token [String] method [String] params [Map] body [String] poll_interval_millis [int] retry [int] retry_ba... -
Apache XTable (incubating)
Interoperating with XTable Installation Syncing to XTable Hudi Streamer Extensions Hudi (tables created from 0.14.0 onwards) supports syncing to Iceberg and/or Delta Lake with... -
Gitlab
Description Key features Options url [String] access_token [String] method [String] params [Map] body [String] poll_interval_millis [int] retry [int] retry_backoff_multipl... -
Glue Data Catalog
Syncing to Glue Data Catalog Pre-requisites Steps Running sync Register the target table in Glue Data Catalog Validating the results Conclusion Syncing to Glue Data Catalo... -
Structured Streaming
Streaming Reads Streaming Writes Partitioned table Maintenance for streaming tables Tune the rate of commits Expire old snapshots Compacting data files Rewrite manifests I... -
Easysearch
Support Those Engines Description Using Dependency Key features Data Type Mapping hosts [array] username [string] password [string] index [string] source [array] query [js... -
Sink
AmazonDynamoDB AmazonSqs Assert Cassandra Clickhouse ClickhouseFile Console CosFile DB2 DataHub DingTalk Doris INFINI Easysearch Elasticsearch Email Enterprise WeCha... -
Branching and Tagging
Overview Use Cases Historical Tags Audit Branch Usage Overview Iceberg table metadata maintains a snapshot log, which represents the changes applied to a table. Snapshots ar...