-
Flink Writes
Writing with SQL INSERT INTO INSERT OVERWRITE UPSERT Write with Avro GenericRecord Branch Writes Metrics Options Write options Notes Iceberg support batch and streami... -
Google BigQuery
Sync Modes Manifest File Benefits of using the new manifest approach: View Over Files (Legacy) Configurations Partition Handling Example Hudi tables can be queried from Goo... -
Apache Pulsar
Description Key features Options topic [String] topic-pattern [String] topic-discovery.interval [Long] subscription.name [String] client.service-url [String] admin.service-u... -
MapReduce
General MapReduce configuration Add Accumulo’s MapReduce API to your dependencies Configure dependencies for your MapReduce job Read input from an Accumulo table Write output t... -
8. Distributed locks and synchronizers
8.1. Lock 8.2. Fair Lock 8.3. MultiLock 8.4. RedLock 8.5. ReadWriteLock 8.6. Semaphore 8.7. PermitExpirableSemaphore 8.8. CountDownLatch 8.9. Spin Lock 8.10. Fenced Lock ... -
文件参数传递
文件参数 使用方式 配置文件参数 输出文件给下游任务 获取上游任务的文件 其他 备注 样例 文件参数 通过配置文件参数，在同一工作流实例中，可以将上游任务工作目录下的文件(或文件夹，下统一以文件 代替)传递给下游任务。 如以下场景可能使用到 在ETL任务中，将多个上游任务处理好的数据文件一起传递给特定的下游任务。 在机器学习场景中，将... -
Authorizations
Configuration Security Labels Writing labeled data Security Label Expression Syntax User Authorizations Advanced Authorizations Handling In Accumulo, data is written with se... -
Getting Started
Using Iceberg in Spark 3 Adding catalogs Creating a table Writing Reading Next steps The latest version of Iceberg is 1.5.2 . Spark is currently the most feature-rich compu... -
AWS Datasync
DataSync 节点 综述 创建任务 任务样例 独有参数 环境配置 DataSync 节点 综述 AWS DataSync 是一种在线数据传输服务，可简化、自动化和加速本地存储系统和 AWS Storage 服务之间，以及不同 AWS Storage 服务之间的数据移动。 DataSync 支持的组件: Network File ... -
Procedures
Usage Named arguments Positional arguments Snapshot management rollback_to_snapshot Usage Output Example Change Data Capture create_changelog_view Usage Output Examples...
