-
Maintenance
Recommended Maintenance Expire Snapshots Remove old metadata files Delete orphan files Optional Maintenance Compact data files Rewrite manifests Maintenance operations req... -
AWS Datasync
DataSync 节点 综述 创建任务 任务样例 独有参数 环境配置 DataSync 节点 综述 AWS DataSync 是一种在线数据传输服务，可简化、自动化和加速本地存储系统和 AWS Storage 服务之间，以及不同 AWS Storage 服务之间的数据移动。 DataSync 支持的组件: Network File ... -
Configuration
Table properties Read properties Write properties Table behavior properties Reserved table properties Compatibility flags Catalog properties Lock catalog properties Hadoop ... -
SQL Lineage Support
Introduction Example Lineage specific identification SQL type support Query Command Building Build with Apache Maven Build against Different Apache Spark Versions Test with... -
Apache Iceberg
Support Iceberg Version Support Those Engines Key features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Task Example Simple: ... -
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam... -
Spark
General configuration Reading from Accumulo table Writing to Accumulo table Use a BatchWriter Using Bulk Import Reference Apache Spark applications can read from and write ... -
Managing Optimizers
Optimizer container Local container Flink container External container Optimizer group Add optimizer group Edit optimizer group Remove optimizer group Optimizer Scale-out a... -
LocalFile
Support Those Engines Key features Description Options path [string] file_format_type [string] read_columns [list] delimiter/field_delimiter [string] parse_partition_from_pa... -
Configuration
Catalogs Catalog configuration Using catalogs Replacing the session catalog Using catalog specific Hadoop configuration values Loading a custom catalog SQL Extensions Runtim...
