-
OssJindoFile
Description Key features Options path [string] bucket [string] access_key [string] access_secret [string] endpoint [string] custom_filename [boolean] file_name_expression [... -
Java Custom Catalog
Custom table operations implementation Custom file IO implementation Custom location provider implementation Custom IcebergSource It’s possible to read an iceberg table either... -
Gobblin on Yarn
Introduction Architecture Overview The Role of Apache Helix Gobblin Yarn Application Launcher YarnAppSecurityManager LogCopier Gobblin ApplicationMaster YarnService GobblinH... -
Structured Streaming
Streaming Reads Streaming Writes Partitioned table Maintenance for streaming tables Tune the rate of commits Expire old snapshots Compacting data files Rewrite manifests I... -
BigLake Metastore
Pre-requisites Steps Create BigLake Catalog Create BigLake Database Running sync Validating the results Conclusion This document walks through the steps to register a OneTa... -
Auxiliary Optimization Rules
Features Usage Additional Configurations Kyuubi provides SQL extension out of box. Due to the version compatibility with Apache Spark, currently we support Apache Spark branch-... -
Key Generation
Key Generators SimpleKeyGenerator ComplexKeyGenerator NonpartitionedKeyGenerator CustomKeyGenerator Bring your own implementation TimestampBasedKeyGenerator Timestamp is GMT ... -
Dell
Dell ECS Integration Parameters Spark Flink Limitations Dell ECS Integration Iceberg can be used with Dell’s Enterprise Object Storage (ECS) by using the ECS catalog since 0... -
CosFile
Support Those Engines Key features Description Options path [string] file_format_type [string] bucket [string] secret_id [string] secret_key [string] region [string] read_... -
SftpFile
Support Those Engines Key Features Description Supported DataSource Info Data Type Mapping Source Options file_format_type [string] compress_codec [string] encoding [string]...
