-
Apache Iceberg
Support Iceberg Version Support Those Engines Key features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Task Example Simple: ... -
Integration with Hive Metastore
Requirements Default Behavior Related Configurations Remote Metastore Database Remote Metastore Server Activate Configurations Via kyuubi-defaults.conf Via hive-site.xml Via... -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ... -
FtpFile
Description Key features Options host [string] port [int] user [string] password [string] path [string] connection_mode [string] custom_filename [boolean] file_name_expres... -
Collections
each map reduce reduceRight find filter findWhere where reject every some contains invoke pluck max min sortBy groupBy indexBy countBy shuffle sample toArray ... -
Hive
Description Key features Options table_name [string] metastore_uri [string] hdfs_site_path [string] hive_site_path [string] hive.hadoop.conf [map] hive.hadoop.conf-path [str... -
Getting Started
Using Iceberg in Spark 3 Adding catalogs Creating a table Writing Reading Next steps The latest version of Iceberg is 1.5.2 . Spark is currently the most feature-rich compu... -
Spark
General configuration Reading from Accumulo table Writing to Accumulo table Use a BatchWriter Using Bulk Import Reference Apache Spark applications can read from and write ... -
deployment
Deployment SeaTunnel Engine 1. Download 2 Config SEATUNNEL_HOME 3. Config SeaTunnel Engine JVM options 4. Config SeaTunnel Engine 4.1 Backup count 4.2 Slot service 4.3 Checkpo... -
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam...