-
Maintenance
Recommended Maintenance Expire Snapshots Remove old metadata files Delete orphan files Optional Maintenance Compact data files Rewrite manifests Maintenance operations req... -
GitHub 趋势日报 (2025年04月30日)
📈 今日整体趋势 Top 10 📊 分语言趋势 Top 5 Swift Java C++ PHP C Kotlin Dart Python Rust Go MDX Ruby C JavaScript Jupyter Notebook Lua Markdown Vim Script TypeScript PowerShe... -
Catalogs
Introduce multi-catalog How to use Future work Introduce multi-catalog A catalog is a metadata namespace that stores information about databases, tables, views, indexes, users... -
Shell
Shell 综述 创建任务 任务参数 任务样例 简单打印一行文字 使用自定义参数 注意事项 Shell 综述 Shell 任务类型，用于创建 Shell 类型的任务并执行一系列的 Shell 脚本。worker 执行该任务的时候，会生成一个临时 shell 脚本，并使用与租户同名的 linux 用户执行这个脚本。 创建任务 点击项... -
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam... -
Hive Metastore
Syncing to Hive Metastore Pre-requisites Steps Running sync Register the target table in Hive Metastore Conclusion Syncing to Hive Metastore This document walks through the... -
Getting Started
Using Iceberg in Spark 3 Adding catalogs Creating a table Writing Reading Next steps The latest version of Iceberg is 1.5.2 . Spark is currently the most feature-rich compu... -
Table Services
What does the Hudi cleaner do? How do I run compaction for a MOR table? What options do I have for asynchronous/offline compactions on MOR table? How to disable all table servic... -
Spark
General configuration Reading from Accumulo table Writing to Accumulo table Use a BatchWriter Using Bulk Import Reference Apache Spark applications can read from and write ... -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ...
