-
SftpFile
Description Key features Options host [string] port [int] username [string] password [string] path [string] custom_filename [boolean] file_name_expression [string] filenam... -
Spark
General configuration Reading from Accumulo table Writing to Accumulo table Use a BatchWriter Using Bulk Import Reference Apache Spark applications can read from and write ... -
Apache Iceberg
Support Iceberg Version Support Those Engines Key features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Task Example Simple: ... -
GitHub 趋势日报 (2025年04月15日)
📈 今日整体趋势 Top 10 📊 分语言趋势 Top 5 C++ Go PHP Ruby Rust Python MDX TypeScript C C Java Shell Lua Dockerfile Jupyter Notebook Vim Script Kotlin HTML Batchfile JavaScr... -
Catalogs
Introduce multi-catalog How to use Future work Introduce multi-catalog A catalog is a metadata namespace that stores information about databases, tables, views, indexes, users... -
Overview
Table format (aka. format) was first proposed by Iceberg, which can be described as follows: It defines the relationship between tables and files, and any engine can query and r... -
Intro To Connector V2 Features
Differences Between Connector V2 And Connector v1 Source Connector Features exactly-once column projection batch stream parallelism support user-defined split support multip... -
Hive Metastore
Syncing to Hive Metastore Pre-requisites Steps Running sync Register the target table in Hive Metastore Conclusion Syncing to Hive Metastore This document walks through the... -
Table Services
What does the Hudi cleaner do? How do I run compaction for a MOR table? What options do I have for asynchronous/offline compactions on MOR table? How to disable all table servic... -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ...
