-
1. Monitoring Kyuubi - Logging System
Logs of Kyuubi Server Configuring Server Logging Basic Configurations KYUUBI_LOG_DIR KYUUBI_MAX_LOG_FILES Custom Log4j2 Settings Logs of Spark SQL Engine Configuring Engine L... -
Architecture
Introduction Architecture Overview Unified Interface Runtime Resource Resiliency High Availability & Load Balance Authentication & Authorization Conclusions Introduction K... -
General
When is Hudi useful for me or my organization? What are some non-goals for Hudi? What is incremental processing? Why does Hudi docs/talks keep talking about it? How is Hudi opti... -
S3File
Support Those Engines Key Features Description Supported DataSource Info Database Dependency Data Type Mapping Orc File Type Parquet File Type Sink Options path [string] h... -
Query API
Creating a query Closing a query Named Query Saving a Query as a Named Query Query Extensions Setting query parameters Compiling a query Executing a query Result Class Con... -
Iterators
Instantiation Interface init seek next hasTop getTopKey and getTopValue deepCopy Yielding Interface enableYielding TabletServer invocation of Iterators Isolation Abstra... -
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
Clustering
Background How is compaction different from clustering? Clustering Architecture Overall, there are 2 steps to clustering Schedule clustering Execute clustering Clustering Use... -
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Java API
Tables Table metadata Scanning File level Transactions Types Primitives Nested types Expressions Expression binding Expression example Modules Tables The main purpose...
