-
Async Queries via Celery
Celery Celery Flower Celery On large analytic databases, it’s common to run queries that execute for minutes or hours. To enable support for long running queries that execute b... -
General
When is Hudi useful for me or my organization? What are some non-goals for Hudi? What is incremental processing? Why does Hudi docs/talks keep talking about it? How is Hudi opti... -
Nessie
Enabling Nessie Catalog Spark SQL Extensions Nessie Catalog Nessie and Iceberg Loosely coupled transactions Experimentation Further use cases Example Future Improvements ... -
Markdown Features
Markdown Headers Documents Blog Posts Extra Features Linking other Documents Linking to Images and Other Assets Generating Table of Contents Language-specific Code Tabs Syn... -
Setup
User Manual (2.x and 3.x) Master/Manager naming Setup for testing or development Setup for Production Configuring Accumulo Initialization Run Accumulo Run individual Accumulo... -
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
PostgreSQL
Support Those Engines Using Dependency For Spark/Flink Engine For SeaTunnel Zeta Engine Key Features Description Supported DataSource Info Database Dependency Data Type Map... -
SQL DDL
Spark SQL Create table Create non-partitioned table Create partitioned table Create table with record keys and ordering fields Create table from an external location Create Ta... -
Clustering
Background How is compaction different from clustering? Clustering Architecture Overall, there are 2 steps to clustering Schedule clustering Execute clustering Clustering Use...
