A Streaming Data Lake Near Real-Time Ingestion Incremental Processing Pipelines Unified Batch and Streaming Cloud-Native Tables Schema Management ACID Transactions Efficient ...
What are some ways to write a Hudi table? How is a Hudi writer job deployed? Can I implement my own logic for how input records are merged with record on storage? How do I delet...
When is Hudi useful for me or my organization? What are some non-goals for Hudi? What is incremental processing? Why does Hudi docs/talks keep talking about it? How is Hudi opti...
Deployment models with supported concurrency controls Model A: Single writer with inline table services Single Writer Guarantees Model B: Single writer with async table services ...
Background How is compaction different from clustering? Clustering Architecture Overall, there are 2 steps to clustering Schedule clustering Execute clustering Clustering Use...
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i...
Background Cleaning Retention Policies Configs Ways to trigger Cleaning Inline Async Run independently CLI Related Resources Background Cleaning is a table service emplo...