-
Self-Optimizing
Introduction Self-optimizing mechanism Self-optimizing scheduling policy Quota Balanced Introduction Lakehouse is characterized by its openness and loose coupling, with data... -
Performance
Optimized DFS Access Performance Optimizations Write Path Bulk Insert Upserts Indexing Read Path Data Skipping Optimized DFS Access Hudi also performs several key storage... -
checkpoint-storage
Checkpoint Storage Introduction Checkpoint Storage Checkpoint Storage Configuration OSS S3 HDFS LocalFile Enable cache Checkpoint Storage Introduction Checkpoint is a f... -
How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
The Basics of AQE Dynamically Switch Join Strategies Dynamically Coalesce Shuffle Partitions Other Tips for Best Practises How to set spark.sql.adaptive.advisoryPartitionSizeInByt... -
Flink Queries
Reading with SQL Flink batch read Flink streaming read FLIP-27 source for SQL Reading branches and tags with SQL Reading with DataStream Batch Read Streaming read Reading w... -
Implement SpotBugs plugin
Implement SpotBugs plugin Create Maven project Write java code to represent bug to find Write test case to ensure your detector can find bug Write java code to avoid false-posit... -
Annotations
@PersistenceCapable @PersistenceAware @Cacheable @EmbeddedOnly @Inheritance @Discriminator @DatastoreIdentity @Version @PrimaryKey @FetchPlans @FetchPlan @FetchGroups @... -
Kyuubi v.s. Spark Thrift JDBC/ODBC Server (STS)
Introductions Barriers to common Spark job usage High Barrier Insecurity Compatibility Bootstrap latency Limitations of Spark ThriftServer Driver Bottleneck Resource isolati... -
Getting Started
Requirements Installation Install Kyuubi Install Spark Configuration Start Kyuubi Operate Clients Open Connections Execute Statements Start Engines Close Connections Stop... -
Using Flink
CDC Ingestion Bulk Insert Options Index Bootstrap Options How To Use Changelog Mode Options Append Mode Inline Clustering Async Clustering Clustering Plan Strategy Buck...