-
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
Clustering
Background How is compaction different from clustering? Clustering Architecture Overall, there are 2 steps to clustering Schedule clustering Execute clustering Clustering Use... -
2.2. How To Use Spark Adaptive Query Execution (AQE) in Kyuubi
How To Use Spark Adaptive Query Execution (AQE) in Kyuubi The Basics of AQE Dynamically Switch Join Strategies Dynamically Coalesce Shuffle Partitions Other Tips for Best Practise... -
SQL DDL
Spark SQL Create table Create non-partitioned table Create partitioned table Create table with record keys and ordering fields Create table from an external location Create Ta... -
Nessie
Enabling Nessie Catalog Spark SQL Extensions Nessie Catalog Nessie and Iceberg Loosely coupled transactions Experimentation Further use cases Example Future Improvements ... -
Hadoop 资源集成
在 Flink on Kubernetes 上使用 Apache Hadoop 资源 1. Apache HDFS 1.1 添加 shade jar 1.2、添加 core-site.xml 和 hdfs-site.xml 2、Apache Hive i、添加 hive 相关的 jar 2.1. 添加 hive 的配置文件（hive-site.x... -
CLI
Local set up Hudi CLI Bundle setup Using hudi-cli Inspecting Commits Drilling Down to a specific Commit FileSystem View Statistics Archived Commits Compactions Validate Com... -
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Apache Iceberg
Support Iceberg Version Support Those Engines Description Supported DataSource Info Database Dependency Data Type Mapping Sink Options Task Example Simple: Hive Catalog: H... -
Flink Quick Start
Setup Flink Support Matrix Download Flink and Start Flink cluster Start Flink SQL client Create Table Insert Data Query Data Update Data Delete Data Row-level Delete Batch...
