-
AWS
Enabling AWS Integration Spark Flink HTTP Client Configurations URL Connection HTTP Client Configurations Apache HTTP Client Configurations Run Iceberg on AWS Amazon Athena ... -
Flink Quick Start
Setup Flink Support Matrix Download Flink and Start Flink cluster Start Flink SQL client Create Table Insert Data Query Data Update Data Delete Data Row-level Delete Batch... -
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
1. Monitoring Kyuubi - Logging System
Logs of Kyuubi Server Configuring Server Logging Basic Configurations KYUUBI_LOG_DIR KYUUBI_MAX_LOG_FILES Custom Log4j2 Settings Logs of Spark SQL Engine Configuring Engine L... -
SQL DDL
Spark SQL Create table Create non-partitioned table Create partitioned table Create table with record keys and ordering fields Create table from an external location Create Ta... -
Design
Background Data Model Architecture Components Tablet Server Garbage Collector Manager Tracer Monitor Compactor (experimental) Compaction Coordinator (experimental) Scan S... -
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Architecture
Introduction Architecture Overview Unified Interface Runtime Resource Resiliency High Availability & Load Balance Authentication & Authorization Conclusions Introduction K... -
Hadoop Resource Integration
Using Apache Hadoop resource in Flink on Kubernetes 1. Apache HDFS 1.1 Add the shaded jar 1.2. add core-site.xml and hdfs-site.xml 2. Apache Hive 2.1. Add Hive-related jars 2... -
Java API
Tables Table metadata Scanning File level Transactions Types Primitives Nested types Expressions Expression binding Expression example Modules Tables The main purpose...
