-
SQL DDL
Spark SQL Create table Create non-partitioned table Create partitioned table Create table with record keys and ordering fields Create table from an external location Create Ta... -
How to read this book
References It is recommended that readers have a basic understanding of R Markdown. Chapter 2 of R Markdown: The Definitive Guide [@rmarkdown2018] provides an overview of the ba... -
1. Terminologies
Kyuubi JDBC Apache Hive Apache Thrift Server ServerSpace Engine EngineSpace Apache Spark Multi Tenancy High Availability / Load Balance Apache Zookeeper Apache Curator ... -
Set Up Develop Environment
Prepare Set Up Clone the Source Code Install Subproject Locally Building seaTunnel from source Building sub module Install JetBrains IDEA Scala Plugin Install JetBrains IDEA ... -
Utility
noConflict identity constant noop times random mixin iteratee uniqueId escape unescape result now template noConflict _.noConflict() source Give control of the... -
Troubleshooting
Writing Tables org.apache.parquet.io.InvalidRecordException: Parquet/Avro schema mismatch: Avro field ‘col1’ not found java.lang.UnsupportedOperationException: org.apache.parquet.... -
Design & Concepts
How does Hudi ensure atomicity? Does Hudi extend the Hive table layout? What concurrency control approaches does Hudi adopt? Hudi’s commits are based on transaction start time i... -
Setting Up a Local Repository with No Internet Access
Prerequisites Steps More Information Prerequisites You must have completed the Getting Started Setting up a Local Repository procedure. - To finish setting up your local ... -
AWS
Enabling AWS Integration Spark Flink HTTP Client Configurations URL Connection HTTP Client Configurations Apache HTTP Client Configurations Run Iceberg on AWS Amazon Athena ... -
1. Monitoring Kyuubi - Logging System
Logs of Kyuubi Server Configuring Server Logging Basic Configurations KYUUBI_LOG_DIR KYUUBI_MAX_LOG_FILES Custom Log4j2 Settings Logs of Spark SQL Engine Configuring Engine L...