-
1. Deploy Kyuubi engines on Yarn
Deploy Kyuubi engines on Yarn Requirements Configurations Environment Spark Properties Master Queue Sizing Tuning Others Kerberos Deploy Kyuubi engines on Yarn ... -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ... -
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :... -
SQL Functions
String Functions ASCII CHAR_LENGTH / LENGTH OCTET_LENGTH CONCAT CONCAT_WS HEXTORAW LOWER / LCASE UPPER / UCASE LEFT RIGHT LOCATE / INSTR / POSITION LPAD RPAD LTRIM RT... -
Config File Encryption And Decryption
Introduction How to use How to implement user-defined encryption and decryption Introduction In most production environments, sensitive configuration items such as passwords a... -
Procedures
Usage Named arguments Positional arguments Snapshot management rollback_to_snapshot Usage Output Example Change Data Capture create_changelog_view Usage Output Examples... -
JDO v JPA
There are several competing persistence technologies available for Java. Two of these are “standardised” (via the JCP). When developing your application you need to choose the mos... -
Snowflake
Support those engines Key features Description Supported DataSource list Database dependency Data Type Mapping Options tips Task Example simple: parallel: parallel bounda... -
Getting Started
Using Iceberg in Spark 3 Adding catalogs Creating a table Writing Reading Next steps The latest version of Iceberg is 1.5.2 . Spark is currently the most feature-rich compu... -
RHEL/CentOS/Oracle Linux 7
Steps Next Step More Information On a server host that has Internet access, use a command line editor to perform the following Steps Install the Ambari bits. This also insta...