-
1. 准备
本节介绍使用 Ambari 安装集群时应准备的信息和材料。 Ambari 为您的集群提供端到端的管理和监控解决方案。 使用 Ambari Web UI 和 REST API，您可以从一个中心点部署、操作、管理配置更改并监控集群中所有节点的服务。 产品互操作性 满足最低系统要求 收集信息 环境准备 -
Spark Tuning Guide
Spark Tuning Guide Writing General Tips Spark failures Hudi consumes too much space in a temp folder while upsert How to tune shuffle parallelism of Hudi jobs ? GC Tuning ... -
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :... -
Hive
Description Key features Options table_name [string] metastore_uri [string] hdfs_site_path [string] hive_site_path [string] hive.hadoop.conf [map] hive.hadoop.conf-path [str... -
1. Deploy Kyuubi engines on Yarn
Deploy Kyuubi engines on Yarn Requirements Configurations Environment Spark Properties Master Queue Sizing Tuning Others Kerberos Deploy Kyuubi engines on Yarn ... -
Apache Iceberg
Support Iceberg Version Support Those Engines Key features Description Supported DataSource Info Database Dependency Data Type Mapping Source Options Task Example Simple: ... -
Config File Encryption And Decryption
Introduction How to use How to implement user-defined encryption and decryption Introduction In most production environments, sensitive configuration items such as passwords a... -
Procedures
Usage Named arguments Positional arguments Snapshot management rollback_to_snapshot Usage Output Example Change Data Capture create_changelog_view Usage Output Examples... -
Bootstrapping
Approaches Use Hudi for new partitions alone Convert existing table to Hudi Using Hudi Streamer Using Spark Datasource Writer Using Spark SQL CALL Procedure Using Hudi CLI C... -
Attach-Detach
Detach All On Commit Copy On Attach Serialization of Detachable classes JDO provides an interface to the persistence of objects. JDO 1.0 didn’t provide a way of taking an objec...