-
Jupyter
Jupyter 综述 Conda虚拟环境配置 Python依赖管理 使用预装好的Conda环境 使用打包的Conda环境 由依赖需求文本文件临时构建 创建任务 任务参数 任务样例 简单的Jupyter任务样例 Jupyter 综述 Jupyter 任务类型，用于创建并执行Jupyter 类型任务。worker 执行该任务的时候，会... -
Elasticsearch Connector
Elasticsearch 写入依赖 基于官网的Elasticsearch写入数据 Apache StreamPark™ 写入 Elasticsearch 1. 配置策略和连接信息 2. 写入Elasticsearch 其他配置 处理失败的 Elasticsearch 请求 配置内部批量处理器 Apache StreamPark™配置 E... -
Deployment
Deploying Hudi Streamer Spark Datasource Writer Jobs Upgrading Downgrading Migrating This section provides all the help you need to deploy and operate Hudi tables at scale. ... -
Hadoop Resource Integration
Using Apache Hadoop resource in Flink on Kubernetes 1. Apache HDFS 1.1 Add the shaded jar 1.2. add core-site.xml and hdfs-site.xml 2. Apache Hive 2.1. Add Hive-related jars 2... -
Elasticsearch Connector
Dependency of elastic writing Write data to Elasticsearch based on the official Using Apache StreamPark™ writes to Elasticsearch 1. 配置策略和连接信息 2. 写入Elasticsearch Other configur... -
1. Kyuubi On Apache Kudu
Kyuubi On Apache Kudu What is Apache Kudu Why Kyuubi on Kudu Kudu Integration with Apache Spark Kudu Integration with Kyuubi Install Kudu Spark Dependency Start Kyuubi Start B... -
Hive Metastore
Spark Data Source example Query using HiveQL Use partition extractor properly Hive Sync Tool Hive Sync Configuration Sync modes HMS JDBC HIVEQL Flink Setup Install Hive E... -
CDC Ingestion
Ingest into one table Iceberg format Mixed-Iceberg format Ingest Into multiple tables Iceberg format Mixed-Iceberg format CDC stands for Change Data Capture, which is a broa... -
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :... -
Schema Evolution
Schema Evolution on Write Type Promotions Schema Evolution on read Adding Columns Altering Columns Deleting Columns Renaming columns Schema Evolution in Action Related Reso...