-
Streaming Writes
Spark Streaming Spark Streaming You can write Hudi tables using spark’s structured streaming. Scala // spark-shell // prepare to stream write to new table import org .... -
Config Management
Introduction Dataset Config Management Requirement Data Model Versioning Client library Config Store Current Dataset Config Management Implementation Data model Client appli... -
团队成员管理
用户管理 团队管理 角色管理 成员管理 用户管理 ADMIN 创建或修改用户时可以指定用户类型，用户类型有 ADMIN 和 USER 两种。 ADMIN 表示系统管理员，即：StreamPark 的超级管理员，有 StreamPark 管理页面以及各个团队的所有权限。 USER 表示平台的普通用户。创建 USER 只是创建账号的过程，默认普通... -
Paimon
Description Key features Options warehouse [string] database [string] table [string] hdfs_site_path [string] Examples Changelog next version Paimon source connector ... -
Flink Queries
Flink Queries Iceberg support streaming and batch read With Apache Flink ‘s DataStream API and Table API. Reading with SQL Iceberg support both streaming and batch read in Flink... -
Configuration
Spark Configuration Catalogs Spark adds an API to plug in table catalogs that are used to load, create, and manage Iceberg tables. Spark catalogs are configured by setting Spark ... -
Configure SAM and Schema Registry Metadata Stores in Postgres
About This Task Steps About This Task If you have already installed MySQL and configured SAM and Schema Registry metadata stores using MySQL, you do not need to configure addi... -
扩展链接
背景介绍 如何创建扩展链接 扩展链接的使用 背景介绍 在生产实践中，为了更好地管理 Flink作业，总会需要将其与外部服务集成，例如代码仓库、指标监控页面、实时日志记录或 HDFS/OSS 上的检查点/保存点文件夹等。 Streampark 作为一站式 Flink DevOps 平台，如果能够提供以扩展链接的形式集成这些服务的能力，在统一的地方集... -
Structured Streaming
Spark Structured Streaming Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Spark DSv2 is an evolving API with different levels of support... -
Configure SAM and Schema Registry Metadata Stores in Postgres
About This Task Steps About This Task If you have already installed MySQL and configured SAM and Schema Registry metadata stores using MySQL, you do not need to configure addit...
