-
Configuration
Spark Configuration Catalogs Spark adds an API to plug in table catalogs that are used to load, create, and manage Iceberg tables. Spark catalogs are configured by setting Spark ... -
Distributed objects
Object holder Java implementation of Redis or Valkey based RBucket object is a holder for any type of object. Size is limited to 512Mb. Code example: RBucket < AnyObject > buc... -
在 Postgres 中配置 SAM 和 Schema Registry 元数据存储
关于此任务 步骤 关于此任务 如果您已经安装了 MySQL 并使用 MySQL 配置了 SAM 和架构注册表元数据存储，则无需在 Postgres 中配置其他元数据存储。 步骤 登录Postgres： sudo su postgres psql 创建一个名为 registry 的数据库，密码为 registry ： ... -
SQL
Description Options source_table_name [string] query [string] Example Struct query Job Config Example Changelog new version SQL transform plugin Description Use SQL ... -
Cassandra
Description Key features Options host [string] keyspace [string] cql [String] username [string] password [string] datacenter [String] consistency_level [String] Examples ... -
Configuring SAM and Schema Registry Metadata Stores in MySQL
Steps Steps Launch the MySQL monitor: mysql - u root - p Create the database for Schema Registry and SAM metastore: create database registry ; create database str... -
Config Management
Introduction Dataset Config Management Requirement Data Model Versioning Client library Config Store Current Dataset Config Management Implementation Data model Client appli... -
Avro format
How To Use Kafka uses example Avro is very popular in streaming data pipeline. Now seatunnel supports Avro format in kafka connector. How To Use Kafka uses example This is a... -
Structured Streaming
Spark Structured Streaming Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Spark DSv2 is an evolving API with different levels of support... -
Greenplum
Greenplum Greenplum source connector Description Read Greenplum data through Jdbc connector . Key features batch stream exactly-once column projection supports qu...
