Hudi Integration Dependencies Hudi Operations Apache Hudi (pronounced “hoodie”) is the next generation streaming data lake platform. Apache Hudi brings core warehouse and datab...
Support Those Engines Key features Description Sink Options Task Example Changelog 2.2.0-beta 2022-09-26 Socket sink connector Support Those Engines Spark Flink SeaTu...
Apache Paimon (Incubating) Integration Dependencies Configurations Apache Paimon (Incubating) Operations # Apache Paimon(incubating) is a streaming data lake platform that su...
Hudi Integration Dependencies Configurations Hudi Operations Apache Hudi (pronounced “hoodie”) is the next generation streaming data lake platform. Apache Hudi brings core war...
Apache Paimon (Incubating) Integration Dependencies Configurations Apache Paimon (Incubating) Operations Apache Paimon(incubating) is a streaming data lake platform that suppo...
Apache Paimon (Incubating) Integration Dependencies Apache Paimon (Incubating) Operations Apache Paimon (Incubating) is a streaming data lake platform that supports high-speed ...
Incremental collection Use in single connections Change incremental collection mode in session Typically, when a user submits a SELECT query to Spark SQL engine, the Driver cal...
Support Connector Version Support Those Engines Description Key Features Options Task Example Simple: Multiple Sources Simple: Console Sample Data Console sink connector...
How To Use Kafka uses example Avro is very popular in streaming data pipeline. Now seatunnel supports Avro format in kafka connector. How To Use Kafka uses example This is a...
Spark Streaming Spark Streaming You can write Hudi tables using spark’s structured streaming. Scala // spark-shell // prepare to stream write to new table import org ....