-
Structured Streaming
Spark Structured Streaming Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Spark DSv2 is an evolving API with different levels of support... -
Batch Reads
Spark DataSource API Daft Spark DataSource API The hudi-spark module offers the DataSource API to read a Hudi table into a Spark DataFrame. A time-travel query example: val ... -
Retention
Introduction Design Overview of Gobblin Config Management Library Retention Constructs DatasetCleaner DatasetFinder ManagedCleanableDatasetFinder ConfigurableCleanableDataset ... -
Privacy Policy
Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following: The IP address from ... -
Schedulers
Introduction Quartz Azkaban Oozie Launching Gobblin in Local Mode Example Config Files Uploading Files to HDFS Adding Gobblin jar Dependencies Launching the Job Launching ... -
Introduction
Documentation Apache Iceberg is an open table format for huge analytic datasets. Iceberg adds tables to compute engines including Spark, Trino, PrestoDB, Flink, Hive and Impala u... -
Flink Queries
Flink Queries Iceberg support streaming and batch read With Apache Flink ‘s DataStream API and Table API. Reading with SQL Iceberg support both streaming and batch read in Flink... -
Import the custom VDF into Ambari
Next Step More Information To import the custom VDF into Ambari, follow these steps: In the cluster install wizard, Select Version step, click the drop down with the HDP vers... -
Slack
Support Those Engines Key features Description Data Type Mapping Options Task Example Simple: Changelog new version Slack sink connector Support Those Engines Spark... -
Script 脚本
Script脚本 Script脚本 如果您需要使用到Shell 脚本进行告警，请在告警实例管理里创建告警实例，选择Script 插件。Script 的配置样例如下: 参数配置 自定义参数 用户自定义的参数将被传入脚本执行 脚本路径 脚本在服务器上的文件位置，只支持.sh后缀的文件 脚本类型 支持Shell 脚本 ...
