Spark Streaming Spark Streaming Structured Streaming reads are based on Hudi’s Incremental Query feature, therefore streaming read can return data for which commits and base fil...
Syncing to Unity Catalog This document walks through the steps to register an Apache XTable™ (Incubating) synced Delta table in Unity Catalog on Databricks and open-source Unity C...
Introduction Record format Configuration General configuration values Authentication No credentials Using certificates Using bucket password Document level expiration 1 - Ex...
Metrics Reporting As of 1.1.0 Iceberg supports the MetricsReporter and the MetricsReport APIs. These two APIs allow expressing different metrics reports while supporting a plu...
User Management Team Management Role Management Member Management User Management ADMIN can select the user type when creating or modifying a user. There are two user types: ...
Installation Usage Refresh config List Servers Delete an Engine New in version 1.6.0. Kyuubi administer tool(kyuubi-admin) provides administrators with some maintenance oper...
Build A Custom EventHandler Enable Custom EventHandler Kyuubi provide event processing mechanism, it can help us to record some events. Beside the builtin JsonLoggingEventHandle...
Disclaimer Supported Storage System Verified Combination of Spark and storage system HDInsight Spark2.4 on Azure Data Lake Storage Gen 2 Databricks Spark2.4 on Azure Data Lake S...