-
PyHive
Requirements Usage DB-API Use PyHive with Pandas Authentication PyHive is a collection of Python DB-API and SQLAlchemy interfaces for Hive. PyHive can connect with the Kyuub... -
Flink Configuration
Catalog Configuration Runtime configuration Read options Write options Catalog Configuration A catalog is created and named by executing the following query (replace <catalog... -
1. Kubernetes Tools Spark Block Cleaner
Kubernetes Tools Spark Block Cleaner Requirements Scenes Principle Usage Build Block Cleaner Docker Image Modify spark-block-cleaner.yml Start daemonSet Related parameters ... -
Tracing
Configuring Tracing Instrumenting a Client Tracing from the Shell It can be difficult to determine why some operations are taking longer than expected. For example, you may be ... -
Pulsar
Support Those Engines Key features Description Supported DataSource Info Sink Options Parameter Interpretation client.service-url [String] admin.service-url [String] auth.pl... -
Paimon
Description Key features Options Examples Single table Single table(Specify hadoop HA config and kerberos config) Single table with write props of paimon Multiple table P... -
Timeline
Actions States Active and Archived timeline LSM Timeline Archival Configs Spark write client configs Flink Options At its core, Hudi maintains a timeline which is a log of... -
Flink Connector
Table managed in Hive catalog. Table managed in hadoop catalog Table managed in custom catalog A complete example. Apache Flink supports creating Iceberg table directly withou... -
SSO Integration
Background SSO login workflow How to enable SSO login Note Background As an enterpise practice, it’s common to apply Single sign-on (SSO) across all applications, so that use... -
Gobblin on Yarn
Introduction Architecture Overview The Role of Apache Helix Gobblin Yarn Application Launcher YarnAppSecurityManager LogCopier Gobblin ApplicationMaster YarnService GobblinH...
