-
Spark
General configuration Reading from Accumulo table Writing to Accumulo table Use a BatchWriter Using Bulk Import Reference Apache Spark applications can read from and write ... -
名词解释
名词解释 模块介绍 在对 Apache DolphinScheduler 了解之前，我们先来认识一下调度系统常用的名词 名词解释 DAG： 全称 Directed Acyclic Graph，简称 DAG。工作流中的 Task 任务以有向无环图的形式组装起来，从入度为零的节点进行拓扑遍历，直到无后继节点为止。举例如下图： 流程定义 ：通过拖... -
Implement SpotBugs plugin
Implement SpotBugs plugin Create Maven project Write java code to represent bug to find Write test case to ensure your detector can find bug Write java code to avoid false-posit... -
Delta Lake
Delta Lake Integration Dependencies Configurations Delta Lake Operations Delta lake is an open-source project that enables building a Lakehouse Architecture on top of existing... -
Configure Kerberos for clients to Access Kerberized Kyuubi
Instructions Install Kerberos Client Configure Kerberos Client Get Kerberos TGT Add Kerberos Client Configuration File to JVM Search Path Add Kerberos Ticket Cache to JVM Sear... -
SQL Functions
String Functions ASCII CHAR_LENGTH / LENGTH OCTET_LENGTH CONCAT CONCAT_WS HEXTORAW LOWER / LCASE UPPER / UCASE LEFT RIGHT LOCATE / INSTR / POSITION LPAD RPAD LTRIM RT... -
Objects
keys allKeys values mapObject pairs invert create functions findKey extend extendOwn pick omit defaults clone tap toPath get has property propertyOf matcher i... -
PySpark
Requirements Preparation Prepare JDBC driver Prepare JDBC Hive Dialect extension Including jars of JDBC driver and Hive Dialect extension Usage Using as JDBC Datasource progra... -
Metrics
MetricsReporter JmxMetricsReporter Configurations Demo MetricsGraphiteReporter Configurations Demo DatadogMetricsReporter Configurations Demo PrometheusMetricsReporter AW... -
Batch Writes
Spark DataSource API The hudi-spark module offers the DataSource API to write a Spark DataFrame into a Hudi table. There are a number of options available: HoodieWriteConfig :...
