-
Microsoft Azure
Disclaimer Supported Storage System Verified Combination of Spark and storage system HDInsight Spark2.4 on Azure Data Lake Storage Gen 2 Databricks Spark2.4 on Azure Data Lake S... -
Metrics for Gobblin ETL
Configuring Metrics and Event emission Operational Metrics Extractor Metrics Converter Metrics Fork Operator Metrics Row Level Policy Metrics Data Writer Metrics Runtime Eve... -
4.19 Put together all code in the appendix (*)
Unless the target readers are highly interested in the computational details while they read a report, you may not want to show the source code blocks in the report. For this purp... -
Object
clone values eqProps keys omit pick pickAll project prop props where keysIn path valuesIn clone {*} → {*} Parameters valueThe object or array to clone Return... -
Hive Dialect Support
Features Usage Hive Dialect plugin aims to provide Hive Dialect support to Spark’s JDBC source. It will auto registered to Spark and applied to JDBC sources with url prefix of j... -
Query based
Introduction Constructs QueryBasedSource QueryBasedExtractor build readRecord Configuration Introduction QueryBasedSource represents a category of sources whose data... -
HTTP
Introduction Note Constructs HttpOperation AsyncRequestBuilder HttpClient ResponseHandler Build an asynchronous writer AvroHttpWriterBuilder R2RestWriterBuilder Bui... -
Console
Support Connector Version Support Those Engines Description Key Features Options Task Example Simple: Multiple Sources Simple: Console Sample Data Console sink connector... -
Object
clone values eqProps keys omit pick pickAll project prop props where keysIn path valuesIn clone {*} → {*} Parameters valueThe object or array to clone Return... -
Java Custom Catalog
Custom Catalog It’s possible to read an iceberg table either from an hdfs path or from a hive table. It’s also possible to use a custom metastore in place of hive. The steps to do...
