-
Parquet HDFS
Description Usage Example Pipeline Configuration Configuration Developer Notes Description An extension to FsDataWriter that writes in Parquet format in the form of either... -
Template
Overview How to Use Templates Available Templates How to Create Your Own Template How does Template Work in Gobblin Overview The job configuration template is implemented fo... -
Snowflake
Querying from Snowflake Currently, Snowflake supports Iceberg tables through External Tables and also Native Iceberg Tables . Iceberg on Snowflake is currently supported in pub... -
Copy
Description Options fields [config] common options [string] Example Changelog new version Copy transform plugin Description Copy a field to a new field. Options n... -
Source Common Options
result_table_name [string] parallelism [int] Example Common parameters of source connectors name type required default value result_table_name string no - ... -
Reliability
Reliability Iceberg was designed to solve correctness problems that affect Hive tables running in S3. Hive tables track data files using both a central metastore for partitions a... -
7.7 Embed the Rmd source file in the HTML output file
When you share an HTML output page with others, they may want the Rmd source file, too. For example, they may want to change the Rmd source and compile the report by themselves. Y... -
Gobblin Compliance Design
Introduction Design Onboarding Purger Gobblin constructs Hive operations Retention Restore Introduction The Gobblin Compliance module allows for data purging to meet reg... -
Knative
Knative Prerequisite Create Knative Source and Sink Set up EventMesh Configuration Step 2: Publish an Event Message from Knative Step 3: Subscribe from an EventMesh Expected Res... -
Software information and conventions
The basic R session information when compiling this book is as follows: xfun :: session_info ( c ( 'bookdown' , 'knitr' , 'rmarkdown' , 'xfun' ), dependencies = F...
