-
DataHub
Configurations Example DataHub is a rich metadata platform that supports features like data discovery, data obeservability, federated governance, etc. Since Hudi 0.11.0, you c... -
AWS S3
AWS configs AWS Credentials AWS Libs AWS S3 Versioned Bucket In this page, we explain how to get your Hudi spark job to store into AWS S3. AWS configs There are two configur... -
Glue Data Catalog
Syncing to Glue Data Catalog Pre-requisites Steps Running sync Register the target table in Glue Data Catalog Validating the results Conclusion Syncing to Glue Data Catalo... -
Integrations
Does AWS GLUE support Hudi ? How to override Hudi jars in EMR? Does AWS GLUE support Hudi ? AWS Glue jobs can write, read and update Glue Data Catalog for hudi tables. In order... -
Exporter
Introduction Arguments Examples Copy a Hudi dataset Export to json or parquet dataset Re-partitioning Custom Re-partitioning Introduction HoodieSnapshotExporter allows you... -
Preparing to Set Up a Local Repository
Steps Next Steps More Information Before setting up your local repository, you must have met certain requirements. Selected an existing server, in or accessible to the cluste... -
4.14 Create an animation from multiple R plots
References When you generate a series of plots in a code chunk, you can combine them into an animation. It is easy to do so if the output format is HTML—you only need to install ... -
Creating your first interoperable table
Creating your first interoperable table Using Apache XTable™ (Incubating) to sync your source tables in different target format involves running sync on your current dataset usi... -
Hive Metastore
Syncing to Hive Metastore This document walks through the steps to register an Apache XTable™ (Incubating) synced table on Hive Metastore (HMS). Pre-requisites Source table(s) ... -
Architecture
Gobblin Architecture Overview Gobblin Job Flow Gobblin Constructs Source and Extractor Converter Quality Checker Fork Operator Data Writer Data Publisher Gobblin Task Flow...
