-
StarRocks
Querying from StarRocks StarRocks allows you to query table formats like Hudi, Delta and Iceberg tables using our external catalog feature. Users do not need additional configura... -
Parquet HDFS
Description Usage Example Pipeline Configuration Configuration Developer Notes Description An extension to FsDataWriter that writes in Parquet format in the form of either... -
WITH
Introduction Filter on aggregate function results Sort results before using collect on them Limit branching of a path search Introduction Using WITH , you can manipulate the ... -
Gobblin Compliance Design
Introduction Design Onboarding Purger Gobblin constructs Hive operations Retention Restore Introduction The Gobblin Compliance module allows for data purging to meet reg... -
Run Java SDK Demo
Run Java SDK Demo 1. TCP 1.1 ASYNC 1.2 BROADCAST 2 HTTP 2.1 ASYNC 3 GRPC 3.1 ASYNC Publish & Webhook Subscribe 3.2 SYNC Publish & Stream Subscribe 3.3 Publish BATCH Message ... -
Streaming Writes
Spark Streaming Spark Streaming You can write Hudi tables using spark’s structured streaming. Scala // spark-shell // prepare to stream write to new table import org .... -
Setting Up a Local Repository
Based on your Internet access, choose one of the following options: No Internet Access This option involves downloading the repository tarball, moving the tarball to the sele... -
Reliability
Reliability Iceberg was designed to solve correctness problems that affect Hive tables running in S3. Hive tables track data files using both a central metastore for partitions a... -
JDBC
Iceberg JDBC Integration JDBC Catalog Iceberg supports using a table in a relational database to manage Iceberg tables through JDBC. The database that JDBC connects to must suppo... -
Snowflake
Querying from Snowflake Currently, Snowflake supports Iceberg tables through External Tables and also Native Iceberg Tables . Iceberg on Snowflake is currently supported in pub...
