-
Structured Streaming
Spark Structured Streaming Iceberg uses Apache Spark’s DataSourceV2 API for data source and catalog implementations. Spark DSv2 is an evolving API with different levels of support... -
Logic
and isEmpty not or cond ifElse allPass anyPass defaultTo both complement either propSatisfies unless when pathSatisfies until and a → b → a | b Added in v0.1.... -
Graphs
Create a Graph create_graph() Delete a Graph drop_graph() How Graphs Are Stored In Postgres A graph consists of a set of vertices and edges, where each individual node and ed... -
Name Your Cluster
Steps Next Step Steps In Name your cluster , type a name for the cluster you want to create. Use no white spaces or special characters in the name. If you plan to Kerberiz... -
State Management and Watermarks
Managing Watermarks in a Job Basics Task Failures Multi-Dataset Jobs Gobblin State Deep Dive State class hierarchy How States are Used in a Gobblin Job This page has two p... -
Using Kyuubi By Terminal
Prerequisites : There must be a running Kyuubi. To deploy and run Kyuubi, please refer to Kyuubi doc Terminal supports interfacing with Kyuubi to submit SQL to Kyuubi for exec... -
Schedulers
Introduction Quartz Azkaban Oozie Launching Gobblin in Local Mode Example Config Files Uploading Files to HDFS Adding Gobblin jar Dependencies Launching the Job Launching ... -
Scalar Functions
id start_id end_id type properties head last length size startNode endNode timestamp toBoolean toFloat toInteger coalesce id id() returns the id of a vertex or e... -
Writes
Spark Writes To use Iceberg in Spark, first configure Spark catalogs . Some plans are only available when using Iceberg SQL extensions in Spark 3. Iceberg uses Apache Spark’s D... -
Logic
and isEmpty not or cond ifElse allPass anyPass defaultTo both complement either and a → b → a | b Added in v0.1.0 Returns the first argument if it is falsy, other...
