To read a OneTable synced target table (regardless of the table format) in Apache Spark locally or on services like Amazon EMR, Google Cloud’s Dataproc, Azure HDInsight, or Databricks, you do not need additional jars or configs other than what is needed by the respective table formats.

Refer to the project specific documentation for the required configurations that needs to be passed in when you create the spark session or when you submit a spark job.

Hudi

• For Hudi, refer the Spark Guide page

df = spark.read.format("hudi").load("/path/to/source/data")

Delta

• For Delta Lake, refer the Set up interactive shell page

df = spark.read.format("delta").load("/path/to/source/data")

Iceberg

• For Iceberg, refer Using Iceberg in Spark 3 page

df = spark.read.format("iceberg").load("/path/to/source/data")