Currently, Gobblin supports the following feature list:

Different Data Sources

Source Type Protocol Vendors
RDMS JDBC MySQL/SQLServer
Files HDFS/SFTP/LocalFS N/A
Salesforce REST Salesforce

  • Different Pulling Types

    • SNAPSHOT-ONLY: Pull the snapshot of one dataset.
    • SNAPSHOT-APPEND: Pull delta changes since last run, optionally merge delta changes into snapshot (Delta changes include updates to the dataset since last run).
    • APPEND-ONLY: Pull delta changes since last run, and append to dataset.

  • Different Deployment Types

    • standalone deploy on a single machine
    • cluster deploy on hadoop 2.3.0

  • Compaction

    • Merge delta changes into snapshot.