Common parameters of source connectors

name type required default value
result_table_name string no -
parallelism int no -

result_table_name [string]

When result_table_name is not specified, the data processed by this plugin will not be registered as a data set (dataStream/dataset) that can be directly accessed by other plugins, or called a temporary table (table) ;

When result_table_name is specified, the data processed by this plugin will be registered as a data set (dataStream/dataset) that can be directly accessed by other plugins, or called a temporary table (table) . The data set (dataStream/dataset) registered here can be directly accessed by other plugins by specifying source_table_name .

parallelism [int]

When parallelism is not specified, the parallelism in env is used by default.

When parallelism is specified, it will override the parallelism in env.

Example

  1. source {
  2.     FakeSourceStream {
  3.         result_table_name = "fake"
  4.     }
  5. }

The result of the data source FakeSourceStream will be registered as a temporary table named fake . This temporary table can be used by any Transform or Sink plugin by specifying source_table_name .