Filter transform plugin

Description

Filter the field.

Options

name type required default value
fields array yes

fields [array]

The list of fields that need to be kept. Fields not in the list will be deleted

common options [string]

Transform plugin common parameters, please refer to Transform Plugin for details

Example

The data read from source is a table like this:

name age card
Joy Ding 20 123
May Ding 20 123
Kin Dom 20 123
Joy Dom 20 123

We want to delete field age, we can add Filter Transform like this

  1. transform {
  2.   Filter {
  3.     source_table_name = "fake"
  4.     result_table_name = "fake1"
  5.     fields = [name, card]
  6.   }
  7. }

Then the data in result table fake1 will like this

name card
Joy Ding 123
May Ding 123
Kin Dom 123
Joy Dom 123

Changelog

new version

  • Add Filter Transform Connector