Replace transform plugin

Description

Examines string value in a given field and replaces substring of the string value that matches the given string literal or regexes with the given replacement.

Options

replace_field [string]

The field you want to replace

pattern [string]

The old string that will be replaced

replacement [string]

The new string for replace

is_regex [boolean]

Use regex for string match

replace_first [boolean]

Whether replace the first match string. Only used when is_regex = true.

common options [string]

Transform plugin common parameters, please refer to Transform Plugin for details

Example

The data read from source is a table like this:

We want to replace the char ` to_at thenamefield. Then we can add aReplace` Transform like this:

transform {
  Replace {
    source_table_name = "fake"
    result_table_name = "fake1"
    replace_field = "name"
    pattern = " "
    replacement = "_"
    is_regex = true
  }
}

Then the data in result table fake1 will update to

Job Config Example

env {
  job.mode = "BATCH"
}
source {
  FakeSource {
    result_table_name = "fake"
    row.num = 100
    schema = {
      fields {
        id = "int"
        name = "string"
      }
    }
  }
}
transform {
  Replace {
    source_table_name = "fake"
    result_table_name = "fake1"
    replace_field = "name"
    pattern = ".+"
    replacement = "b"
    is_regex = true
  }
}
sink {
  Console {
    source_table_name = "fake1"
  }
}

Changelog

new version

• Add Replace Transform Connector