Http sink connector

Support Those Engines

Spark
Flink
SeaTunnel Zeta

Key Features

Description

Used to launch web hooks using data.

For example, if the data from upstream is [age: 12, name: tyrantlucifer], the body content is the following: {"age": 12, "name": "tyrantlucifer"}

Tips: Http sink only support post json webhook and the data from source will be treated as body content in web hook.

Supported DataSource Info

In order to use the Http connector, the following dependencies are required. They can be downloaded via install-plugin.sh or from the Maven central repository.

Datasource Supported Versions Dependency
Http universal Download

Sink Options

Name Type Required Default Description
url String Yes - Http request url
headers Map No - Http headers
retry Int No - The max retry times if request http return to IOException
retry_backoff_multiplier_ms Int No 100 The retry-backoff times(millis) multiplier if request http failed
retry_backoff_max_ms Int No 10000 The maximum retry-backoff times(millis) if request http failed
connect_timeout_ms Int No 12000 Connection timeout setting, default 12s.
socket_timeout_ms Int No 60000 Socket timeout setting, default 60s.
common-options No - Sink plugin common parameters, please refer to Sink Common Options for details

Example

simple:

  1. Http {
  2.     url = "http://localhost/test/webhook"
  3.     headers {
  4.         token = "9e32e859ef044462a257e1fc76730066"
  5.     }
  6. }

Changelog

2.2.0-beta 2022-09-26

  • Add Http Sink Connector