Background

In production practice, in order to manage the Flink job properly, there is always a need to integrate it with external services, such as code repository, metrics monitoring page, real time logging, or checkpoint/savepoint folder on HDFS/OSS, etc.

Streampark, as an one-stop Flink DevOps platform, will bring more values to user, if it can provide the capability of integrating those services in form of dynamic link, which can be defined in centeralised place, and applied to each Flink job automatically.

How to create the external link

Login as system admin, go to the Settings module, and click the External Link from the navigation bar. From the listing page, you are able to click the Add New button and create new entry.

In the detail page, each link consists of label(optional), name, color and link. And they can make a clickable badge together. Color can be either chosen from the color picker, or just click the samples on the right side to follow the pattern, and after that you can preview the badge immediately. And last but not least, the link can be definded with placeholder, including job_id, job_name and yarn_id, all of that can be replaced with real values, and become a clickable badge when the Flink Job is spinned up.

Where can see the external link

After the Flink job starts, you can go to the Application module, and click the Flink job from the list page. After that, all the defined badges will be displayed on the top of the detail page, and upon click, request will be redirected to desired external service page.