Skip to content

Commit 0464123

Browse files
caishunfengAmy0104devosend
authored
[Feature-11223] support stream task (#11350)
* add task execute type * update task definition list paging * update task instance list paging * stream task start * [Feature][UI] Some changes to execute task. * Set the connection edge to dashed line. * Add FLINK_STREAM task. * add stream task * flink savepoint and cancel * fix query bug * add stream task definition * add task instance for stream task * delete stream task definition state * update api for stream task definition edit * modify search for stream task instance * add language * delete task type search for stream task definition * change task type search for stream task instance * add jump button * add savepoint * add down log for stream task instance * ui test * stream task start * run DAG * [Fix][UI] Fix the stream task edgs not to be dashed when filling back. * [Feature][UI] Remove some fields for FLINK_STREAM. * add start modal * add dryRun column for stream task instance * fix duration * fix pon * fix build error * Add success tip * add auto sync for stream task instance * remove forgien key for task instance * license header * UT fix * modify locales * recover common config * fix UT * add doc Co-authored-by: Amy <amywang0104@163.com> Co-authored-by: devosend <devosend@gmail.com>
1 parent b3919d3 commit 0464123

128 files changed

Lines changed: 4928 additions & 690 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,23 @@
11
# Task Definition
22

3+
## Batch Task Definition
34
Task definition allows to modify or operate tasks at the task level rather than modifying them in the workflow definition.
45
We already have workflow level task editor in [workflow definition](workflow-definition.md) which you can click the specific
56
workflow and then edit its task definition. It is depressing when you want to edit the task definition but do not remember
67
which workflow it belongs to. So we decide to add `Task Definition` view under `Task` menu.
78

8-
![task-definition](../../../../img/new_ui/dev/project/task-definition.jpg)
9+
![task-definition](../../../../img/new_ui/dev/project/batch-task-definition.png)
910

1011
In this view, you can create, query, update, delete task definition by click the related button in `operation` column. The
1112
most exciting thing is you could query task by task name in the wildcard, and it is useful when you only remember the task
1213
name but forget which workflow it belongs to. It is also supported query by the task name alone with `Task Type` or
1314
`Workflow Name`
15+
16+
## Stream Task Definition
17+
Stream task definitions are created in the workflow definition, and can be modified and executed.
18+
19+
![task-definition](../../../../img/new_ui/dev/project/stream-task-definition.png)
20+
21+
Click the execute button, check the execution parameters and click Confirm to submit the stream task.
22+
23+
![task-definition](../../../../img/new_ui/dev/project/stream-task-execute.png)
Lines changed: 13 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,23 @@
11
# Task Instance
22

3-
## Create Task Instance
3+
## Batch Task Instance
4+
### Create Task Instance
45

56
Click `Project Management -> Workflow -> Task Instance` to enter the task instance page, as shown in the figure below, click the name of the workflow instance to jump to the DAG diagram of the workflow instance to view the task status.
67

7-
![task-instance](../../../../img/new_ui/dev/project/task-instance.png)
8+
![task-instance](../../../../img/new_ui/dev/project/batch-task-instance.png)
89

9-
## View Log
10+
### View Log
1011

1112
Click the `View Log` button in the operation column to view the log of the task execution
1213

1314
![task-log](../../../../img/new_ui/dev/project/task-log.png)
15+
16+
## Stream Task Instance
17+
18+
-Switch to the stream task instance page, as shown in the following figure:
19+
20+
![task-instance](../../../../img/new_ui/dev/project/stream-task-instance.png)
21+
22+
- SavePoint: Click the `SavePoint` button in the operation column to do stream task savepoint.
23+
- Stop: Click the `Stop` button in the operation column to stop the stream task.

‎docs/docs/en/guide/project/workflow-definition.md‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,11 @@ Click the plus sign on the right of the task node to connect the task; as shown
3434

3535
![workflow-dependent](../../../../img/new_ui/dev/project/workflow-dependent.png)
3636

37+
### Dependencies with stream task
38+
If the DAG contains stream tasks, the relationship between stream tasks is displayed as a dotted line, and the execution of stream tasks will be skipped when the workflow instance is executed.
39+
40+
![workflow-dependent](../../../../img/new_ui/dev/project/workflow-definition-with-stream-task.png)
41+
3742
**Delete dependencies:** Using your mouse to select the connection line, and click the "Delete" icon in the upper right corner <img src= "../../../../img/delete.png" width="35"/>, delete dependencies between tasks.
3843

3944
![workflow-delete](../../../../img/new_ui/dev/project/workflow-delete.png)
Lines changed: 15 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,22 @@
11
# 任务定义
22

3-
任务定义允许您在基于任务级别而不是在工作流中操作修改任务。再此之前,我们已经有了工作流级别的任务编辑器,你可以在[工作流定义](workflow-definition.md)
3+
## 批量任务定义
4+
批量任务定义允许您在基于任务级别而不是在工作流中操作修改任务。再此之前,我们已经有了工作流级别的任务编辑器,你可以在[工作流定义](workflow-definition.md)
45
单击特定的工作流,然后编辑任务的定义。当您想编辑特定的任务定义但不记得它属于哪个工作流时,这是令人沮丧的。所以我们决定在 `任务` 菜单下添加 `任务定义` 视图。
56

6-
![task-definition](../../../../img/new_ui/dev/project/task-definition.jpg)
7+
![task-definition](../../../../img/new_ui/dev/project/batch-task-definition.png)
78

89
在该视图中,您可以通过单击 `操作` 列中的相关按钮来进行创建、查询、更新、删除任务定义。最令人兴奋的是您可以通过通配符进行全部任务查询,当您只
910
记得任务名称但忘记它属于哪个工作流时是非常有用的。也支持通过任务名称结合使用 `任务类型``工作流程名称` 进行查询。
11+
12+
13+
## 实时任务定义
14+
实时任务定义在工作流定义中创建,在任务定义页面可以进行修改和执行。
15+
16+
![task-definition](../../../../img/new_ui/dev/project/stream-task-definition.png)
17+
18+
点击实时任务执行,检查执行参数后点击确认,即可提交实时任务。
19+
20+
![task-definition](../../../../img/new_ui/dev/project/stream-task-execute.png)
21+
22+
Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,19 @@
11
# 任务实例
22

3+
## 批量任务实例
34
- 点击项目管理->工作流->任务实例,进入任务实例页面,如下图所示,点击工作流实例名称,可跳转到工作流实例DAG图查看任务状态。
45

5-
![task-instance](../../../../img/new_ui/dev/project/task-instance.png)
6+
![task-instance](../../../../img/new_ui/dev/project/batch-task-instance.png)
67

78
- 查看日志:点击操作列中的“查看日志”按钮,可以查看任务执行的日志情况。
89

910
![task-log](../../../../img/new_ui/dev/project/task-log.png)
11+
12+
## 实时任务实例
13+
14+
- 切换到实时任务实例页面,如下图所示:
15+
16+
![task-instance](../../../../img/new_ui/dev/project/stream-task-instance.png)
17+
18+
- SavePoint:点击操作列中的SavePoint按钮,可以进行实时任务的SavePoint。
19+
- Stop:点击操作列中的Stop按钮,可以停止该实时任务。

‎docs/docs/zh/guide/project/workflow-definition.md‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,10 @@
2424

2525
![workflow-dependent](../../../../img/new_ui/dev/project/workflow-dependent.png)
2626

27+
- **实时任务的依赖关系:** 若DAG中包含了实时任务的组件,��实时任务的关联关系显示为虚线,在执行工作流实例的时候会跳过实时任务的执行
28+
29+
![workflow-dependent](../../../../img/new_ui/dev/project/workflow-definition-with-stream-task.png)
30+
2731
- **删除依赖关系:** 点击右上角"箭头"图标<img src="../../../../img/arrow.png" width="35"/>,选中连接线,点击右上角"删除"图标<img src="../../../../img/delete.png" width="35"/>,删除任务间的依赖关系。
2832

2933
![workflow-delete](../../../../img/new_ui/dev/project/workflow-delete.png)
70.7 KB
Loading
71.3 KB
Loading
43.1 KB
Loading
65.1 KB
Loading

0 commit comments

Comments
 (0)