You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink Jira Bot (Jira)" <ji...@apache.org> on 2022/01/01 22:39:00 UTC
[jira] [Updated] (FLINK-7018) Refactor streamGraph to make interfaces clear
[ https://issues.apache.org/jira/browse/FLINK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Flink Jira Bot updated FLINK-7018:
----------------------------------
Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned pull-request-available (was: auto-deprioritized-major auto-unassigned pull-request-available stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any updates so it is being deprioritized. If this ticket is actually Minor, please raise the priority and ask a committer to assign you the issue or revive the public discussion.
> Refactor streamGraph to make interfaces clear
> ---------------------------------------------
>
> Key: FLINK-7018
> URL: https://issues.apache.org/jira/browse/FLINK-7018
> Project: Flink
> Issue Type: Improvement
> Components: API / DataStream
> Reporter: Xu Pingyong
> Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor, auto-unassigned, pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Motivation:
> 1. StreamGraph is a graph consisted of some streamNodes. So virtual nodes (such as select, sideOutput, partition) should be moved away from it. Main iterfaces of StreamGraph should be as following:
> addSource(StreamNode sourceNode)
> addSink(StreamNode sinkNode)
> addOperator(StreamNode streamNode)
> addEdge(Integer upStreamVertexID, Integer downStreamVertexID, StreamEdge.InputOrder inputOrder, StreamPartitioner<?> partitioner, List<String> outputNames, OutputTag outputTag)
> getJobGraph()
> 2. StreamExecutionEnvironment should not be in StreamGraph, I create StreamGraphProperties which extracts all env information the streamGraph needs from StreamExecutionEnvironment. It contains:
> 1) executionConfig
> 2) checkpointConfig
> 3) timeCharacteristic
> 4) stateBackend
> 5) chainingEnabled
> 6) cachedFiles
> 7) jobName
>
> Related Changes:
> I moved the part of dealing with virtual nodes to StreamGraphGenerator. And get properties of StreamGraph from StreamGraphProperties instead of StreamExecutionEnvironment.
>
> It is only a code abstraction internally.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)