You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Andrei Shumanski (JIRA)" <ji...@apache.org> on 2018/05/28 14:23:00 UTC
[jira] [Updated] (FLINK-9453) Flink 1.5 incorrectly shows statistics in web UI

     [ https://issues.apache.org/jira/browse/FLINK-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrei Shumanski updated FLINK-9453:
------------------------------------
    Description: 
Flink 1.5.0 incorrectly shows execution statistics and differently from Flink 1.4.1.

I attach screenshots from both versions. It looks like 1.5.0 sums all steps in operators connected with "forward()". It makes it impossible to understand how much data was actually consumed.

My test code:

 

 

public static void main(String[] args) throws Exception {
 StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
 
 env.setStateBackend(new FsStateBackend("file:///mapr/rdidev1/user/eshuand/tmp/", true));
 
 List<Integer> input = new ArrayList<>();
 
 input.add(1);
 input.add(2);
 input.add(3);
 input.add(4);
 input.add(5);
 
 DataStream<Integer> stream = env.fromCollection(input).rebalance();
 
 stream.map(i -> i+1).name("incr").forward().map(i -> i-1).name("decr").forward().print();
 
 env.execute();

}

 

  was:
Flink 1.5.0 incorrectly shows execution statistics and differently from Flink 1.4.1.

I attach screenshots from both versions. It looks like 1.5.0 sums all steps in operators connected with "forward()". It makes it impossible to understand how much data was actually consumed.

My test code:

 

 

{{public static void main(String[] args) throws Exception {}}
{{ StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();}}

{{ List<Integer> input = new ArrayList<>();}}

{{ input.add(1);}}
{{ input.add(2);}}
{{ input.add(3);}}
{{ input.add(4);}}
{{ input.add(5);}}

{{ DataStream<Integer> stream = env.fromCollection(input).rebalance();}}

{{ stream.map(i -> i+1).name("incr").forward().map(i -> i-1).name("decr").forward().print();}}

{{ env.execute();}}{{}}}


> Flink 1.5 incorrectly shows statistics in web UI
> ------------------------------------------------
>
>                 Key: FLINK-9453
>                 URL: https://issues.apache.org/jira/browse/FLINK-9453
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming, Web Client, Webfrontend
>    Affects Versions: 1.5.0
>            Reporter: Andrei Shumanski
>            Priority: Major
>         Attachments: Flink_1.4.PNG, Flink_1.5.PNG
>
>
> Flink 1.5.0 incorrectly shows execution statistics and differently from Flink 1.4.1.
> I attach screenshots from both versions. It looks like 1.5.0 sums all steps in operators connected with "forward()". It makes it impossible to understand how much data was actually consumed.
> My test code:
>  
>  
> public static void main(String[] args) throws Exception {
>  StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
>  
>  env.setStateBackend(new FsStateBackend("file:///mapr/rdidev1/user/eshuand/tmp/", true));
>  
>  List<Integer> input = new ArrayList<>();
>  
>  input.add(1);
>  input.add(2);
>  input.add(3);
>  input.add(4);
>  input.add(5);
>  
>  DataStream<Integer> stream = env.fromCollection(input).rebalance();
>  
>  stream.map(i -> i+1).name("incr").forward().map(i -> i-1).name("decr").forward().print();
>  
>  env.execute();
> }
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)