You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Maximilian Michels (JIRA)" <ji...@apache.org> on 2015/12/07 16:47:11 UTC

[jira] [Created] (FLINK-3133) Introduce collect()/coun()/print() methods in DataStream API

Maximilian Michels created FLINK-3133:
-----------------------------------------

             Summary: Introduce collect()/coun()/print() methods in DataStream API
                 Key: FLINK-3133
                 URL: https://issues.apache.org/jira/browse/FLINK-3133
             Project: Flink
          Issue Type: Improvement
          Components: DataStream API, Streaming
    Affects Versions: 0.10.1, 0.10.0, 1.0.0
            Reporter: Maximilian Michels
             Fix For: 1.0.0


The DataSet API's methods {{collect()}}, {{count()}}, and {{print()}} should be mirrored to the DataStream API. 

The semantics of the calls are different. We need to be able to sample parts of a stream, e.g. by supplying a time period in the arguments to the methods. Collect/count/print should be lazily evaluated. Users should use the {{StreamEnvironment}} to retrieve the results.

{code:java}
StreamExecutionEnvironment env = StramEnvironment.getStreamExecutionEnvironment();

DataStream<Integer> printSink = env.addSource(..).print();

ResultQueryable queryObject = env.executeWithResultQueryable();

List<Integer> sampled = queryObject.retrieve(printSink, Time.seconds(5));
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)