[jira] [Commented] (FLINK-18627) Get unmatch filter method records to side output

["Seth Wiesman (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-18627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161366#comment-17161366 ] 

Seth Wiesman commented on FLINK-18627:
--------------------------------------

Hi [~roeyshemtov], 

Thank you for opening this ticket. Can you explain a little more what you are trying to accomplish?  Flink already supports exactly this via a non-keyed processes function and side outputs[1]. My initial reaction is that this goes against the semantics of `filter` where the user wants to discard certain records where it seems like you are looking for more of a split. 

Seth 

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/stream/side_output.html

> Get unmatch filter method records to side output
> ------------------------------------------------
>
>                 Key: FLINK-18627
>                 URL: https://issues.apache.org/jira/browse/FLINK-18627
>             Project: Flink
>          Issue Type: New Feature
>          Components: API / DataStream
>            Reporter: Roey Shem Tov
>            Priority: Major
>             Fix For: 1.12.0
>
>
> Unmatch records to filter functions should send somehow to side output.
> Example:
>  
> {code:java}
> datastream
> .filter(i->i%2==0)
> .sideOutput(oddNumbersSideOutput);
> {code}
>  
>  
> That's way we can filter multiple times and send the filtered records to our side output instead of dropping it immediatly, it can be useful in many ways.
>  
> What do you think?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)