You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "David Yan (JIRA)" <ji...@apache.org> on 2016/05/09 19:57:12 UTC
[jira] [Commented] (APEXMALHAR-2082) Data Filter Operator
[ https://issues.apache.org/jira/browse/APEXMALHAR-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276907#comment-15276907 ]
David Yan commented on APEXMALHAR-2082:
---------------------------------------
Before doing any work on this, please look at library/src/main/java/com/datatorrent/lib/util/FilterOperator.java and see what feature is missing. One feature we can add is autometrics of how many tuples satisfied the filter and how many did not.
> Data Filter Operator
> ---------------------
>
> Key: APEXMALHAR-2082
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2082
> Project: Apache Apex Malhar
> Issue Type: New Feature
> Reporter: Pradeep A Dalvi
>
> Data Filter Operator which will allow apex users to filter (select/drop) tuples based on the certain condition from incoming stream.
> Use case:
> -------------
> In many cases, not all tuples are of interest for the downstream operators. In such cases, one may want select/filter out tuples to downstream. Also one may want to process tuples which did not meet the condition/expression.
> Functionality:
> -----------------
> 1. Any tuple for which expression could not be evaluated shall be emitted on error output port.
> 2. Filter operator shall receive POJO as input tuple and emit POJO on either of remaining output ports i.e. truePort and falsePort. As the output ports' name signify, when condition is met then the POJO shall be emitted on truePort and if condition is not met then that POJO shall be emitted on falsePort.
> 3. Operator needs condition/expression as a input param. This condition is based on expression language support we already have in Malhar.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)