You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/05/15 04:46:04 UTC
[jira] [Commented] (APEXMALHAR-2447) No indication from
AbstractFileInputOperator when directory is empty
[ https://issues.apache.org/jira/browse/APEXMALHAR-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009984#comment-16009984 ]
ASF GitHub Bot commented on APEXMALHAR-2447:
--------------------------------------------
GitHub user prasannapramod opened a pull request:
https://github.com/apache/apex-malhar/pull/619
APEXMALHAR-2447 Notification from AbstractFileInputOperator when scanning directory
APEXMALHAR-2447 Added notification in AbstractFileInputOperator, when scanning the directory for the first time. Implementations can use this information in different ways such as notifying downstream operators with a control tuple that a new directory has been scanned.
@DT-Priyanka please see.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/prasannapramod/apex-malhar APEXMALHAR-2447
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/apex-malhar/pull/619.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #619
----
commit 3a362984143dde0a89fb9538a704ed1f444f0204
Author: Lakshmi Prasanna Velineni <la...@datatorrent.com>
Date: 2017-03-16T15:27:39Z
APEXMALHAR-2447 Added notfication in AbstractFileInputOperator, when scanning the directory for first time. Implementations can use these information in different ways such as notifying downstream operators that a new directory has been scanned.
----
> No indication from AbstractFileInputOperator when directory is empty
> --------------------------------------------------------------------
>
> Key: APEXMALHAR-2447
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-2447
> Project: Apache Apex Malhar
> Issue Type: Improvement
> Reporter: Velineni Lakshmi Prasanna
> Assignee: Velineni Lakshmi Prasanna
> Priority: Minor
>
> AbstractFileInputOperator scans a directory for files and outputs the file contents. However, when the directory is empty nothing is sent. A downstream operator may want some basic information that the input directory is scanned, so for example, it can create an output folder. Add a notification to the operator when the directory is scanned for the first time. An implementation, for example, can use this notification to send a control tuple with the directory path notifying the downstream that the directory has been visited.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)