You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/10/02 16:09:00 UTC

[jira] [Commented] (APEXMALHAR-2250) AbstractFileInputOperator.DirectoryScanner does not handle directories correctly.

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16188362#comment-16188362 ] 

ASF GitHub Bot commented on APEXMALHAR-2250:
--------------------------------------------

vrozov closed pull request #419: APEXMALHAR-2250: Ignore directories while scanning.
URL: https://github.com/apache/apex-malhar/pull/419
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> AbstractFileInputOperator.DirectoryScanner does not handle directories correctly.
> ---------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-2250
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2250
>             Project: Apache Apex Malhar
>          Issue Type: Bug
>            Reporter: Tushar Gosavi
>
> The default DirectoryScanner defined in AbstractFileInputOperator does not handle directories correctly. If there is a directory in the configured path, it gets added as a file in pendingFile list and when operator tries to open it for reading
> it fails, the operator keeps retrying for configured number of time and then ignore this file.
> The fix would be to not return directory name in scanned file names in the first place.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)