You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Randy Gelhausen (JIRA)" <ji...@apache.org> on 2016/11/10 16:06:58 UTC

[jira] [Resolved] (MINIFI-96) MiNiFi-cpp GetFile "recurse subdirectories" only recurses one directory deep

     [ https://issues.apache.org/jira/browse/MINIFI-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Randy Gelhausen resolved MINIFI-96.
-----------------------------------
    Resolution: Cannot Reproduce

> MiNiFi-cpp GetFile "recurse subdirectories" only recurses one directory deep
> ----------------------------------------------------------------------------
>
>                 Key: MINIFI-96
>                 URL: https://issues.apache.org/jira/browse/MINIFI-96
>             Project: Apache NiFi MiNiFi
>          Issue Type: Bug
>          Components: C++, Core Framework
>            Reporter: Randy Gelhausen
>
> I am generating files with the following naming schems:
> /host-data/metrics/$METRIC/$HOSTNAME/$MINUTE/$UNIXTIME
> $METRIC is "ps", "nmon", "netstat", etc.
> Using the following GetFile yml config:
> Processors:
> - name: GetNMon
>   class: org.apache.nifi.processors.standard.GetFile
>   max concurrent tasks: 1
>   scheduling strategy: TIMER_DRIVEN
>   scheduling period: 0 sec 
>   penalization period: 30 sec 
>   yield period: 1 sec 
>   run duration nanos: 0
>   auto-terminated relationships list: []
>   Properties:
>     Batch Size:
>     File Filter:
>     Ignore Hidden Files:
>     Input Directory: /host-data/metrics/nmon/HOSTNAME
>     Keep Source File:
>     Maximum File Age:
>     Maximum File Size:
>     Minimum File Age: 10 sec 
>     Minimum File Size:
>     Path Filter:
>     Polling Interval:
>     Recurse Subdirectories:
> In minifi-app.log.txt I see repeated entries for the $MINUTE folders, but no entries for the $UNIXTIME files underneath those $MINUTE folders.
> I suspect the default "false" Keep Subdirectories value is causing MiNiFi to repeatedly send the $MINUTE folders and never progress into the files underneath.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)