You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Joseph Witt (JIRA)" <ji...@apache.org> on 2016/03/13 19:31:33 UTC
[jira] [Commented] (NIFI-1588) ListHDFS to retaining wrong state in
zookeeper
[ https://issues.apache.org/jira/browse/NIFI-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192466#comment-15192466 ]
Joseph Witt commented on NIFI-1588:
-----------------------------------
[~markap14] reviewing this and NIFI-1587. It would be great if they were a single patch (actually PR but we'll fight that battle another day). Can you merge them?
> ListHDFS to retaining wrong state in zookeeper
> ----------------------------------------------
>
> Key: NIFI-1588
> URL: https://issues.apache.org/jira/browse/NIFI-1588
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 0.4.1
> Environment: latest 0.5.1
> Reporter: Matthew Clarke
> Assignee: Mark Payne
> Fix For: 0.6.0
>
> Attachments: 0001-NIFI-1588-Reworked-how-ListHDFS-store-state-so-that-.patch
>
>
> The expected state that should be retained by listHDFS processor is the last modified timestamp. The processor instead is retaining the filename and path of every file it lists. This results in excessive disk usage by zookeeper to retain this filename based state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)