You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Michael Moser (JIRA)" <ji...@apache.org> on 2016/11/21 14:47:58 UTC
[jira] [Commented] (NIFI-3068) NiFi can not reliably support
multiple HDFS clusters in the same flow
[ https://issues.apache.org/jira/browse/NIFI-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15683757#comment-15683757 ]
Michael Moser commented on NIFI-3068:
-------------------------------------
Thought this was fixed by NIFI-2471, but maybe it broke again?
> NiFi can not reliably support multiple HDFS clusters in the same flow
> ---------------------------------------------------------------------
>
> Key: NIFI-3068
> URL: https://issues.apache.org/jira/browse/NIFI-3068
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.0.0
> Reporter: Sam Hjelmfelt
> Labels: HDFS
>
> The HDFS configurations in PutHDFS are not respected when two (or more) PutHDFS processors exist with different configurations. The second processor to run will use the configurations from the first processor. This can cause data to be written to the wrong cluster.
> This appears to be caused by configuration caching in AbstractHadoopProcessor, which would affect all HDFS processors.
> https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/src/main/java/org/apache/nifi/processors/hadoop/AbstractHadoopProcessor.java#L144
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)