[jira] Commented: (CHUKWA-460) Demux depends on conf/chukwa-collector-conf.xml

["Eric Yang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CHUKWA-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12842020#action_12842020 ] 

Eric Yang commented on CHUKWA-460:
----------------------------------

Demux process should not be using writer.hdfs.filesystem.  The original implementation made a mistake to use "writer.hdfs.filesystem" as reference to hdfs.  Instead, demux should pick up the proper hdfs url from HADOOP_CONF_DIR.  I don't have any objection on the suggested workaround, but less configuration that we need to maintain, the better.


> Demux depends on conf/chukwa-collector-conf.xml
> -----------------------------------------------
>
>                 Key: CHUKWA-460
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-460
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: Data Processors
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>
> We've packaged our own chukwa rpms to be able to deploy the collector, the agent and the data processor each separately. In doing so I realized that the data processor (i.e., Demux) has a dependency on conf/chukwa-collector-conf.xml as packaged in the distro, since that's the only place where where 'writer.hdfs.filesystem' is set.
> The workaround is straight forward enough (just add writer.hdfs.filesystem to chukwa-demux.xml), but I thought I'd point out the cross-dependency. Although it feels redundant, it seems the proper thing to do would be to include writer.hdfs.filesystem in both configs, since both processes have that dep. Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.