You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "E. Sammer (JIRA)" <ji...@apache.org> on 2012/05/05 00:11:48 UTC

[jira] [Created] (FLUME-1179) flume-ng script silently fails if HADOOP_HOME isn't absolute

E. Sammer created FLUME-1179:
--------------------------------

             Summary: flume-ng script silently fails if HADOOP_HOME isn't absolute
                 Key: FLUME-1179
                 URL: https://issues.apache.org/jira/browse/FLUME-1179
             Project: Flume
          Issue Type: Bug
    Affects Versions: v1.1.0
            Reporter: E. Sammer


Running bin/flume-ng fails silently if you specify HADOOP_HOME as a relative path (and you're using the HDFS sink). After configuration, the agent just blocks. It has something to do with the way the path is resolved. Very strange. I don't have time to debug right now, but I didn't want to lose this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (FLUME-1179) flume-ng script silently fails if HADOOP_HOME isn't absolute

Posted by "Hari Shreedharan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268756#comment-13268756 ] 

Hari Shreedharan commented on FLUME-1179:
-----------------------------------------

I have seen this happen in other cases too. Basically if it cannot find the hadoop jar, when Class.forName() tries to create the class object for a class which has members which are from the hadoop jar, a NoClassDefFoundError is thrown(Class.forName throws a NoClassDefFoundError if it cant find the class for something defined inside a class it is trying to create the class object for - it throws a ClassNotFoundException if it can't find the class whose class object it is trying to load) . If you run it in a debugger, you can see that this causes the code to jump to the finally block in PropertiesFileConfigurationProvider#load(), and exits the function, and then nothing happens, not even the polling of the configuration file. 

This happens if anything that has a hadoop supplied class's object inside another class and the hadoop jar isn't in class path or can't be found. RecoverableMemoryChannel is an example - take a look at FLUME-1137.
                
> flume-ng script silently fails if HADOOP_HOME isn't absolute
> ------------------------------------------------------------
>
>                 Key: FLUME-1179
>                 URL: https://issues.apache.org/jira/browse/FLUME-1179
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.1.0
>            Reporter: E. Sammer
>
> Running bin/flume-ng fails silently if you specify HADOOP_HOME as a relative path (and you're using the HDFS sink). After configuration, the agent just blocks. It has something to do with the way the path is resolved. Very strange. I don't have time to debug right now, but I didn't want to lose this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira