You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "amit tiwari (JIRA)" <ji...@apache.org> on 2016/09/26 16:29:20 UTC

[jira] [Created] (BIGTOP-2541) hadoop classpath gets messed up on running TestHadoopExamples

amit tiwari created BIGTOP-2541:
-----------------------------------

             Summary: hadoop classpath gets messed up on running TestHadoopExamples
                 Key: BIGTOP-2541
                 URL: https://issues.apache.org/jira/browse/BIGTOP-2541
             Project: Bigtop
          Issue Type: Bug
          Components: hadoop
    Affects Versions: 1.1.0
            Reporter: amit tiwari


`hadoop classpath` gets messed up when running hadoop examples, like so: mvn clean verify -Dorg.apache.bigtop.itest.log4j.level=TRACE -D'org.apache.maven-failsafe-plugin.testInclude=**/*TestHadoopExamples*' -f bigtop-tests/test-execution/smokes/hadoop/pom.xml

BEFORE CLASSPATH: /etc/hadoop:/opt/hadoop/share/hadoop/common/lib/*:/opt/hadoop/share/hadoop/common/*:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/*:/opt/hadoop/share/hadoop/hdfs/*:/opt/hadoop/share/hadoop/yarn/lib/*:/opt/hadoop/share/hadoop/yarn/*:/opt/hadoop/share/hadoop/mapreduce/lib/*:/opt/hadoop/share/hadoop/mapreduce/*:/opt/hadoop/share/hadoop/tools/lib/*:/opt/alti-kafka-sink-0.2.0/hadoop-kafka-2.7.1.jar:/opt/alti-kafka-sink-0.2.0/kafka-clients-0.9.0.0.jar:/opt/alti-node-decommissioner/decommissioner-0.4.0.jar:/opt/alti-node-decommissioner/decommissioner.jar

INCORRECT_AFTER_CLASSPATH:
/etc/hadoop:/opt/hadoop/share/hadoop/common/lib/*:/opt/hadoop/share/hadoop/common/*:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/*:/opt/hadoop/share/hadoop/hdfs/*:/opt/hadoop/share/hadoop/yarn/lib/*:/opt/hadoop/share/hadoop/yarn/*:/opt/hadoop/share/hadoop/mapreduce//share/hadoop/mapreduce/*:/opt/hadoop/share/hadoop/tools/lib/*:/opt/alti-kafka-sink-0.2.0/hadoop-kafka-2.7.1.jar:/opt/alti-kafka-sink-0.2.0/kafka-clients-0.9.0.0.jar:/opt/alti-node-decommissioner/decommissioner-0.4.0.jar:/opt/alti-node-decommissioner/decommissioner.jar

Notice, how the ":/opt/hadoop/share/hadoop/mapreduce/*:" gets replaced by ":/opt/hadoop/share/hadoop/mapreduce//share/hadoop/mapreduce/*:"

Steps:
#1) export HADOOP_MAPRED_HOME=/opt/hadoop/share/hadoop/mapreduce/
 This is a required step, because it expects this system variable to be defined
#2) mvn clean verify -Dorg.apache.bigtop.itest.log4j.level=TRACE -D'org.apache.maven-failsafe-plugin.testInclude=**/*TestHadoopExamples*' -f bigtop-tests/test-execution/smokes/hadoop/pom.xml
#3) The preceding step would have borked the `hadoop classpath`





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)