You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Josh Elser (JIRA)" <ji...@apache.org> on 2014/02/03 17:04:09 UTC
[jira] [Commented] (ACCUMULO-1472) MiniAccumulo cluster improperly
configures classpaths
[ https://issues.apache.org/jira/browse/ACCUMULO-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13889577#comment-13889577 ]
Josh Elser commented on ACCUMULO-1472:
--------------------------------------
The {{null/lib/*.jar}} in the {{general.classpaths}} value was bugging me. Turns out there's another small issue there -- we reference ACCUMULO_HOME from the current environment, but that value doesn't necessarily exist yet (if it does, it isn't the right one). When we exec out to the Accumulo processes, that where we turn the File from the MiniAccumuloConfig into the ACCUMULO_HOME env variable.
> MiniAccumulo cluster improperly configures classpaths
> -----------------------------------------------------
>
> Key: ACCUMULO-1472
> URL: https://issues.apache.org/jira/browse/ACCUMULO-1472
> Project: Accumulo
> Issue Type: Bug
> Components: mini
> Affects Versions: 1.5.0
> Reporter: Keith Turner
> Assignee: Josh Elser
> Priority: Trivial
> Fix For: 1.5.1, 1.6.0
>
>
> I used instamo to run an Accumulo shell against MiniAccumuloCluster. I ran the classpath command and noticed it was referencing the hadoop jars from my local hadoop install. It was also referencing the hadoop jars from maven.
> I looked at the accumulo-site.xml generated MAC and saw the following :
> {noformat}
> <property><name>general.classpaths</name><value>null/lib/.*.jar,$ZOOKEEPER_HOME/zookeeper[^.].*.jar,$HADOOP_HOME/[^.].*.jar,$HADOOP_HOME/lib/[^.].*.jar,$HADOOP_PREFIX/share/hadoop/common/.*.jar,$HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,$HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,$HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar</value></property>
> {noformat}
> I think this prop should be empty. Below is what I saw when running classpath. Also, I do not think it should print the warning.
> {noformat}
> root@miniInstance !METADATA> classpath
> [main] WARN org.apache.accumulo.start.classloader.vfs.AccumuloVFSClassLoader - ignoring classpath entry file:///lib/ext/[^.].*.jar
> Level 1: Java System Classloader (loads Java system resources) URL classpath items are:
> file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/dnsns.jar
> file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/localedata.jar
> file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/sunpkcs11.jar
> file:/home/kturner/software/jdk1.6.0_33/jre/lib/ext/sunjce_provider.jar
> Level 2: Java Classloader (loads everything defined by java classpath) URL classpath items are:
> file:/home/kturner/instamo-example/target/classes/
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-core/1.5.0/accumulo-core-1.5.0.jar
> file:/home/kturner/.m2/repository/com/beust/jcommander/1.30/jcommander-1.30.jar
> file:/home/kturner/.m2/repository/jline/jline/1.0/jline-1.0.jar
> file:/home/kturner/.m2/repository/org/apache/commons/commons-vfs2/2.0/commons-vfs2-2.0.jar
> file:/home/kturner/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar
> file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-api/1.4/maven-scm-api-1.4.jar
> file:/home/kturner/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.6/plexus-utils-1.5.6.jar
> file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-provider-svnexe/1.4/maven-scm-provider-svnexe-1.4.jar
> file:/home/kturner/.m2/repository/org/apache/maven/scm/maven-scm-provider-svn-commons/1.4/maven-scm-provider-svn-commons-1.4.jar
> file:/home/kturner/.m2/repository/regexp/regexp/1.3/regexp-1.3.jar
> file:/home/kturner/.m2/repository/org/apache/thrift/libthrift/0.9.0/libthrift-0.9.0.jar
> file:/home/kturner/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar
> file:/home/kturner/.m2/repository/org/apache/httpcomponents/httpclient/4.1.3/httpclient-4.1.3.jar
> file:/home/kturner/.m2/repository/org/apache/httpcomponents/httpcore/4.1.3/httpcore-4.1.3.jar
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-fate/1.5.0/accumulo-fate-1.5.0.jar
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-server/1.5.0/accumulo-server-1.5.0.jar
> file:/home/kturner/.m2/repository/com/google/code/gson/gson/2.2.2/gson-2.2.2.jar
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-test/1.5.0/accumulo-test-1.5.0.jar
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-minicluster/1.5.0/accumulo-minicluster-1.5.0.jar
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-start/1.5.0/accumulo-start-1.5.0.jar
> file:/home/kturner/.m2/repository/org/apache/accumulo/accumulo-trace/1.5.0/accumulo-trace-1.5.0.jar
> file:/home/kturner/.m2/repository/org/apache/zookeeper/zookeeper/3.3.6/zookeeper-3.3.6.jar
> file:/home/kturner/.m2/repository/log4j/log4j/1.2.15/log4j-1.2.15.jar
> file:/home/kturner/.m2/repository/javax/mail/mail/1.4/mail-1.4.jar
> file:/home/kturner/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar
> file:/home/kturner/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar
> file:/home/kturner/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar
> file:/home/kturner/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar
> file:/home/kturner/.m2/repository/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar
> file:/home/kturner/.m2/repository/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar
> file:/home/kturner/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar
> file:/home/kturner/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar
> file:/home/kturner/.m2/repository/commons-httpclient/commons-httpclient/3.0.1/commons-httpclient-3.0.1.jar
> file:/home/kturner/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar
> file:/home/kturner/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> file:/home/kturner/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar
> file:/home/kturner/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar
> file:/home/kturner/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar
> file:/home/kturner/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar
> file:/home/kturner/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar
> file:/home/kturner/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
> file:/home/kturner/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar
> file:/home/kturner/.m2/repository/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar
> file:/home/kturner/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar
> file:/home/kturner/.m2/repository/tomcat/jasper-runtime/5.5.12/jasper-runtime-5.5.12.jar
> file:/home/kturner/.m2/repository/tomcat/jasper-compiler/5.5.12/jasper-compiler-5.5.12.jar
> file:/home/kturner/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar
> file:/home/kturner/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar
> file:/home/kturner/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar
> file:/home/kturner/.m2/repository/ant/ant/1.6.5/ant-1.6.5.jar
> file:/home/kturner/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar
> file:/home/kturner/.m2/repository/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar
> file:/home/kturner/.m2/repository/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar
> file:/home/kturner/.m2/repository/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar
> file:/home/kturner/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar
> file:/home/kturner/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar
> file:/home/kturner/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
> file:/home/kturner/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
> Level 3: Accumulo Classloader (loads everything defined by general.classpaths) URL classpath items are:
> file:/home/kturner/software/zookeeper/zookeeper-3.3.5.jar
> file:/home/kturner/software/hadoop/hadoop-client-1.0.3.jar
> file:/home/kturner/software/hadoop/hadoop-ant-1.0.3.jar
> file:/home/kturner/software/hadoop/hadoop-core-1.0.3.jar
> file:/home/kturner/software/hadoop/hadoop-test-1.0.3.jar
> file:/home/kturner/software/hadoop/hadoop-tools-1.0.3.jar
> file:/home/kturner/software/hadoop/hadoop-minicluster-1.0.3.jar
> file:/home/kturner/software/hadoop/hadoop-examples-1.0.3.jar
> file:/home/kturner/software/hadoop/lib/commons-collections-3.2.1.jar
> file:/home/kturner/software/hadoop/lib/commons-beanutils-1.7.0.jar
> file:/home/kturner/software/hadoop/lib/jasper-compiler-5.5.12.jar
> file:/home/kturner/software/hadoop/lib/jasper-runtime-5.5.12.jar
> file:/home/kturner/software/hadoop/lib/servlet-api-2.5-20081211.jar
> file:/home/kturner/software/hadoop/lib/slf4j-log4j12-1.4.3.jar
> file:/home/kturner/software/hadoop/lib/aspectjrt-1.6.5.jar
> file:/home/kturner/software/hadoop/lib/commons-logging-api-1.0.4.jar
> file:/home/kturner/software/hadoop/lib/mockito-all-1.8.5.jar
> file:/home/kturner/software/hadoop/lib/jackson-core-asl-1.8.8.jar
> file:/home/kturner/software/hadoop/lib/jsch-0.1.42.jar
> file:/home/kturner/software/hadoop/lib/jersey-core-1.8.jar
> file:/home/kturner/software/hadoop/lib/hadoop-fairscheduler-1.0.3.jar
> file:/home/kturner/software/hadoop/lib/kfs-0.2.2.jar
> file:/home/kturner/software/hadoop/lib/asm-3.2.jar
> file:/home/kturner/software/hadoop/lib/log4j-1.2.15.jar
> file:/home/kturner/software/hadoop/lib/jersey-json-1.8.jar
> file:/home/kturner/software/hadoop/lib/hsqldb-1.8.0.10.jar
> file:/home/kturner/software/hadoop/lib/jersey-server-1.8.jar
> file:/home/kturner/software/hadoop/lib/slf4j-api-1.4.3.jar
> file:/home/kturner/software/hadoop/lib/commons-httpclient-3.0.1.jar
> file:/home/kturner/software/hadoop/lib/commons-configuration-1.6.jar
> file:/home/kturner/software/hadoop/lib/junit-4.5.jar
> file:/home/kturner/software/hadoop/lib/commons-logging-1.1.1.jar
> file:/home/kturner/software/hadoop/lib/commons-beanutils-core-1.8.0.jar
> file:/home/kturner/software/hadoop/lib/commons-math-2.1.jar
> file:/home/kturner/software/hadoop/lib/core-3.1.1.jar
> file:/home/kturner/software/hadoop/lib/jetty-util-6.1.26.jar
> file:/home/kturner/software/hadoop/lib/jackson-mapper-asl-1.8.8.jar
> file:/home/kturner/software/hadoop/lib/hadoop-capacity-scheduler-1.0.3.jar
> file:/home/kturner/software/hadoop/lib/jets3t-0.6.1.jar
> file:/home/kturner/software/hadoop/lib/aspectjtools-1.6.5.jar
> file:/home/kturner/software/hadoop/lib/hadoop-thriftfs-1.0.3.jar
> file:/home/kturner/software/hadoop/lib/commons-digester-1.8.jar
> file:/home/kturner/software/hadoop/lib/xmlenc-0.52.jar
> file:/home/kturner/software/hadoop/lib/jdeb-0.8.jar
> file:/home/kturner/software/hadoop/lib/commons-daemon-1.0.1.jar
> file:/home/kturner/software/hadoop/lib/jetty-6.1.26.jar
> file:/home/kturner/software/hadoop/lib/commons-codec-1.4.jar
> file:/home/kturner/software/hadoop/lib/commons-el-1.0.jar
> file:/home/kturner/software/hadoop/lib/commons-io-2.1.jar
> file:/home/kturner/software/hadoop/lib/commons-cli-1.2.jar
> file:/home/kturner/software/hadoop/lib/commons-net-1.4.1.jar
> file:/home/kturner/software/hadoop/lib/oro-2.0.8.jar
> file:/home/kturner/software/hadoop/lib/commons-lang-2.4.jar
> Level 4: Accumulo Dynamic Classloader (loads everything defined by general.dynamic.classpaths) VFS classpaths items are:
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)