You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2017/10/30 11:05:00 UTC
[jira] [Closed] (FLINK-5235) Don't automatically add HBase
classpath to Flink classpath
[ https://issues.apache.org/jira/browse/FLINK-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aljoscha Krettek closed FLINK-5235.
-----------------------------------
Resolution: Won't Fix
Superseded by FLINK-7944
> Don't automatically add HBase classpath to Flink classpath
> ----------------------------------------------------------
>
> Key: FLINK-5235
> URL: https://issues.apache.org/jira/browse/FLINK-5235
> Project: Flink
> Issue Type: Bug
> Components: Startup Shell Scripts
> Reporter: Maximilian Michels
>
> If the {{HBASE_CONF_DIR}} is set, the startup script adds the output of {{hbase classpath}} to the classpath. This is a huge list of dependencies which is very likely to clash with Flink dependencies.
> For example, on my machine:
> {noformat}
> /Users/max/Downloads/hbase-1.1.6/conf/:/Library/Java/JavaVirtualMachines/jdk1.8.0_40.jdk/Contents/Home/lib/tools.jar:/Users/max/Downloads/hbase-1.1.6/:/Users/max/Downloads/hbase-1.1.6//lib/activation-1.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/aopalliance-1.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/apacheds-i18n-2.0.0-M15.jar:/Users/max/Downloads/hbase-1.1.6//lib/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/max/Downloads/hbase-1.1.6//lib/api-asn1-api-1.0.0-M20.jar:/Users/max/Downloads/hbase-1.1.6//lib/api-util-1.0.0-M20.jar:/Users/max/Downloads/hbase-1.1.6//lib/asm-3.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/avro-1.7.4.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-beanutils-1.7.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-beanutils-core-1.8.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-cli-1.2.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-codec-1.9.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-collections-3.2.2.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-compress-1.4.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-configuration-1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-daemon-1.0.13.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-digester-1.8.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-el-1.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-httpclient-3.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-io-2.4.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-lang-2.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-logging-1.2.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-math-2.2.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-math3-3.1.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/commons-net-3.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/disruptor-3.3.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/findbugs-annotations-1.3.9-1.jar:/Users/max/Downloads/hbase-1.1.6//lib/guava-12.0.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/guice-3.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/guice-servlet-3.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-annotations-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-auth-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-client-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-common-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-hdfs-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-mapreduce-client-app-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-mapreduce-client-common-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-mapreduce-client-core-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-yarn-api-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-yarn-client-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-yarn-common-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hadoop-yarn-server-common-2.5.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-annotations-1.1.6-tests.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-annotations-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-client-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-common-1.1.6-tests.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-common-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-examples-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-hadoop-compat-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-hadoop2-compat-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-it-1.1.6-tests.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-it-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-prefix-tree-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-procedure-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-protocol-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-resource-bundle-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-rest-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-server-1.1.6-tests.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-server-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-shell-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/hbase-thrift-1.1.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/htrace-core-3.1.0-incubating.jar:/Users/max/Downloads/hbase-1.1.6//lib/httpclient-4.2.5.jar:/Users/max/Downloads/hbase-1.1.6//lib/httpcore-4.1.3.jar:/Users/max/Downloads/hbase-1.1.6//lib/jackson-core-asl-1.9.13.jar:/Users/max/Downloads/hbase-1.1.6//lib/jackson-jaxrs-1.9.13.jar:/Users/max/Downloads/hbase-1.1.6//lib/jackson-mapper-asl-1.9.13.jar:/Users/max/Downloads/hbase-1.1.6//lib/jackson-xc-1.9.13.jar:/Users/max/Downloads/hbase-1.1.6//lib/jamon-runtime-2.3.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/jasper-compiler-5.5.23.jar:/Users/max/Downloads/hbase-1.1.6//lib/jasper-runtime-5.5.23.jar:/Users/max/Downloads/hbase-1.1.6//lib/java-xmlbuilder-0.4.jar:/Users/max/Downloads/hbase-1.1.6//lib/javax.inject-1.jar:/Users/max/Downloads/hbase-1.1.6//lib/jaxb-api-2.2.2.jar:/Users/max/Downloads/hbase-1.1.6//lib/jaxb-impl-2.2.3-1.jar:/Users/max/Downloads/hbase-1.1.6//lib/jcodings-1.0.8.jar:/Users/max/Downloads/hbase-1.1.6//lib/jersey-client-1.9.jar:/Users/max/Downloads/hbase-1.1.6//lib/jersey-core-1.9.jar:/Users/max/Downloads/hbase-1.1.6//lib/jersey-guice-1.9.jar:/Users/max/Downloads/hbase-1.1.6//lib/jersey-json-1.9.jar:/Users/max/Downloads/hbase-1.1.6//lib/jersey-server-1.9.jar:/Users/max/Downloads/hbase-1.1.6//lib/jets3t-0.9.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/jettison-1.3.3.jar:/Users/max/Downloads/hbase-1.1.6//lib/jetty-6.1.26.jar:/Users/max/Downloads/hbase-1.1.6//lib/jetty-sslengine-6.1.26.jar:/Users/max/Downloads/hbase-1.1.6//lib/jetty-util-6.1.26.jar:/Users/max/Downloads/hbase-1.1.6//lib/joni-2.1.2.jar:/Users/max/Downloads/hbase-1.1.6//lib/jruby-complete-1.6.8.jar:/Users/max/Downloads/hbase-1.1.6//lib/jsch-0.1.42.jar:/Users/max/Downloads/hbase-1.1.6//lib/jsp-2.1-6.1.14.jar:/Users/max/Downloads/hbase-1.1.6//lib/jsp-api-2.1-6.1.14.jar:/Users/max/Downloads/hbase-1.1.6//lib/junit-4.12.jar:/Users/max/Downloads/hbase-1.1.6//lib/leveldbjni-all-1.8.jar:/Users/max/Downloads/hbase-1.1.6//lib/libthrift-0.9.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/log4j-1.2.17.jar:/Users/max/Downloads/hbase-1.1.6//lib/metrics-core-2.2.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/netty-3.2.4.Final.jar:/Users/max/Downloads/hbase-1.1.6//lib/netty-all-4.0.23.Final.jar:/Users/max/Downloads/hbase-1.1.6//lib/paranamer-2.3.jar:/Users/max/Downloads/hbase-1.1.6//lib/protobuf-java-2.5.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/servlet-api-2.5-6.1.14.jar:/Users/max/Downloads/hbase-1.1.6//lib/servlet-api-2.5.jar:/Users/max/Downloads/hbase-1.1.6//lib/slf4j-api-1.7.7.jar:/Users/max/Downloads/hbase-1.1.6//lib/slf4j-log4j12-1.7.5.jar:/Users/max/Downloads/hbase-1.1.6//lib/snappy-java-1.0.4.1.jar:/Users/max/Downloads/hbase-1.1.6//lib/spymemcached-2.11.6.jar:/Users/max/Downloads/hbase-1.1.6//lib/xmlenc-0.52.jar:/Users/max/Downloads/hbase-1.1.6//lib/xz-1.0.jar:/Users/max/Downloads/hbase-1.1.6//lib/zookeeper-3.4.6.jar:/Users/max/Downloads/hadoop-2.7.2/etc/hadoop:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/common/lib/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/common/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/hdfs:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/hdfs/lib/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/hdfs/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/yarn/lib/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/yarn/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/mapreduce/lib/*:/Users/max/Downloads/hadoop-2.7.2/share/hadoop/mapreduce/*:/contrib/capacity-scheduler/*.jar:/Users/max/Downloads/hbase-1.1.6/conf/
> {noformat}
> We should at least warn the user or not load everything by default.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)