You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/08/24 23:06:00 UTC
[jira] [Commented] (FLINK-9086) Use INTERNAL_HADOOP_CLASSPATHS as
classpath for launching Yarn cluster for Scala Shell
[ https://issues.apache.org/jira/browse/FLINK-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592298#comment-16592298 ]
ASF GitHub Bot commented on FLINK-9086:
---------------------------------------
ruankd commented on issue #5768: [FLINK-9086] Use INTERNAL_HADOOP_CLASSPATHS as classpath for Yarn Session
URL: https://github.com/apache/flink/pull/5768#issuecomment-415904593
Ping.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> Use INTERNAL_HADOOP_CLASSPATHS as classpath for launching Yarn cluster for Scala Shell
> --------------------------------------------------------------------------------------
>
> Key: FLINK-9086
> URL: https://issues.apache.org/jira/browse/FLINK-9086
> Project: Flink
> Issue Type: Improvement
> Components: Startup Shell Scripts
> Affects Versions: 1.4.0
> Reporter: Keda Ruan
> Priority: Major
> Labels: pull-request-available
>
> Some environments don't have hadoop jars in {{HADOOP_CLASSPATH}}, causing Flink Yarn cluster unable to start due to some jars missing. For example Flink 1.4.0 drops jersey dependency in its shaded hadoop jar, causing Yarn cluster unable to start:
> {quote}Exception in thread "main" java.lang.NoClassDefFoundError: com/sun/jersey/core/util/FeaturesAndProperties
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> {quote}
> Since there is a {{INTERNAL_HADOOP_CLASSPATHS}} in {{config.sh}} that has {{hadoop classpath}} result, we can utilize this and improve the user experience on starting Flink Yarn cluster for Scala Shell.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)