You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/08/18 14:44:00 UTC
[jira] [Commented] (FLINK-7477) Use "hadoop classpath" to augment
classpath when available
[ https://issues.apache.org/jira/browse/FLINK-7477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16133044#comment-16133044 ]
ASF GitHub Bot commented on FLINK-7477:
---------------------------------------
GitHub user aljoscha opened a pull request:
https://github.com/apache/flink/pull/4566
[FLINK-7477] [FLINK-7480] Various improvements to Flink scripts
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aljoscha/flink hadoop-env-improvements
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4566.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4566
----
commit 6b4d7e5e09dcd913fbb9c84c59fc8a10e6c662cc
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2017-08-18T14:39:41Z
[FLINK-7477] Use "hadoop classpath" to augment classpath when available
This improves the out-of-box experience on GCE and AWS, both of which
don't set a HADOOP_CLASSPATH but have "hadoop" available on the $PATH.
commit f63e2d03d739014f0cd94634d731e552a02c76d9
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2017-08-18T14:40:55Z
[FLINK-7480] Set HADOOP_CONF_DIR to sane default if not set
This improves the out-of-box experience on GCE and AWS, both of which
don't set HADOOP_CONF_DIR by default but use /etc/hadoop/conf
----
> Use "hadoop classpath" to augment classpath when available
> ----------------------------------------------------------
>
> Key: FLINK-7477
> URL: https://issues.apache.org/jira/browse/FLINK-7477
> Project: Flink
> Issue Type: Bug
> Components: Startup Shell Scripts
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Fix For: 1.4.0
>
>
> Currently, some cloud environments don't properly put the Hadoop jars into {{HADOOP_CLASSPATH}} (or don't set {{HADOOP_CLASSPATH}}) at all. We should check in {{config.sh}} if the {{hadoop}} binary is on the path and augment our {{INTERNAL_HADOOP_CLASSPATHS}} with the result of {{hadoop classpath}} in our scripts.
> This will improve the out-of-box experience of users that otherwise have to manually set {{HADOOP_CLASSPATH}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)