You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by astroshim <gi...@git.apache.org> on 2016/08/16 15:20:39 UTC
[GitHub] zeppelin pull request #1335: [ZEPPELIN-1336] hadoop library for spark interp...
GitHub user astroshim opened a pull request:
https://github.com/apache/zeppelin/pull/1335
[ZEPPELIN-1336] hadoop library for spark interpreter is not match.
### What is this PR for?
This PR is for download hadoop libraries for yarn cluster.
This issue comes from https://github.com/apache/zeppelin/pull/1318.
### What type of PR is it?
Bug Fix
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1336
### How should this be tested?
1. build zeppelin for `spark2.0&hadoop2.7`
```
mvn clean package -Pspark-2.0 -Phadoop-2.7 -Dhadoop.version=2.7.2 -Pyarn -Ppyspark -Pscala-2.11 -DskipTests
```
2. verify hadoop library version for spark.
```
ls -al $ZEPPELIN_HOME/spark/target/lib/
```
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/astroshim/zeppelin ZEPPELIN-1336
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/1335.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1335
----
commit 4f333ac4a66d510bd499af2b7ce394aa09edc6fe
Author: astroshim <hs...@nflabs.com>
Date: 2016-08-16T15:12:35Z
add hadoop libraries for spark interpreter
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin issue #1335: [ZEPPELIN-1336] hadoop library for spark interpreter i...
Posted by astroshim <gi...@git.apache.org>.
Github user astroshim commented on the issue:
https://github.com/apache/zeppelin/pull/1335
@jongyoul I will close this issue since removing yarn profile is working.
please do it at the https://github.com/apache/zeppelin/pull/1301 as @zjffdu mentioned.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin pull request #1335: [ZEPPELIN-1336] hadoop library for spark interp...
Posted by astroshim <gi...@git.apache.org>.
Github user astroshim closed the pull request at:
https://github.com/apache/zeppelin/pull/1335
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin issue #1335: [ZEPPELIN-1336] hadoop library for spark interpreter i...
Posted by jongyoul <gi...@git.apache.org>.
Github user jongyoul commented on the issue:
https://github.com/apache/zeppelin/pull/1335
I think spark-dependencies is a proper position for this change. How do you think?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---