You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by berngp <gi...@git.apache.org> on 2014/02/21 10:54:06 UTC
[GitHub] incubator-spark pull request: SPARK-3: The spark-shell fails under...
GitHub user berngp opened a pull request:
https://github.com/apache/incubator-spark/pull/627
SPARK-3: The spark-shell fails under a dist.
Problem:
The spark-shell will fail to start when Spark is deployed using the
tar.gz file built by ./make-distribution. The problem is generated
by the spark-class shell that fails to setup a CLASSPATH if
Spark is a RELEASE.
Fix:
The script `spark-class` now sets the CLASSPATH if it is a RELEASE/dist
by pointing to the only assembly that should exist in the `./jars`
Environment:
*NIX environments. A similar change should be applied to
`spark-class.cmd`.
[ticket: SPARK-3] : https://issues.apache.org/jira/browse/SPARK-3
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/berngp/incubator-spark hotfix/SPARK-3
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-spark/pull/627.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #627
----
commit f1d6fdc3c119b972dd2f093c45c6f91a7c8d4a82
Author: Bernardo Gomez Palacio <be...@gmail.com>
Date: 2014-02-21T09:44:41Z
SPARK-3: The spark-shell fails under a dist.
Problem:
The spark-shell will fail to start when Spark is deployed using the
tar.gz file built by ./make-distribution. The problem is generated
by the spark-class shell that fails to setup a CLASSPATH if
Spark is a RELEASE.
Fix:
The script `spark-class` now sets the CLASSPATH if it is a RELEASE/dist
by pointing to the only assembly that should exist in the `./jars`
Environment:
*NIX environments. A similar change should be applied to
`spark-class.cmd`.
[ticket: SPARK-3] : https://issues.apache.org/jira/browse/SPARK-3
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---
[GitHub] incubator-spark pull request: SPARK-1116: The spark-shell fails un...
Posted by berngp <gi...@git.apache.org>.
Github user berngp commented on the pull request:
https://github.com/apache/incubator-spark/pull/627#issuecomment-35825450
@pwendell sorry, not an issue.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---
[GitHub] incubator-spark pull request: SPARK-3: The spark-shell fails under...
Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/incubator-spark/pull/627#issuecomment-35714571
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---
[GitHub] incubator-spark pull request: SPARK-1116: The spark-shell fails un...
Posted by pwendell <gi...@git.apache.org>.
Github user pwendell commented on the pull request:
https://github.com/apache/incubator-spark/pull/627#issuecomment-35824436
Hey @berngp - I can't reproduce this problem. There is already a line in `spark-classpath` that adds this correctly:
```
else
# Else use spark-assembly jar from either RELEASE or assembly directory
if [ -f "$FWDIR/RELEASE" ]; then
ASSEMBLY_JAR=`ls "$FWDIR"/jars/spark-assembly*.jar`
else
```
I also did a made fresh distribution and tested the shell and it worked properly.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---
[GitHub] incubator-spark pull request: SPARK-1116: The spark-shell fails un...
Posted by berngp <gi...@git.apache.org>.
Github user berngp closed the pull request at:
https://github.com/apache/incubator-spark/pull/627
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
infrastructure@apache.org or file a JIRA ticket with INFRA.
---