You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2020/12/04 13:39:14 UTC
[GitHub] [bigtop] sekikn opened a new pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
sekikn opened a new pull request #709:
URL: https://github.com/apache/bigtop/pull/709
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #709:
URL: https://github.com/apache/bigtop/pull/709#issuecomment-738837629
@sekikn I think the PR makes implicit dependency on spark::common which defines Package['spark-core']. Addressing [BIGTOP-3381](https://issues.apache.org/jira/browse/BIGTOP-3381) should be the right fix?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn merged pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
Posted by GitBox <gi...@apache.org>.
sekikn merged pull request #709:
URL: https://github.com/apache/bigtop/pull/709
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #709:
URL: https://github.com/apache/bigtop/pull/709#issuecomment-739438440
Thank you for the review, merged into master and branch-1.5.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #709:
URL: https://github.com/apache/bigtop/pull/709#issuecomment-739137273
Updated the PR so that we don't have to specify Spark as a argument for the `--stack` option explicitly.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #709:
URL: https://github.com/apache/bigtop/pull/709#issuecomment-738870545
I meant that specifying livy only does not work. We need `--stack spark,livy` always.
```
$ ./docker-hadoop.sh -c 1 --stack livy
...
Error: Could not find resource 'Package[spark-core]' in parameter 'require' (file: /bigtop-home/bigtop-deploy/puppet/modules/livy/manifests/init.pp, line: 46) on node 7fee5c6931a5.bigtop.apache.org
```
Including spark::common class in livy's manifests should fix this.
```
class livy {
class deploy ($roles) {
if ('livy-server' in $roles) {
include livy::server
include spark::common
}
}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #709: BIGTOP-3462. Deploying Livy fails if the SPARK_HOME directory doesn't exist.
Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #709:
URL: https://github.com/apache/bigtop/pull/709#issuecomment-739106244
> Addressing BIGTOP-3381 should be the right fix?
That's totally right, but it requires to rebuild packages for all distros/platforms and signing them. It will delay our release about a week again... So I'd like to address this issue within the puppet manifest as a workaround at this time. Is this OK for you?
If the RC0 vote fails and we have to rebuild the packages, I'll address BIGTOP-3381.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org