You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by kwmonroe <gi...@git.apache.org> on 2017/06/02 19:08:01 UTC
[GitHub] bigtop pull request #229: BIGTOP-2795: spark charm: fix sparkpi and rework s...
GitHub user kwmonroe opened a pull request:
https://github.com/apache/bigtop/pull/229
BIGTOP-2795: spark charm: fix sparkpi and rework start/stop logic
See [bigtop-2795](https://issues.apache.org/jira/browse/BIGTOP-2795) for details.
- add bundle descriptions to the hadoop-spark yaml files
- expose the worker ui port
- rework start/stop logic to handle ports and wait when appropriate
- fix sparkpi.sh by not hard coding the spark-examples.jar path
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/juju-solutions/bigtop bug/BIGTOP-2795/logic-fixes
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/bigtop/pull/229.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #229
----
commit 69e3e17574e67d38530fbe4beae8dd08e3dac6c2
Author: Kevin W Monroe <ke...@canonical.com>
Date: 2017-06-01T20:57:30Z
adjust bundle description
commit e0e5d0cacdf41ae2e80c96f8b2251ec631da29d6
Author: Kevin W Monroe <ke...@canonical.com>
Date: 2017-06-02T18:56:12Z
add worker-ui port; rework start/stop to open ports and wait for services appropriately
commit 71468acd0a47ae07f0488211df99a50309a2dabc
Author: Kevin W Monroe <ke...@canonical.com>
Date: 2017-06-02T18:57:11Z
sparkpi: find example jar dynamically and rework the output
commit 3cd376fce4f0214b3ea9897213457c33cac9e725
Author: Kevin W Monroe <ke...@canonical.com>
Date: 2017-06-02T19:01:24Z
add bundle descriptions to dev/local bundle yamls
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] bigtop pull request #229: BIGTOP-2795: spark charm: fix sparkpi and rework s...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/bigtop/pull/229
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] bigtop issue #229: BIGTOP-2795: spark charm: fix sparkpi and rework start/st...
Posted by kwmonroe <gi...@git.apache.org>.
Github user kwmonroe commented on the issue:
https://github.com/apache/bigtop/pull/229
During test, I found the `submit` action to be waaay too complex. I refactored it to use a simpler set of arguments, and then documented this in the readme.
While I was in the readme, I noticed we didn't document the `*_memory` config options, so I added a section for those.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---