You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "vivostar (via GitHub)" <gi...@apache.org> on 2023/12/24 07:38:07 UTC
[PR] BIGTOP-4055. Add Spark History Server Smoke Test [bigtop]
vivostar opened a new pull request, #1221:
URL: https://github.com/apache/bigtop/pull/1221
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/BIGTOP/How+to+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g., 'BIGTOP-3638: Your PR title ...'.
-->
### Description of PR
Add Spark History Server Smoke Test
### How was this patch tested?
We can use docker-hadoop.sh to test it
1. modify the config_centos-7.yaml as following example
```yaml
docker:
memory_limit: "4g"
image: "bigtop/puppet:trunk-centos-7"
repo: "http://repos.bigtop.apache.org/releases/3.2.1/centos/7/$basearch"
distro: centos
components: [hdfs, yarn, mapreduce, spark]
enable_local_repo: false
smoke_test_components: [hdfs, yarn, mapreduce]
```
2. create hadoop cluster
```shell
./docker-hadoop.sh -dcp -c 3
```
3. smoke test spark
```shell
./docker-hadoop.sh -dcp -s spark
```
I have tested it on centos-7 and debian-11
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
- [x] Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org