You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "iwasakims (via GitHub)" <gi...@apache.org> on 2024/02/07 14:12:59 UTC
[PR] BIGTOP-4062. Upgrade Spark to 3.3.4. [bigtop]
iwasakims opened a new pull request, #1234:
URL: https://github.com/apache/bigtop/pull/1234
https://issues.apache.org/jira/browse/BIGTOP-4062
The latest maintenance release of Spark 3.3 series with security and correctness fixes is available.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4062. Upgrade Spark to 3.3.4. [bigtop]
Posted by "sekikn (via GitHub)" <gi...@apache.org>.
sekikn commented on PR #1234:
URL: https://github.com/apache/bigtop/pull/1234#issuecomment-1962952373
+1, tested on Fedora 38 (x86_64). Thanks @iwasakims.
```
$ ./gradlew allclean spark-pkg repo -Dbuildwithdeps=true
$ (cd docker/bigtop-puppet && ./build.sh trunk-fedora-38)
$ (cd docker/bigtop-slaves && ./build.sh trunk-fedora-38)
$ (cd provisioner/docker && ./docker-hadoop.sh -d -dcp -C config_fedora-38.yaml -F docker-compose-cgroupv2.yml -G -L -k hdfs,yarn,spark -s spark -c 3)
...
org.apache.bigtop.itest.spark.TestSpark > testSparkSQL STANDARD_OUT
SPARK_MASTER isn't set. yarn will be used as the master URL. Refer to smoke-tests/README If this isn't what you you expect.
org.apache.bigtop.itest.spark.TestSpark > testSparkR STANDARD_OUT
SPARK_MASTER isn't set. yarn will be used as the master URL. Refer to smoke-tests/README If this isn't what you you expect.
Gradle Test Executor 2 finished executing tests.
> Task :bigtop-tests:smoke-tests:spark:test
Finished generating test XML results (0.006 secs) into: /bigtop-home/bigtop-tests/smoke-tests/spark/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.011 secs) into: /bigtop-home/bigtop-tests/smoke-tests/spark/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:spark:test (Thread[Daemon worker,5,main]) completed. Took 49.935 secs.
BUILD SUCCESSFUL in 2m 15s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4062. Upgrade Spark to 3.3.4. [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1234:
URL: https://github.com/apache/bigtop/pull/1234#issuecomment-1932138980
ran smoke test of spark on Ubuntu 22.04 x86_64.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4062. Upgrade Spark to 3.3.4. [bigtop]
Posted by "sekikn (via GitHub)" <gi...@apache.org>.
sekikn merged PR #1234:
URL: https://github.com/apache/bigtop/pull/1234
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] BIGTOP-4062. Upgrade Spark to 3.3.4. [bigtop]
Posted by "iwasakims (via GitHub)" <gi...@apache.org>.
iwasakims commented on PR #1234:
URL: https://github.com/apache/bigtop/pull/1234#issuecomment-1932139645
building and testing on Rocky Linux 8 aarch64 now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org