You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2022/10/02 15:22:00 UTC
[jira] [Commented] (SPARK-40635) Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
[ https://issues.apache.org/jira/browse/SPARK-40635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612128#comment-17612128 ]
Yang Jie commented on SPARK-40635:
----------------------------------
{code:java}
Exception message: Cannot run program "bash" (in directory "/home/runner/work/spark/spark/resource-managers/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/runner/appcache/application_1664721938509_0027/container_1664721938509_0027_02_000001"): error=7, Argument list too long
22096[info] Stack trace: java.io.IOException: Cannot run program "bash" (in directory "/home/runner/work/spark/spark/resource-managers/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/runner/appcache/application_1664721938509_0027/container_1664721938509_0027_02_000001"): error=7, Argument list too long
22097[info] at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
22098[info] at org.apache.hadoop.util.Shell.runCommand(Shell.java:526)
22099[info] at org.apache.hadoop.util.Shell.run(Shell.java:482)
22100[info] at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
22101[info] at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
22102[info] at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
22103[info] at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
22104[info] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
22105[info] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
22106[info] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
22107[info] at java.lang.Thread.run(Thread.java:750)
22108[info] Caused by: java.io.IOException: error=7, Argument list too long
22109[info] at java.lang.UNIXProcess.forkAndExec(Native Method)
22110[info] at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
22111[info] at java.lang.ProcessImpl.start(ProcessImpl.java:134)
22112[info] at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
22113[info] ... 10 more
22114[info] {code}
> Scala 2.12 + Hadoop 2 + JDK 8 Daily Test failed
> ------------------------------------------------
>
> Key: SPARK-40635
> URL: https://issues.apache.org/jira/browse/SPARK-40635
> Project: Spark
> Issue Type: Bug
> Components: Tests, YARN
> Affects Versions: 3.4.0
> Reporter: Yang Jie
> Priority: Major
>
> [https://github.com/apache/spark/actions/runs/3164718086]
>
> {code:java}
> [error] org.apache.spark.deploy.yarn.YarnShuffleAlternateNameConfigWithLevelDBBackendSuite
> [error] org.apache.spark.deploy.yarn.YarnShuffleIntegrationWithLevelDBBackendSuite
> [error] org.apache.spark.deploy.yarn.YarnClusterSuite
> [error] org.apache.spark.deploy.yarn.YarnShuffleAuthWithLevelDBBackendSuite
> [error] org.apache.spark.deploy.yarn.YarnShuffleAlternateNameConfigWithRocksDBBackendSuite
> [error] org.apache.spark.deploy.yarn.YarnShuffleIntegrationWithRocksDBBackendSuite
> [error] org.apache.spark.deploy.yarn.YarnShuffleAuthWithRocksDBBackendSuite {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org