You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/07/09 04:34:00 UTC

[jira] [Created] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly

Kousuke Saruta created SPARK-36067:
--------------------------------------

             Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly
                 Key: SPARK-36067
                 URL: https://issues.apache.org/jira/browse/SPARK-36067
             Project: Spark
          Issue Type: Bug
          Components: Build, Tests, YARN
    Affects Versions: 3.2.0, 3.3.0
            Reporter: Kousuke Saruta
            Assignee: Kousuke Saruta


YarnClusterSuite will fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly regardless of building with SBT or Maven.
{code}
build/sbt -Pyarn "yarn/testOnly org.apache.spark.deploy.yarn.YarnClusterSuite"
...
[info] YarnClusterSuite:
[info] org.apache.spark.deploy.yarn.YarnClusterSuite *** ABORTED *** (598 milliseconds)
[info]   java.lang.NoClassDefFoundError: org/bouncycastle/operator/OperatorCreationException
[info]   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:888)
[info]   at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
[info]   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1410)
[info]   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:344)
[info]   at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
[info]   at org.apache.hadoop.yarn.server.MiniYARNCluster.initResourceManager(MiniYARNCluster.java:359)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org