You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Adam Szita (JIRA)" <ji...@apache.org> on 2017/09/01 13:02:00 UTC

[jira] [Created] (PIG-5296) Minicluster tests in Spark should use yarn-client mode instead of local

Adam Szita created PIG-5296:
-------------------------------

             Summary: Minicluster tests in Spark should use yarn-client mode instead of local
                 Key: PIG-5296
                 URL: https://issues.apache.org/jira/browse/PIG-5296
             Project: Pig
          Issue Type: Improvement
          Components: spark
            Reporter: Adam Szita
            Assignee: Adam Szita


Currently if a unit test is using MiniGenericCluster it will have no difference from a simple local mode testing in Spark mode.
In order to run these tests properly with Yarn being involved we need to specify SPARK_MASTER=yarn-client as env var.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)