You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "liyunzhang_intel (JIRA)" <ji...@apache.org> on 2017/09/15 03:45:00 UTC
[jira] [Comment Edited] (PIG-5305) Enable yarn-client mode
execution of tests in Spark (1) mode
[ https://issues.apache.org/jira/browse/PIG-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167284#comment-16167284 ]
liyunzhang_intel edited comment on PIG-5305 at 9/15/17 3:44 AM:
----------------------------------------------------------------
[~szita]: several suggestions
1. can we only add {{pigtest-jar}} to {{test-spark}} target in build.xml? I guess for {{test-tez}}, there is no need for {{pigtest-jar}}
meanwhile there is no need to add {{jar-simple}} in the dependency of {{test-tez}} as the dependency of {{compile-test}} includes {{jar-simple}}. If my understanding is not right, tell me.
2.please add comment {{added feature to re-initialize SparkContext when switching between cluster and local mode PigServers}} on related code.
Besides, is there any unit test failures if convert {{SPARK_MASTER}} from "local" to "yarn-client"?
was (Author: kellyzly):
[~szita]: several suggestions
1. can we only modify {{test-spark}} target in build.xml? I guess for {{test-tez}}, there is no need for {{pigtest-jar}}
meanwhile there is no need to add {{jar-simple}} in the dependency of {{test-tez}} as the dependency of {{compile-test}} includes {{jar-simple}}. If my understanding is not right, tell me.
2.please add comment {{added feature to re-initialize SparkContext when switching between cluster and local mode PigServers}} on related code.
Besides, is there any unit test failures if convert {{SPARK_MASTER}} from "local" to "yarn-client"?
> Enable yarn-client mode execution of tests in Spark (1) mode
> ------------------------------------------------------------
>
> Key: PIG-5305
> URL: https://issues.apache.org/jira/browse/PIG-5305
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Adam Szita
> Assignee: Adam Szita
> Attachments: PIG-5305.0.patch
>
>
> See parent jira (PIG-5305) for problem description
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)