You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Praveen Rachabattuni (JIRA)" <ji...@apache.org> on 2015/02/24 04:51:52 UTC
[jira] [Updated] (PIG-4364) remove unnessary MR plan code generated
in SparkLauncher.java
[ https://issues.apache.org/jira/browse/PIG-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Praveen Rachabattuni updated PIG-4364:
--------------------------------------
Fix Version/s: spark-branch
> remove unnessary MR plan code generated in SparkLauncher.java
> -------------------------------------------------------------
>
> Key: PIG-4364
> URL: https://issues.apache.org/jira/browse/PIG-4364
> Project: Pig
> Issue Type: Bug
> Components: spark
> Reporter: liyunzhang_intel
> Assignee: liyunzhang_intel
> Fix For: spark-branch
>
> Attachments: PIG-4364.patch
>
>
> following code in SparkLauncher.java Line 112~116 is about MR plan is generated in Spark mode which is unnecessary.
> {code}
> // Code pulled from MapReduceLauncher
> MRCompiler mrCompiler = new MRCompiler(physicalPlan, pigContext);
> mrCompiler.compile();
> MROperPlan plan = mrCompiler.getMRPlan();
> POPackageAnnotator pkgAnnotator = new POPackageAnnotator(plan);
> pkgAnnotator.visit();
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)