You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2016/12/22 03:02:58 UTC
[jira] [Comment Edited] (PIG-5081) Can not run pig on spark source
code distribution
[ https://issues.apache.org/jira/browse/PIG-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15768848#comment-15768848 ]
Jeff Zhang edited comment on PIG-5081 at 12/22/16 3:02 AM:
-----------------------------------------------------------
[~kellyzly] Thanks for review. I mean spark 1.6 source code distribution not spark master. I know Spark 2.x has some differences on assembly jar. The spark assembly jar is under assembly/target/scala-2.10/. We could run sparksubmit in source code distribution, so I think we should enable that for pig as well. This could help us to test pig on the latest version of spark.
was (Author: zjffdu):
[~kellyzly] Thanks for review. I mean spark 1.6 source code distribution not spark master. I know Spark 2.x has some differences on assembly jar.
> Can not run pig on spark source code distribution
> -------------------------------------------------
>
> Key: PIG-5081
> URL: https://issues.apache.org/jira/browse/PIG-5081
> Project: Pig
> Issue Type: Bug
> Components: spark
> Affects Versions: 0.16.0
> Reporter: Jeff Zhang
> Assignee: Jeff Zhang
> Priority: Minor
> Attachments: PIG_5081_1.patch
>
>
> This is due to spark assembly jar is not found for spark source code distribution
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)