[jira] [Commented] (PIG-4605) fix a bug when coping Jar to SparkJob working directory

["liyunzhang_intel (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14587697#comment-14587697 ] 

liyunzhang_intel commented on PIG-4605:
---------------------------------------

[~kexianda]: For PIG-4605.patch: +1

> fix a bug when coping Jar to SparkJob working directory
> -------------------------------------------------------
>
>                 Key: PIG-4605
>                 URL: https://issues.apache.org/jira/browse/PIG-4605
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: kexianda
>            Assignee: kexianda
>             Fix For: spark-branch
>
>         Attachments: PIG-4605.patch
>
>
> The function SparkLauncher.addJarToSparkJobWorkingDirectory() try to copy the user's Jar files to the working directory. 
> when SPARK_MATER == LOCAL, and if the src & dest Jar files have the same absolute path, an exception will be thrown.
> Reproduce steps:
> 1. build pig tutorial
> 2. cd PIG_HOME/tutorial/pigtmp
>     pig -x spark
>     REGISTER ./tutorial.jar
>     raw = LOAD '/user/excite-small.log' USING PigStorage('\t') AS (user, time, query);
>     clean1 = FILTER raw BY org.apache.pig.tutorial.NonURLDetector(query);
>     store clean1 into '/user/result1';



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)