[jira] [Updated] (PIG-5413) [spark] TestStreaming.testInputCacheSpecs failing with "File script1.pl was already registered"

["Koji Noguchi (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated PIG-5413:
------------------------------
    Fix Version/s: 0.18.0
       Resolution: Fixed
           Status: Resolved  (was: Patch Available)

Thanks for the review Rohini!!!

Committed to trunk (0.18). 

> [spark] TestStreaming.testInputCacheSpecs failing with "File script1.pl was already registered"
> -----------------------------------------------------------------------------------------------
>
>                 Key: PIG-5413
>                 URL: https://issues.apache.org/jira/browse/PIG-5413
>             Project: Pig
>          Issue Type: Bug
>          Components: spark
>            Reporter: Koji Noguchi
>            Assignee: Koji Noguchi
>            Priority: Minor
>             Fix For: 0.18.0
>
>         Attachments: pig-5413-v01.patch
>
>
>  {noformat}
> Caused by: java.lang.IllegalArgumentException: requirement failed: File script1.pl was already registered with a different path (old path = /tmp/yarn-local/usercache/knoguchi/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache7028476439694979845/script1.pl, new path = /tmp/yarn-local/usercache/knoguchi/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache4167672945345635171/script1.pl
> at scala.Predef$.require(Predef.scala:224)
> at org.apache.spark.rpc.netty.NettyStreamManager.addFile(NettyStreamManager.scala:70)
> at org.apache.spark.SparkContext.addFile(SparkContext.scala:1559)
> ...
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)