You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Koji Noguchi (Jira)" <ji...@apache.org> on 2021/10/08 18:16:00 UTC
[jira] [Commented] (PIG-5413) [spark]
TestStreaming.testInputCacheSpecs failing with "File script1.pl was already
registered"
[ https://issues.apache.org/jira/browse/PIG-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426317#comment-17426317 ]
Koji Noguchi commented on PIG-5413:
-----------------------------------
Full stack trace.
{noformat}
Unable to open iterator for alias A
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias A
at org.apache.pig.PigServer.openIterator(PigServer.java:1024)
at org.apache.pig.test.TestStreaming.testInputCacheSpecs(TestStreaming.java:486)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias A
at org.apache.pig.PigServer.storeEx(PigServer.java:1127)
at org.apache.pig.PigServer.store(PigServer.java:1086)
at org.apache.pig.PigServer.openIterator(PigServer.java:999)
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.lang.IllegalArgumentException: requirement failed: File script1.pl was already registered with a different path (old path = /grid/1/tmp/yarn-local/usercache/gtrain/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache7028476439694979845/script1.pl, new path = /grid/1/tmp/yarn-local/usercache/gtrain/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache4167672945345635171/script1.pl
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:296)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1479)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1464)
at org.apache.pig.PigServer.storeEx(PigServer.java:1123)
Caused by: java.lang.IllegalArgumentException: requirement failed: File script1.pl was already registered with a different path (old path = /grid/1/tmp/yarn-local/usercache/gtrain/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache7028476439694979845/script1.pl, new path = /grid/1/tmp/yarn-local/usercache/gtrain/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache4167672945345635171/script1.pl
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.rpc.netty.NettyStreamManager.addFile(NettyStreamManager.scala:70)
at org.apache.spark.SparkContext.addFile(SparkContext.scala:1559)
at org.apache.spark.SparkContext.addFile(SparkContext.scala:1508)
at org.apache.spark.api.java.JavaSparkContext.addFile(JavaSparkContext.scala:675)
at org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher.addResourceToSparkJobWorkingDirectory(SparkLauncher.java:507)
at org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher.cacheFiles(SparkLauncher.java:421)
at org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher.addFilesToSparkJob(SparkLauncher.java:377)
at org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher.uploadResources(SparkLauncher.java:252)
at org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher.launchPig(SparkLauncher.java:238)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:290)
{noformat}
> [spark] TestStreaming.testInputCacheSpecs failing with "File script1.pl was already registered"
> -----------------------------------------------------------------------------------------------
>
> Key: PIG-5413
> URL: https://issues.apache.org/jira/browse/PIG-5413
> Project: Pig
> Issue Type: Bug
> Components: spark
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Priority: Minor
>
> {noformat}
> Caused by: java.lang.IllegalArgumentException: requirement failed: File script1.pl was already registered with a different path (old path = /tmp/yarn-local/usercache/knoguchi/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache7028476439694979845/script1.pl, new path = /tmp/yarn-local/usercache/knoguchi/appcache/application_1628754354801_523406/container_e07_1628754354801_523406_01_000061/tmp/pig_junit_tmp1798933174/cache4167672945345635171/script1.pl
> at scala.Predef$.require(Predef.scala:224)
> at org.apache.spark.rpc.netty.NettyStreamManager.addFile(NettyStreamManager.scala:70)
> at org.apache.spark.SparkContext.addFile(SparkContext.scala:1559)
> ...
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)