You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by hc busy <hc...@gmail.com> on 2010/04/30 01:05:20 UTC
how to debug pig with ERROR 6017
Hey guys, I'm trying to figure out why my pig script crashes half way (after
2 or 3 mr's) The error is below. I took a dump of the plan and didn't see
anything suspicious except that the missing temp file wasn't part of the
plan any where. The hadoop UI did not report any kind of MR error.
Any help would be appreciated.
2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 6017: Execution failed, while processing hdfs://
sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
hdfs://sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 6017: Execution
failed, while processing hdfs://
sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
hdfs://sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:777)
at org.apache.pig.PigServer.execute(PigServer.java:770)
at org.apache.pig.PigServer.access$100(PigServer.java:89)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:947)
at org.apache.pig.PigServer.executeBatch(PigServer.java:249)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:320)
Re: how to debug pig with ERROR 6017
Posted by hc busy <hc...@gmail.com>.
Ok, just so that nobody out there's worrying about my project. One of our
experts here came and fixed the script... As far as I can tell, all that was
done was a lot of comments were removed from the script, many many
unnecessary aliases were removed... (aliases that don't end up on the path
to a store or dump) Shrank my 500 line pig script to something around 250
lines. Restarted the hadoop cluster several times, and then it just ran
through. no errors, no foul smells, no nothing.
... I'd recommend the three finger salute for anybody else who's having this
problem. My guess is that really fixed it.
On Thu, Apr 29, 2010 at 9:50 PM, hc busy <hc...@gmail.com> wrote:
>
>
> Okay, just went through and 'describ'ed every table. types all seem fine.
> The failure happens about 10 minutes into the execution... so it's a second
> or third MR failing to read something in after the initial few MR's
> completed their processing...
>
> Urrrg.
>
>
> On Thu, Apr 29, 2010 at 6:34 PM, hc busy <hc...@gmail.com> wrote:
>
>> I tried to turn optimization offer per collegue's suggestion, and it still
>> failed the same place. No error from the hadoop UI.
>>
>>
>> On Thu, Apr 29, 2010 at 4:05 PM, hc busy <hc...@gmail.com> wrote:
>>
>>> Hey guys, I'm trying to figure out why my pig script crashes half way
>>> (after 2 or 3 mr's) The error is below. I took a dump of the plan and didn't
>>> see anything suspicious except that the missing temp file wasn't part of the
>>> plan any where. The hadoop UI did not report any kind of MR error.
>>>
>>> Any help would be appreciated.
>>>
>>>
>>> 2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
>>> ERROR 6017: Execution failed, while processing hdfs://
>>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
>>> hdfs://
>>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
>>> 2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
>>> org.apache.pig.backend.executionengine.ExecException: ERROR 6017: Execution
>>> failed, while processing hdfs://
>>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
>>> hdfs://
>>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
>>> at
>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181)
>>> at
>>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
>>> at
>>> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:777)
>>> at org.apache.pig.PigServer.execute(PigServer.java:770)
>>> at org.apache.pig.PigServer.access$100(PigServer.java:89)
>>> at org.apache.pig.PigServer$Graph.execute(PigServer.java:947)
>>> at org.apache.pig.PigServer.executeBatch(PigServer.java:249)
>>> at
>>> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115)
>>> at
>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172)
>>> at
>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
>>> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
>>> at org.apache.pig.Main.main(Main.java:320)
>>>
>>
>>
>
Re: how to debug pig with ERROR 6017
Posted by hc busy <hc...@gmail.com>.
Okay, just went through and 'describ'ed every table. types all seem fine.
The failure happens about 10 minutes into the execution... so it's a second
or third MR failing to read something in after the initial few MR's
completed their processing...
Urrrg.
On Thu, Apr 29, 2010 at 6:34 PM, hc busy <hc...@gmail.com> wrote:
> I tried to turn optimization offer per collegue's suggestion, and it still
> failed the same place. No error from the hadoop UI.
>
>
> On Thu, Apr 29, 2010 at 4:05 PM, hc busy <hc...@gmail.com> wrote:
>
>> Hey guys, I'm trying to figure out why my pig script crashes half way
>> (after 2 or 3 mr's) The error is below. I took a dump of the plan and didn't
>> see anything suspicious except that the missing temp file wasn't part of the
>> plan any where. The hadoop UI did not report any kind of MR error.
>>
>> Any help would be appreciated.
>>
>>
>> 2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
>> ERROR 6017: Execution failed, while processing hdfs://
>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
>> hdfs://
>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
>> 2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
>> org.apache.pig.backend.executionengine.ExecException: ERROR 6017: Execution
>> failed, while processing hdfs://
>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
>> hdfs://
>> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
>> at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181)
>> at
>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
>> at
>> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:777)
>> at org.apache.pig.PigServer.execute(PigServer.java:770)
>> at org.apache.pig.PigServer.access$100(PigServer.java:89)
>> at org.apache.pig.PigServer$Graph.execute(PigServer.java:947)
>> at org.apache.pig.PigServer.executeBatch(PigServer.java:249)
>> at
>> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115)
>> at
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172)
>> at
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
>> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
>> at org.apache.pig.Main.main(Main.java:320)
>>
>
>
Re: how to debug pig with ERROR 6017
Posted by hc busy <hc...@gmail.com>.
I tried to turn optimization offer per collegue's suggestion, and it still
failed the same place. No error from the hadoop UI.
On Thu, Apr 29, 2010 at 4:05 PM, hc busy <hc...@gmail.com> wrote:
> Hey guys, I'm trying to figure out why my pig script crashes half way
> (after 2 or 3 mr's) The error is below. I took a dump of the plan and didn't
> see anything suspicious except that the missing temp file wasn't part of the
> plan any where. The hadoop UI did not report any kind of MR error.
>
> Any help would be appreciated.
>
>
> 2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 6017: Execution failed, while processing hdfs://
> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
> hdfs://
> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
> 2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> org.apache.pig.backend.executionengine.ExecException: ERROR 6017: Execution
> failed, while processing hdfs://
> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
> hdfs://
> sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:777)
> at org.apache.pig.PigServer.execute(PigServer.java:770)
> at org.apache.pig.PigServer.access$100(PigServer.java:89)
> at org.apache.pig.PigServer$Graph.execute(PigServer.java:947)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:249)
> at
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
> at org.apache.pig.Main.main(Main.java:320)
>