You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Kevin Weil <ke...@gmail.com> on 2009/09/25 21:36:34 UTC
Exception from empty samples file
I am randomly getting the following stack trace, and having otherwise simple
jobs fail. We're running the version of pig-0.4 that comes with Cloudera's
new 0.20.1-based distro, so I know it's a patched version of Pig. But
perhaps someone provide some insight into the stack trace. So the samples
file is empty -- is that the root problem, or a side effect? Should the
samples file ever be empty, i.e. should this be a job-killing error? Is
there a pig-script-level issue that I should look for that might be causing
the empty samples file?
Thanks in advance,
Kevin
2009-09-25 19:02:20,927 WARN org.apache.hadoop.mapred.TaskTracker:
Error running child
java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask$OldOutputCollector.<init>(MapTask.java:448)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 6 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
Empty samples file
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.configure(WeightedRangePartitioner.java:104)
... 11 more
Caused by: java.lang.RuntimeException: Empty samples file
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.configure(WeightedRangePartitioner.java:89)
... 11 more
2009-09-25 19:02:20,932 INFO org.apache.hadoop.mapred.TaskRunner:
Runnning cleanup for the task
Re: Exception from empty samples file
Posted by Thejas Nair <te...@yahoo-inc.com>.
Looks like you have hit this bug -
https://issues.apache.org/jira/browse/PIG-894 .
Is your script generating empty input for the order-by ?
-Thejas
On 9/25/09 12:36 PM, "Kevin Weil" <ke...@gmail.com> wrote:
> I am randomly getting the following stack trace, and having otherwise simple
> jobs fail. We're running the version of pig-0.4 that comes with Cloudera's
> new 0.20.1-based distro, so I know it's a patched version of Pig. But
> perhaps someone provide some insight into the stack trace. So the samples
> file is empty -- is that the root problem, or a side effect? Should the
> samples file ever be empty, i.e. should this be a job-killing error? Is
> there a pig-script-level issue that I should look for that might be causing
> the empty samples file?
> Thanks in advance,
> Kevin
>
> 2009-09-25 19:02:20,927 WARN org.apache.hadoop.mapred.TaskTracker:
> Error running child
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at
> org.apache.hadoop.mapred.MapTask$OldOutputCollector.<init>(MapTask.java:448)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.j
> ava:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 6 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> Empty samples file
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.Weig
> htedRangePartitioner.configure(WeightedRangePartitioner.java:104)
> ... 11 more
> Caused by: java.lang.RuntimeException: Empty samples file
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.Weig
> htedRangePartitioner.configure(WeightedRangePartitioner.java:89)
> ... 11 more
> 2009-09-25 19:02:20,932 INFO org.apache.hadoop.mapred.TaskRunner:
> Runnning cleanup for the task