You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Kevin Weil <ke...@gmail.com> on 2009/09/25 21:36:34 UTC

Exception from empty samples file

I am randomly getting the following stack trace, and having otherwise simple
jobs fail.  We're running the version of pig-0.4 that comes with Cloudera's
new 0.20.1-based distro, so I know it's a patched version of Pig.  But
perhaps someone provide some insight into the stack trace.  So the samples
file is empty -- is that the root problem, or a side effect?  Should the
samples file ever be empty, i.e. should this be a job-killing error?  Is
there a pig-script-level issue that I should look for that might be causing
the empty samples file?
Thanks in advance,
Kevin

2009-09-25 19:02:20,927 WARN org.apache.hadoop.mapred.TaskTracker:
Error running child
java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
	at org.apache.hadoop.mapred.MapTask$OldOutputCollector.<init>(MapTask.java:448)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
	... 6 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
Empty samples file
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.configure(WeightedRangePartitioner.java:104)
	... 11 more
Caused by: java.lang.RuntimeException: Empty samples file
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.configure(WeightedRangePartitioner.java:89)
	... 11 more
2009-09-25 19:02:20,932 INFO org.apache.hadoop.mapred.TaskRunner:
Runnning cleanup for the task

Re: Exception from empty samples file

Posted by Thejas Nair <te...@yahoo-inc.com>.
Looks like you have hit this bug -
https://issues.apache.org/jira/browse/PIG-894 .

Is your script generating empty input for the order-by ?

-Thejas



On 9/25/09 12:36 PM, "Kevin Weil" <ke...@gmail.com> wrote:

> I am randomly getting the following stack trace, and having otherwise simple
> jobs fail.  We're running the version of pig-0.4 that comes with Cloudera's
> new 0.20.1-based distro, so I know it's a patched version of Pig.  But
> perhaps someone provide some insight into the stack trace.  So the samples
> file is empty -- is that the root problem, or a side effect?  Should the
> samples file ever be empty, i.e. should this be a job-killing error?  Is
> there a pig-script-level issue that I should look for that might be causing
> the empty samples file?
> Thanks in advance,
> Kevin
> 
> 2009-09-25 19:02:20,927 WARN org.apache.hadoop.mapred.TaskTracker:
> Error running child
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
> at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> at 
> org.apache.hadoop.mapred.MapTask$OldOutputCollector.<init>(MapTask.java:448)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.j
> ava:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
> ... 6 more
> Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
> Empty samples file
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.Weig
> htedRangePartitioner.configure(WeightedRangePartitioner.java:104)
> ... 11 more
> Caused by: java.lang.RuntimeException: Empty samples file
> at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.Weig
> htedRangePartitioner.configure(WeightedRangePartitioner.java:89)
> ... 11 more
> 2009-09-25 19:02:20,932 INFO org.apache.hadoop.mapred.TaskRunner:
> Runnning cleanup for the task