You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2010/06/28 18:19:50 UTC
[jira] Commented: (PIG-1470) map/red jobs fail using G1 GC
(Couldn't find heap)
[ https://issues.apache.org/jira/browse/PIG-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883205#action_12883205 ]
Ashutosh Chauhan commented on PIG-1470:
---------------------------------------
This is actually a bug in G1. http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6815790 Towards the bottom of page there is a comment:
{code}
Evaluation The monitoring and management support for G1 is yet to be implemented
{code}
I think until it gets fixed in G1, we should recommend users not to use G1.
> map/red jobs fail using G1 GC (Couldn't find heap)
> --------------------------------------------------
>
> Key: PIG-1470
> URL: https://issues.apache.org/jira/browse/PIG-1470
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.6.0
> Environment: OS: 2.6.27.19-5-default #1 SMP 2009-02-28 04:40:21 +0100 x86_64 x86_64 x86_64 GNU/Linux
> Java: Java(TM) SE Runtime Environment (build 1.6.0_18-b07)
> Hadoop: 0.20.1
> Reporter: Randy Prager
>
> Here is the hadoop map/red configuration (conf/mapred-site.xml) that fails
> {noformat}
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx300m -XX:+DoEscapeAnalysis -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseG1GC</value>
> </property>
> {noformat}
> Here is the hadoop map/red configuration that succeeds
> {noformat}
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx300m -XX:+DoEscapeAnalysis -XX:+UseCompressedOops</value>
> </property>
> {noformat}
> Here is the exception from the pig script.
> {noformat}
> Backend error message
> ---------------------
> org.apache.pig.backend.executionengine.ExecException: ERROR 2081: Unable to set up the load function.
> at org.apache.pig.backend.executionengine.PigSlice.init(PigSlice.java:89)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.SliceWrapper.makeReader(SliceWrapper.java:144)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getRecordReader(PigInputFormat.java:282)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:338)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: java.lang.RuntimeException: could not instantiate 'PigStorage' with arguments '[,]'
> at org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:519)
> at org.apache.pig.backend.executionengine.PigSlice.init(PigSlice.java:85)
> ... 5 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:487)
> ... 6 more
> Caused by: java.lang.RuntimeException: Couldn't find heap
> at org.apache.pig.impl.util.SpillableMemoryManager.<init>(SpillableMemoryManager.java:95)
> at org.apache.pig.data.BagFactory.<init>(BagFactory.java:106)
> at org.apache.pig.data.DefaultBagFactory.<init>(DefaultBagFactory.java:71)
> at org.apache.pig.data.BagFactory.getInstance(BagFactory.java:76)
> at org.apache.pig.builtin.Utf8StorageConverter.<init>(Utf8StorageConverter.java:49)
> at org.apache.pig.builtin.PigStorage.<init>(PigStorage.java:69)
> at org.apache.pig.builtin.PigStorage.<init>(PigStorage.java:79)
> ... 11 more
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.