You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Nick Dimiduk (JIRA)" <ji...@apache.org> on 2013/10/11 01:14:42 UTC
[jira] [Commented] (HBASE-9744) Set io.serializations correctly in
HFileOutputFormat.configureIncrementalLoad
[ https://issues.apache.org/jira/browse/HBASE-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792087#comment-13792087 ]
Nick Dimiduk commented on HBASE-9744:
-------------------------------------
Good catch. +1
> Set io.serializations correctly in HFileOutputFormat.configureIncrementalLoad
> -----------------------------------------------------------------------------
>
> Key: HBASE-9744
> URL: https://issues.apache.org/jira/browse/HBASE-9744
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.96.0
> Reporter: Jean-Daniel Cryans
> Assignee: Jean-Daniel Cryans
> Priority: Minor
> Fix For: 0.96.1
>
> Attachments: HBASE-9744.patch
>
>
> HFileOutputFormat.configureIncrementalLoad is not setting all the io serializations correctly so custom bulk loaders (like ImportTsv) need to set it. Simple fix, just add what's missing.
> In case someone doesn't get this patch but upgrades to an old RC, this is what you'll see when running via YARN (or similar if MR1):
> {noformat}
> 2013-10-10 09:48:13,836 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.NullPointerException
> at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:989)
> at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:390)
> at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:79)
> at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:674)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:746)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:165)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1485)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:160)
> {noformat}
> Kudos to [~jarcec] for finding the issue.
--
This message was sent by Atlassian JIRA
(v6.1#6144)