You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Bikas Saha (JIRA)" <ji...@apache.org> on 2013/12/20 12:48:09 UTC
[jira] [Updated] (TEZ-682) TezGroupedSplits fails with empty (zero
length) file
[ https://issues.apache.org/jira/browse/TEZ-682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bikas Saha updated TEZ-682:
---------------------------
Attachment: TEZ-682.1.patch
> TezGroupedSplits fails with empty (zero length) file
> ----------------------------------------------------
>
> Key: TEZ-682
> URL: https://issues.apache.org/jira/browse/TEZ-682
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.2.0, 0.3.0
> Reporter: Gunther Hagleitner
> Attachments: TEZ-682.1.patch
>
>
> Running hive on a directory with some 0 length files in it:
> 2013-12-17 23:01:35,868 ERROR [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Vertex Input: bucket1_1 initializer failed
> java.lang.NullPointerException
> at org.apache.hadoop.io.Text.encode(Text.java:443)
> at org.apache.hadoop.io.Text.encode(Text.java:424)
> at org.apache.hadoop.io.Text.writeString(Text.java:476)
> at org.apache.hadoop.mapred.split.TezGroupedSplit.write(TezGroupedSplit.java:87)
> at org.apache.tez.mapreduce.hadoop.MRHelpers.createSplitProto(MRHelpers.java:446)
> at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:129)
> at org.apache.tez.dag.app.dag.RootInputInitializerRunner$InputInitializerCallable.call(RootInputInitializerRunner.java:121)
> at org.apache.tez.dag.app.dag.RootInputInitializerRunner$InputInitializerCallable.call(RootInputInitializerRunner.java:97)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:695)
> Deleting the empty files makes the error disappear.
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)