You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2014/02/20 19:04:20 UTC

[jira] [Commented] (TEZ-863) NullPointerException in shuffle phase

    [ https://issues.apache.org/jira/browse/TEZ-863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13907253#comment-13907253 ] 

Hitesh Shah commented on TEZ-863:
---------------------------------

[~rajesh.balamohan] Could you attach the logs for the task attempt that had this error?

> NullPointerException in shuffle phase
> -------------------------------------
>
>                 Key: TEZ-863
>                 URL: https://issues.apache.org/jira/browse/TEZ-863
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>         Environment: Hadoop 2.3.0,  Hive 0.13,  Tez 0.3.0
>            Reporter: Rajesh Balamohan
>            Priority: Critical
>
> When running amplab-benchmark (query 2a, 2b, 2c), randomly the following exception is thrown.  It is not very consistent though.
> Amplab query reference: https://amplab.cs.berkeley.edu/benchmark/
> >>>
> SELECT SUBSTR(sourceIP, 1, 10), SUM(adRevenue) FROM uservisits GROUP BY SUBSTR(sourceIP, 1, 10)
> >>>
> Vertex re-running, vertexName=Map 1, vertexId=vertex_1392875986731_0052_2_01
> Vertex failed, vertexName=Reducer 2, vertexId=vertex_1392875986731_0052_2_00, diagnostics=[Task failed, taskId=task_1392875986731_0052_2_00_000030, diagnostics=[AttemptID:attempt_1392875986731_0052_2_00_000030_0 Info:Error: java.lang.NullPointerException
>         at org.apache.tez.runtime.library.common.shuffle.impl.Shuffle.handleEvents(Shuffle.java:175)
>         at org.apache.tez.runtime.library.input.ShuffledMergedInput.handleEvents(ShuffledMergedInput.java:195)
>         at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.handleEvent(LogicalIOProcessorRuntimeTask.java:566)
>         at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.access$1100(LogicalIOProcessorRuntimeTask.java:81)
>         at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$1.run(LogicalIOProcessorRuntimeTask.java:628)
>         at java.lang.Thread.run(Thread.java:744)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)