You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Vineet Garg (JIRA)" <ji...@apache.org> on 2018/04/11 04:07:00 UTC
[jira] [Commented] (HIVE-19165) TestMiniLlapLocalCliDriver
groupby_groupingset_bug failure
[ https://issues.apache.org/jira/browse/HIVE-19165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433372#comment-16433372 ]
Vineet Garg commented on HIVE-19165:
------------------------------------
cc [~kgyrtkirk] I wasn't able to reproduce this outside test but this is reproducible on master.
> TestMiniLlapLocalCliDriver groupby_groupingset_bug failure
> ----------------------------------------------------------
>
> Key: HIVE-19165
> URL: https://issues.apache.org/jira/browse/HIVE-19165
> Project: Hive
> Issue Type: Sub-task
> Components: Test
> Reporter: Vineet Garg
> Priority: Major
>
> Query:
> {code:sql}
> select count(*) cnt
> from
> x1_store_sales s
> ,x1_date_dim d
> ,x1_item i
> where
> 1=1
> and s.ss_sold_date_sk = d.d_date_sk
> and s.ss_item_sk = i.i_item_sk
> and d.d_month_seq in
> (select distinct (d_month_seq)
> from x1_date_dim
> where d_year = 2000 and d_year*d_moy > 200000
> and d_moy = 2 )
> and i.i_current_price >
> (select min(j.i_current_price)
> from x1_item j
> where j.i_category = i.i_category)
> group by d.d_month_seq
> order by cnt
> limit 100;
> {code}
> Error stack:
> {noformat}
> 2018-04-10T20:36:49,379 ERROR [2f7066d9-5b29-4558-9a95-63f1da246cae main] ql.Driver: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 7, vertexId=vertex_1523417780216_0001_38_06, diagnostics=[Task failed, taskId=task_1523417780216_0001_38_06_000000, diagnostics=[TaskAttempt 0 killed, TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) : attempt_1523417780216_0001_38_06_000000_1:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
> at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
> at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:266)
> ... 15 more
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
> at org.apache.hadoop.hive.ql.exec.tez.DynamicValueRegistryTez.setValue(DynamicValueRegistryTez.java:78)
> at org.apache.hadoop.hive.ql.exec.tez.DynamicValueRegistryTez.init(DynamicValueRegistryTez.java:118)
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:313)
> ... 16 more
> ], TaskAttempt 2 failed, info=[Error: Error while running task ( failure ) : attempt_1523417780216_0001_38_06_000000_2:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
> at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
> at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
> at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
> at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:354)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:266)
> ... 15 more
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap.putVal(ConcurrentHashMap.java:1011)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1006)
> at org.apache.hadoop.hive.ql.exec.tez.DynamicValueRegistryTez.setValue(DynamicValueRegistryTez.java:78)
> at org.apache.hadoop.hive.ql.exec.tez.DynamicValueRegistryTez.init(DynamicValueRegistryTez.java:118)
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:313)
> ... 16 more
> ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1523417780216_0001_38_06 [Map 7] killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 5, vertexId=vertex_1523417780216_0001_38_08, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1523417780216_0001_38_08 [Reducer 5] killed/failed due to:OTHER_VERTEX_FAILURE]Vertex killed, vertexName=Reducer 6, vertexId=vertex_1523417780216_0001_38_09, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1523417780216_0001_38_09 [Reducer 6] killed/failed due to:OTHER_VERTEX_FAILURE]Vertex killed, vertexName=Map 4, vertexId=vertex_1523417780216_0001_38_07, diagnostics=[Vertex received Kill in INITED state., Vertex vertex_1523417780216_0001_38_07 [Map 4] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:3
> 2018-04-10T20:36:49,379 DEBUG [2f7066d9-5b29-4558-9a95-63f1da246cae main] ql.Driver: Shutting down query
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)