You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "vitthal (Suhas) Gogate (JIRA)" <ji...@apache.org> on 2011/06/04 00:03:47 UTC
[jira] [Created] (HIVE-2195) Hive queries hangs with first stage
job created with zero mappers and 1 reducer,
Hive queries hangs with first stage job created with zero mappers and 1 reducer,
----------------------------------------------------------------------------------
Key: HIVE-2195
URL: https://issues.apache.org/jira/browse/HIVE-2195
Project: Hive
Issue Type: Bug
Affects Versions: 0.7.0
Reporter: vitthal (Suhas) Gogate
This happens when query aggregate data w/ predicate selecting bunch of non-existing data partitions.
e,g, Table XXX has five columns, A (int), B (int), C(string), date (int) and hour (int), where date/hour are the partition columns,
select cast((100*date+hour) as BIGINT) as datehour, sum(A) as sumA,
sum(B) as sumB from XXX where date>=20110925 and C='test' group by date, hour order by datehour
In the above query, make a note that selected date partition range does not exists in hive table i.e. no date partitions for date>=20110925
The above query hangs with the first map reduce job it creates, with zero mappers and 1 reducer.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-2195) Hive queries hangs with first stage
job created with zero mappers and 1 reducer,
Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vaibhav Aggarwal resolved HIVE-2195.
------------------------------------
Resolution: Not A Problem
> Hive queries hangs with first stage job created with zero mappers and 1 reducer,
> ----------------------------------------------------------------------------------
>
> Key: HIVE-2195
> URL: https://issues.apache.org/jira/browse/HIVE-2195
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: vitthal (Suhas) Gogate
> Assignee: Vaibhav Aggarwal
>
> This happens when query aggregate data w/ predicate selecting bunch of non-existing data partitions.
> e,g, Table XXX has five columns, A (int), B (int), C(string), date (int) and hour (int), where date/hour are the partition columns,
> select cast((100*date+hour) as BIGINT) as datehour, sum(A) as sumA,
> sum(B) as sumB from XXX where date>=20110925 and C='test' group by date, hour order by datehour
> In the above query, make a note that selected date partition range does not exists in hive table i.e. no date partitions for date>=20110925
> The above query hangs with the first map reduce job it creates, with zero mappers and 1 reducer.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2195) Hive queries hangs with first stage
job created with zero mappers and 1 reducer,
Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072014#comment-13072014 ]
Vaibhav Aggarwal commented on HIVE-2195:
----------------------------------------
This is an issue with the fair scheduler.
This is not a Hive issue.
> Hive queries hangs with first stage job created with zero mappers and 1 reducer,
> ----------------------------------------------------------------------------------
>
> Key: HIVE-2195
> URL: https://issues.apache.org/jira/browse/HIVE-2195
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: vitthal (Suhas) Gogate
> Assignee: Vaibhav Aggarwal
>
> This happens when query aggregate data w/ predicate selecting bunch of non-existing data partitions.
> e,g, Table XXX has five columns, A (int), B (int), C(string), date (int) and hour (int), where date/hour are the partition columns,
> select cast((100*date+hour) as BIGINT) as datehour, sum(A) as sumA,
> sum(B) as sumB from XXX where date>=20110925 and C='test' group by date, hour order by datehour
> In the above query, make a note that selected date partition range does not exists in hive table i.e. no date partitions for date>=20110925
> The above query hangs with the first map reduce job it creates, with zero mappers and 1 reducer.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2195) Hive queries hangs with first stage
job created with zero mappers and 1 reducer,
Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vaibhav Aggarwal reassigned HIVE-2195:
--------------------------------------
Assignee: Vaibhav Aggarwal
> Hive queries hangs with first stage job created with zero mappers and 1 reducer,
> ----------------------------------------------------------------------------------
>
> Key: HIVE-2195
> URL: https://issues.apache.org/jira/browse/HIVE-2195
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: vitthal (Suhas) Gogate
> Assignee: Vaibhav Aggarwal
>
> This happens when query aggregate data w/ predicate selecting bunch of non-existing data partitions.
> e,g, Table XXX has five columns, A (int), B (int), C(string), date (int) and hour (int), where date/hour are the partition columns,
> select cast((100*date+hour) as BIGINT) as datehour, sum(A) as sumA,
> sum(B) as sumB from XXX where date>=20110925 and C='test' group by date, hour order by datehour
> In the above query, make a note that selected date partition range does not exists in hive table i.e. no date partitions for date>=20110925
> The above query hangs with the first map reduce job it creates, with zero mappers and 1 reducer.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira