You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Goun Na (JIRA)" <ji...@apache.org> on 2018/04/25 03:14:00 UTC
[jira] [Comment Edited] (HIVE-19283) Select count(distinct()) a
couple of times stuck in last reducer
[ https://issues.apache.org/jira/browse/HIVE-19283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16451555#comment-16451555 ]
Goun Na edited comment on HIVE-19283 at 4/25/18 3:13 AM:
---------------------------------------------------------
[~gopalv], that is a great news! Thanks!
was (Author: goun):
[~gopalv], this is great! Thanks!
> Select count(distinct()) a couple of times stuck in last reducer
> ----------------------------------------------------------------
>
> Key: HIVE-19283
> URL: https://issues.apache.org/jira/browse/HIVE-19283
> Project: Hive
> Issue Type: Improvement
> Components: CBO, Logical Optimizer
> Affects Versions: 2.1.1
> Reporter: Goun Na
> Assignee: Ashutosh Chauhan
> Priority: Major
>
> Distinct count query performance is significantly improved due to HIVE-10568.
> {code:java}
> select count(distinct elevenst_id)
> from 11st.log_table
> where part_dt between '20180101' and '20180131'{code}
>
> However, some queries with several distinct counts are still slow. It starts with multiple mappers, but stuck in the last one reducer.
> {code:java}
> select
> count(distinct elevenst_id)
> , count(distinct member_id)
> , count(distinct user_id)
> , count(distinct action_id)
> , count(distinct other_id)
> from 11st.log_table
> where part_dt between '20180101' and '20180131'{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)