You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Goun Na (JIRA)" <ji...@apache.org> on 2018/04/24 05:09:00 UTC
[jira] [Updated] (HIVE-19283) Select count(distinct()) a couple of
times stuck in last reducer
[ https://issues.apache.org/jira/browse/HIVE-19283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Goun Na updated HIVE-19283:
---------------------------
Description:
Distinct count query performance is significantly improved due to HIVE-10568.
{code:java}
select count(distinct elevenst_id)
from 11st.log_table
where part_dt between '20180101' and '20180131'{code}
However, some queries with several distinct counts are still slow. It starts with multiple mappers, but stuck in the last one reducer.
{code:java}
select
count(distinct elevenst_id)
, count(distinct member_id)
, count(distinct user_id)
, count(distinct action_id)
, count(distinct other_id)
from 11st.log_table
where part_dt between '20180101' and '20180131'{code}
was:
Distinct count query performance is significantly improved due to HIVE-10568.
{code:java}
select count(distinct elevenst_id)
from 11st.log_table
where part_dt between '20180101' and '20180131'{code}
However, some queries that contain several distinct counts are still slow. It starts with multiple mappers, but stuck in the last one reducer.
{code:java}
select
count(distinct elevenst_id)
, count(distinct member_id)
, count(distinct user_id)
, count(distinct action_id)
, count(distinct other_id)
from 11st.log_table
where part_dt between '20180101' and '20180131'{code}
> Select count(distinct()) a couple of times stuck in last reducer
> ----------------------------------------------------------------
>
> Key: HIVE-19283
> URL: https://issues.apache.org/jira/browse/HIVE-19283
> Project: Hive
> Issue Type: Improvement
> Components: CBO, Logical Optimizer
> Affects Versions: 2.1.1
> Reporter: Goun Na
> Assignee: Ashutosh Chauhan
> Priority: Major
>
> Distinct count query performance is significantly improved due to HIVE-10568.
> {code:java}
> select count(distinct elevenst_id)
> from 11st.log_table
> where part_dt between '20180101' and '20180131'{code}
>
> However, some queries with several distinct counts are still slow. It starts with multiple mappers, but stuck in the last one reducer.
> {code:java}
> select
> count(distinct elevenst_id)
> , count(distinct member_id)
> , count(distinct user_id)
> , count(distinct action_id)
> , count(distinct other_id)
> from 11st.log_table
> where part_dt between '20180101' and '20180131'{code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)