You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/12/03 11:14:00 UTC
[jira] [Work logged] (HIVE-25448) Invalid partition columns when skew with distinct
[ https://issues.apache.org/jira/browse/HIVE-25448?focusedWorklogId=689917&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-689917 ]
ASF GitHub Bot logged work on HIVE-25448:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Dec/21 11:13
Start Date: 03/Dec/21 11:13
Worklog Time Spent: 10m
Work Description: dengzhhu653 commented on pull request #2585:
URL: https://github.com/apache/hive/pull/2585#issuecomment-985433461
> > @dengzhhu653 do you happen to have a testcase for this?
>
> Not yet, I have tested on our environment for the skew table, shows that it can get pretty performance gain(mr).
Hi @kgyrtkirk, what do you think about this? there are also some tests like [groupby11.q](https://github.com/apache/hive/blob/7b3ecf617a6d46f48a3b6f77e0339fd4ad95a420/ql/src/test/queries/clientpositive/groupby11.q) and [groupby8_map_skew.q](https://github.com/apache/hive/blob/7b3ecf617a6d46f48a3b6f77e0339fd4ad95a420/ql/src/test/queries/clientpositive/groupby8_map_skew.q) showing the changes in partition columns after applying the fix. Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 689917)
Time Spent: 1h 20m (was: 1h 10m)
> Invalid partition columns when skew with distinct
> -------------------------------------------------
>
> Key: HIVE-25448
> URL: https://issues.apache.org/jira/browse/HIVE-25448
> Project: Hive
> Issue Type: Bug
> Components: Logical Optimizer
> Reporter: Zhihua Deng
> Assignee: Zhihua Deng
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> When hive.groupby.skewindata is enabled, we spray by the grouping key and distinct key if distinct is present in the first reduce sink operator.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)