You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by GitBox <gi...@apache.org> on 2021/02/16 08:42:30 UTC

[GitHub] [hive] rbalamohan opened a new pull request #1980: Hive 24764 1

rbalamohan opened a new pull request #1980:
URL: https://github.com/apache/hive/pull/1980


   https://issues.apache.org/jira/browse/HIVE-24764
   insert overwrite on a partition resets row count stats in other partitions. This causes partitions to return PARTIAL value and in some cases, it ends up generating suboptimal plan.
   What changes were proposed in this pull request?
   
   FSStatsAggregator::aggregateStats should return the value when the partitions are present in its statslist. Otherwise, it should return empty or null value. This would prevent stats from being overwritten in BasicStatsTask::updateStats for other partitions during 'insert overwrite' operation.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


[GitHub] [hive] rbalamohan commented on pull request #1980: Hive 24764: insert overwrite on a partition resets row count stats in other partitions

Posted by GitBox <gi...@apache.org>.
rbalamohan commented on pull request #1980:
URL: https://github.com/apache/hive/pull/1980#issuecomment-783123814


   Thanks @ashutoshc for the review.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


[GitHub] [hive] ashutoshc commented on pull request #1980: Hive 24764: insert overwrite on a partition resets row count stats in other partitions

Posted by GitBox <gi...@apache.org>.
ashutoshc commented on pull request #1980:
URL: https://github.com/apache/hive/pull/1980#issuecomment-783090481


   +1 LGTM


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org


[GitHub] [hive] rbalamohan merged pull request #1980: Hive 24764: insert overwrite on a partition resets row count stats in other partitions

Posted by GitBox <gi...@apache.org>.
rbalamohan merged pull request #1980:
URL: https://github.com/apache/hive/pull/1980


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org