You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Aditya Shah (Jira)" <ji...@apache.org> on 2020/03/03 06:23:00 UTC
[jira] [Comment Edited] (HIVE-22964) MM table split computation is
very slow
[ https://issues.apache.org/jira/browse/HIVE-22964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049932#comment-17049932 ]
Aditya Shah edited comment on HIVE-22964 at 3/3/20 6:22 AM:
------------------------------------------------------------
Adding threadpool to processPathforMMRead
[~gopalv] [~pvary] [~prasanth_j] can you please review. Thanks!
was (Author: aditya-shah):
Adding threadpool to processPathforMMRead
> MM table split computation is very slow
> ---------------------------------------
>
> Key: HIVE-22964
> URL: https://issues.apache.org/jira/browse/HIVE-22964
> Project: Hive
> Issue Type: Improvement
> Reporter: Aditya Shah
> Assignee: Aditya Shah
> Priority: Major
> Attachments: HIVE-22964.patch
>
>
> Since for MM table we process the paths prior to inputFormat.getSplits() we end up doing listing on the whole table at once. This could be optimized.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)