You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2017/11/14 03:02:00 UTC
[jira] [Commented] (HIVE-14953) don't use globStatus on S3 in MM
tables
[ https://issues.apache.org/jira/browse/HIVE-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250738#comment-16250738 ]
Lefty Leverenz commented on HIVE-14953:
---------------------------------------
Doc note: This adds *hive.mm.avoid.s3.globstatus* to HiveConf.java and branch-14535 has been merged to master for release 3.0.0 by HIVE-15212, so the wiki needs to be updated.
I'm not sure where *hive.mm.avoid.s3.globstatus* belongs in Configuration Properties. Perhaps the Transactions section should have a subsection, although so far this is the only new parameter that needs to be documented.
* [Configuration Properties -- Transactions and Compactor | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-TransactionsandCompactor]
Added a TODOC3.0.0 label.
> don't use globStatus on S3 in MM tables
> ---------------------------------------
>
> Key: HIVE-14953
> URL: https://issues.apache.org/jira/browse/HIVE-14953
> Project: Hive
> Issue Type: Sub-task
> Reporter: Rajesh Balamohan
> Assignee: Sergey Shelukhin
> Labels: TODOC3.0
> Fix For: hive-14535
>
> Attachments: HIVE-14953.01.patch, HIVE-14953.patch
>
>
> Need to investigate if recursive get is faster. Also, normal listStatus might suffice because MM code handles directory structure in a more definite manner than old code; so it knows where the files of interest are to be found.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)