You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@sentry.apache.org by "Alexander Kolbasov (JIRA)" <ji...@apache.org> on 2017/09/26 20:59:01 UTC

[jira] [Updated] (SENTRY-1964) HDFS sync does not need partition locations (usually)

     [ https://issues.apache.org/jira/browse/SENTRY-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexander Kolbasov updated SENTRY-1964:
---------------------------------------
    Summary: HDFS sync does not need partition locations (usually)  (was: Do not save and send partition to HDFS)

> HDFS sync does not need partition locations (usually)
> -----------------------------------------------------
>
>                 Key: SENTRY-1964
>                 URL: https://issues.apache.org/jira/browse/SENTRY-1964
>             Project: Sentry
>          Issue Type: Improvement
>          Components: Sentry
>    Affects Versions: 2.0.0
>            Reporter: Na Li
>            Assignee: Na Li
>            Priority: Critical
>
> Right now, sentry saves partition info from HMS and send it to HDFS. HDFS only needs database and table info, and does not need partition info for ACL unless the partion location is not sharing the same prefix of its table.
> The partition data amount is huge, and causes performance issue. We can optimize it by not saving and not sending partition info if it shares the same path of its table. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)