[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

["Daryn Sharp (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daryn Sharp updated HDFS-10939:
-------------------------------
    Attachment: HDFS-10939.patch

Full use of IIP in EncryptionZoneManager and FsDirEncryptionZoneOp required a few minor IIP xattr api changes with a small ripple into other classes.

Main changes are:
# a few more shorts via hasCreatedEncryptionZone()
# moved EZ specific code from FsDirWriteFileOp into FsDirEncryptionZoneOp
# significantly cleaned up startFile method
# forced multi-stage locking is removed.  Instead of read lock, resolve, pre-conditions, read unlock, may generate EDEK, write lock, resolve, pre-conditions, do create; it's now write lock, resolve, pre-conditions, (iff need EDEK: write unlock, generate EDEK, write lock, re-resolve, pre-conditions), do create
# don't allocate BlocksMapUpdateInfo until just before needed so failed creates don't waste allocations
# tweaked how skipSync is set to avoid nothing to sync logging in some cases 

> Reduce performance penalty of encryption zones
> ----------------------------------------------
>
>                 Key: HDFS-10939
>                 URL: https://issues.apache.org/jira/browse/HDFS-10939
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs
>    Affects Versions: 2.7
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>         Attachments: HDFS-10939.patch
>
>
> The encryption zone APIs should be optimized to extensively use IIPs to eliminate path resolutions.  The performance penalties incurred by common operations like creation of file statuses may be reduced by more extensive short-circuiting of EZ lookups when no EZs exist.  All file creates should not be subjected to the multi-stage locking performance penalty required only for EDEK generation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org