[jira] [Updated] (HDFS-8269) getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime

["Junping Du (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Junping Du updated HDFS-8269:
-----------------------------
    Fix Version/s: 2.8.0

> getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-8269
>                 URL: https://issues.apache.org/jira/browse/HDFS-8269
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Yesha Vora
>            Assignee: Haohui Mai
>            Priority: Blocker
>             Fix For: 2.8.0, 2.7.1, 3.0.0-alpha1
>
>         Attachments: HDFS-8269.000.patch, HDFS-8269.001.patch, HDFS-8269.002.patch, HDFS-8269.003.patch
>
>
> When {{FSNamesystem#getBlockLocations}} updates the access time of the INode, it uses the path passed from the client, which generates incorrect edit logs entries:
> {noformat}
>   <RECORD>
>     <OPCODE>OP_TIMES</OPCODE>
>     <DATA>
>       <TXID>5085</TXID>
>       <LENGTH>0</LENGTH>
>       <PATH>/.reserved/.inodes/18230</PATH>
>       <MTIME>-1</MTIME>
>       <ATIME>1429908236392</ATIME>
>     </DATA>
>   </RECORD>
> {noformat}
> Note that the NN does not resolve the {{/.reserved}} path when processing the edit log, therefore it eventually leads to a NPE when loading the edit logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org