You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Liu Shaohui (JIRA)" <ji...@apache.org> on 2016/03/03 15:16:18 UTC

[jira] [Created] (HDFS-9898) An operation of atomic fold rename crashed in Wasb FileSystem

Liu Shaohui created HDFS-9898:
---------------------------------

             Summary: An operation of atomic fold rename crashed in Wasb FileSystem
                 Key: HDFS-9898
                 URL: https://issues.apache.org/jira/browse/HDFS-9898
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Liu Shaohui
            Priority: Critical


An operation of atomic fold rename crashed in Wasb FileSystem
{code}
org.apache.hadoop.fs.azure.AzureException: Source blob hbase/azurtst-xiaomi/data/default/YCSBTest/5f882f5492c90b4c03a26561a2ee0a96/.regioninfo does not exist.
        at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.rename(AzureNativeFileSystemStore.java:2405)
        at org.apache.hadoop.fs.azure.NativeAzureFileSystem$FolderRenamePending.execute(NativeAzureFileSystem.java:413)
        at org.apache.hadoop.fs.azure.NativeAzureFileSystem.rename(NativeAzureFileSystem.java:1997)
{code}

The problem is that there are duplicated file is the RenamePending.json. 
{code}
    "5f882f5492c90b4c03a26561a2ee0a96",                                                     
"5f882f5492c90b4c03a26561a2ee0a96\/.regioninfo",                                                                                                                              
    "5f882f5492c90b4c03a26561a2ee0a96\/C\/8a2c08db432d447d9e0ed5266940b25e",                         
    "5f882f5492c90b4c03a26561a2ee0a96\/C\/9425c621073e41df9430e88f0ef61c01",                         
    "5f882f5492c90b4c03a26561a2ee0a96\/C\/f9fc55a94fa34efbb2d26be77c76187c",                         
    "5f882f5492c90b4c03a26561a2ee0a96\/.regioninfo",                                                 
    "5f882f5492c90b4c03a26561a2ee0a96\/.tmp",                                                        
    "5f882f5492c90b4c03a26561a2ee0a96\/C",                                                           
    "5f882f5492c90b4c03a26561a2ee0a96\/C\/8a2c08db432d447d9e0ed5266940b25e",                         
    "5f882f5492c90b4c03a26561a2ee0a96\/C\/9425c621073e41df9430e88f0ef61c01",                         
    "5f882f5492c90b4c03a26561a2ee0a96\/C\/f9fc55a94fa34efbb2d26be77c76187c",                         
    "5f882f5492c90b4c03a26561a2ee0a96\/recovered.edits", 

{code}

Maybe there is a bug in the Listing of all the files in the folder in Wasb. Any suggestions?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)