You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/06/23 17:24:00 UTC

[jira] [Commented] (HADOOP-14583) wasb throws an exception if you try to create a file and there's no parent directory

    [ https://issues.apache.org/jira/browse/HADOOP-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061255#comment-16061255 ] 

Steve Loughran commented on HADOOP-14583:
-----------------------------------------

stack

{code}
Running org.apache.hadoop.fs.azure.integration.ITestAzureHugeFiles
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.123 sec - in org.apache.hadoop.fs.azure.integration.ITestFileSystemOperationExceptionMessage
Tests run: 6, Failures: 0, Errors: 5, Skipped: 0, Time elapsed: 3.842 sec <<< FAILURE! - in org.apache.hadoop.fs.azure.integration.ITestAzureHugeFiles
test_010_CreateHugeFile(org.apache.hadoop.fs.azure.integration.ITestAzureHugeFiles)  Time elapsed: 1.972 sec  <<< ERROR!
org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: The specified blob does not exist.
	at com.microsoft.azure.storage.StorageException.translateFromHttpStatus(StorageException.java:175)
	at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:94)
	at com.microsoft.azure.storage.core.StorageRequest.materializeException(StorageRequest.java:305)
	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:175)
	at com.microsoft.azure.storage.blob.CloudBlob.downloadAttributes(CloudBlob.java:1197)
	at org.apache.hadoop.fs.azure.StorageInterfaceImpl$CloudBlobWrapperImpl.downloadAttributes(StorageInterfaceImpl.java:321)
	at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.retrieveMetadata(AzureNativeFileSystemStore.java:1973)
	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.create(NativeAzureFileSystem.java:1748)
	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.create(NativeAzureFileSystem.java:1559)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1074)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1034)
	at org.apache.hadoop.fs.azure.integration.ITestAzureHugeFiles.test_010_CreateHugeFile(ITestAzureHugeFiles.java:209)
{code}


> wasb throws an exception if you try to create a file and there's no parent directory
> ------------------------------------------------------------------------------------
>
>                 Key: HADOOP-14583
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14583
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/azure
>    Affects Versions: 2.9.0
>            Reporter: Steve Loughran
>            Priority: Minor
>
> It's a known defect of the Hadoop FS API (and one we don't explicitly test for enough), but you can create a file on a path which doesn't exist. In that situation, the create() logic is expectd to create the entries.
> Wasb appears to raise an exception if you try to call {{create(filepath)}} without calling {{mkdirs(filepath.getParent()}} first. That's the semantics expected of {{createNonRecursive()}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org