You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Thomas Marqardt (Jira)" <ji...@apache.org> on 2020/06/24 13:15:00 UTC

[jira] [Created] (HADOOP-17089) WASB: Update azure-storage-java SDK

Thomas Marqardt created HADOOP-17089:
----------------------------------------

             Summary: WASB: Update azure-storage-java SDK
                 Key: HADOOP-17089
                 URL: https://issues.apache.org/jira/browse/HADOOP-17089
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs/azure
    Affects Versions: 3.2.0, 3.1.0, 3.0.0, 2.9.0, 2.8.0, 2.7.0
            Reporter: Thomas Marqardt
            Assignee: Thomas Marqardt


WASB depends on the Azure Storage Java SDK.  There is a concurrency bug in the Azure Storage Java SDK that can cause the results of a list blobs operation to appear empty.  This causes the Filesystem listStatus and similar APIs to return empty results.  This has been seen in Spark work loads when jobs use more than one executor core. 

See [https://github.com/Azure/azure-storage-java/pull/546] for details on the bug in the Azure Storage SDK.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org