[jira] [Created] (HADOOP-18521) ABFS ReadBufferManager buffer sharing across concurrent HTTP requests

["Steve Loughran (Jira)" <ji...@apache.org>]

Steve Loughran created HADOOP-18521:
---------------------------------------

             Summary: ABFS ReadBufferManager buffer sharing across concurrent HTTP requests
                 Key: HADOOP-18521
                 URL: https://issues.apache.org/jira/browse/HADOOP-18521
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs/azure
    Affects Versions: 3.3.4, 3.3.3, 3.3.2
            Reporter: Steve Loughran
            Assignee: Steve Loughran



AbfsInputStream.close() can trigger the return of buffers used for active prefetch GET requests into the ReadBufferManager free buffer pool.

A subsequent prefetch by a different stream in the same process may acquire this same buffer. This can lead to risk of corruption of its own prefetched data, data which may then be returned to that other thread.

On releases without the fix for this (3.3.2 to 3.3.4), the bug can be avoided by disabling all prefetching 

{code}
fs.azure.readaheadqueue.depth
{code}




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org