You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/10/08 01:06:00 UTC
[jira] [Work logged] (HADOOP-17301) ABFS: Fix bug introduced in
HADOOP-16852 which reports read-ahead error back
[ https://issues.apache.org/jira/browse/HADOOP-17301?focusedWorklogId=497030&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-497030 ]
ASF GitHub Bot logged work on HADOOP-17301:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 08/Oct/20 01:05
Start Date: 08/Oct/20 01:05
Worklog Time Spent: 10m
Work Description: snvijaya opened a new pull request #2369:
URL: https://github.com/apache/hadoop/pull/2369
When reads done by readahead buffers failed, the exceptions where dropped and the failure was not getting reported to the calling app.
Jira HADOOP-16852: Report read-ahead error back
tried to handle the scenario by reporting the error back to calling app. But the commit has introduced a bug which can lead to ReadBuffer being injected into read completed queue twice when it has finished the store operation.
Additionally, in a scenario where all readahead buffers are exhausted and the buffer chosen to evict is one which is failed read, there is no buffer returned for other reads to use. But successful eviction leads the queuing logic to determine there is a free buffer and while fetching the buffer index from free list, can lead to EmptyStack exceptions.
This PR fixes both these issues and also has added test checks for both scenarios.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 497030)
Remaining Estimate: 0h
Time Spent: 10m
> ABFS: Fix bug introduced in HADOOP-16852 which reports read-ahead error back
> ----------------------------------------------------------------------------
>
> Key: HADOOP-17301
> URL: https://issues.apache.org/jira/browse/HADOOP-17301
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.3.0
> Reporter: Sneha Vijayarajan
> Assignee: Sneha Vijayarajan
> Priority: Critical
> Time Spent: 10m
> Remaining Estimate: 0h
>
> When reads done by readahead buffers failed, the exceptions where dropped and the failure was not getting reported to the calling app.
> Jira HADOOP-16852: Report read-ahead error back
> tried to handle the scenario by reporting the error back to calling app. But the commit has introduced a bug which can lead to ReadBuffer being injected into read completed queue twice.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org