You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "CapMoon (via GitHub)" <gi...@apache.org> on 2026/06/01 10:50:09 UTC
[PR] HDFS-17929. Revisit retrying mechanism in DFSStripedInputStream [hadoop]
CapMoon opened a new pull request, #8524:
URL: https://github.com/apache/hadoop/pull/8524
### Description of PR
DFSStripedInputStream#createBlockReader handles reader creation failures by re-fetching the block location, because the striped internal block may have moved. However, after re-fetching it unconditionally calls addToLocalDeadNodes().
There is also a related retry issue in DFSStripedInputStream#readWithStrategy. The method retries after an IOException, but the next blockSeekTo() can still use cached LocatedBlocks. Without refreshing open file information before retrying, the retry may reuse stale block locations and hit the same moved-block condition again.
### How was this patch tested?
Unit tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HDFS-17929. Revisit retrying mechanism in DFSStripedInputStream [hadoop]
Posted by "hfutatzhanghb (via GitHub)" <gi...@apache.org>.
hfutatzhanghb commented on PR #8524:
URL: https://github.com/apache/hadoop/pull/8524#issuecomment-4592508946
> @ZanderXu @hfutatzhanghb masters, can take a look at this mr when you are available
Thanks for reporting and involving me here. Will review this laterly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HDFS-17929. Revisit retrying mechanism in DFSStripedInputStream [hadoop]
Posted by "CapMoon (via GitHub)" <gi...@apache.org>.
CapMoon commented on PR #8524:
URL: https://github.com/apache/hadoop/pull/8524#issuecomment-4591878245
@ZanderXu @hfutatzhanghb masters, can take a look at this mr when you are available
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org