You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Konstantin Shvachko (Jira)" <ji...@apache.org> on 2021/11/17 01:54:00 UTC
[jira] [Updated] (HADOOP-17999) No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HADOOP-17999:
-----------------------------------------
Summary: No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem (was: ViewFileSystem.setVerifyChecksum should not initialize all target filesystems)
> No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem
> --------------------------------------------------------------------------------
>
> Key: HADOOP-17999
> URL: https://issues.apache.org/jira/browse/HADOOP-17999
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Abhishek Das
> Assignee: Abhishek Das
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Currently setVerifyChecksum and setWriteChecksum initializes all target file systems which causes delay in hadoop shell copy commands such as get, put, copyFromLocal etc.
> This also eventually causes OOM.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org