[jira] Commented: (HADOOP-7178) copyToLocal API is creating .crc files in local, even after setting verifyChecksum to false at client side.

["Uma Maheswara Rao G (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005685#comment-13005685 ] 

Uma Maheswara Rao G commented on HADOOP-7178:
---------------------------------------------

FileSystem already has the API setVerifyChecksum. As per current implementation this flag will be set in DistributedFilesystem.Based on this flag, checksum verification will happen. Bydefault LocalFileSystem will be selected as  local file system . But LocalFileSystem will create crc files in local disk in all the cases because it is CheckSumFileSystem.
But when user explicitly set the verifyCheckSum flag to false, then LocalFileSystem will create the crc files in local disk.
 
One Option to solve this issue is:
        We can provide an API in FileSystem which will be the getter method(getVerifyChecksum) for setVerifyChecksum. DistributedFileSystem can override this method.

In Filesystem’s copyToLocalFile API, we can use this flag status.
If this flag is disabled, then we can select RawLocalFileSystem as local file system. This RawLocalFileSystem will not create any of the CRC files.


> copyToLocal API is creating .crc files in local, even after setting verifyChecksum to false at client side.
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7178
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7178
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>
> When we copy the files from DFS to local, it is creating the .crc file in local filesystem for the verification of checksum even if we disable the checksum verification at client side.
>         When user does not want to do any checksum verification, then what will be the use in creating of these files in local file system.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira