You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2008/09/16 14:12:44 UTC
[jira] Created: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Add setVerifyChecksum() method to FileSystem
--------------------------------------------
Key: HADOOP-4185
URL: https://issues.apache.org/jira/browse/HADOOP-4185
Project: Hadoop Core
Issue Type: Sub-task
Reporter: Tom White
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sharad Agarwal updated HADOOP-4185:
-----------------------------------
Attachment: 4185_v3.patch
included test case
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Fix For: 0.20.0
>
> Attachments: 4185_v1.patch, 4185_v2.patch, 4185_v3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sharad Agarwal reassigned HADOOP-4185:
--------------------------------------
Assignee: Sharad Agarwal
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647752#action_12647752 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
The patch looks good to me. Could we get a junit testcase?
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch, 4185_v2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sharad Agarwal updated HADOOP-4185:
-----------------------------------
Attachment: 4185_v1.patch
this patch:
adds setVerifyChecksum method to FileSystem, FilterFileSystem and ChecksumFileSystem.
Will appreciate if someone familiar with ChecksumFileSystem can review the changes.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647080#action_12647080 ]
Raghu Angadi commented on HADOOP-4185:
--------------------------------------
Regd the patch : Rather than overriding needChecksum(), verifyChecksum should be passed to FSInputChecker in ChecksumFSInputChecker. This avoids various issues ('sums' is checked for null in the implementation, for e.g.)
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647351#action_12647351 ]
Doug Cutting commented on HADOOP-4185:
--------------------------------------
> Does it make more sense if we make "verifyChecksum" as a a parameter to open [ ...]
It does make sense to be able to set this on a file-by-file basis, but I'm hesitant to add parameters, since the number of parameters could become unmanageable. Ideally open and create might take an 'options' parameter to pass things like blockSize, verifyData, bufferSize, replication, etc. What do you think of changing (in a separate issue) open and create to an options-style API?
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch, 4185_v2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646708#action_12646708 ]
Tom White commented on HADOOP-4185:
-----------------------------------
The motivation to add setVerifyChecksum to FileSystem is to break core's dependency on HDFS from FsShell by promoting the method from DistributedFileSystem to FileSystem. This change allows users using the shell to disable checksum verification for any filesystem, not just HDFS.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646842#action_12646842 ]
Sharad Agarwal commented on HADOOP-4185:
----------------------------------------
@Hairong Your solution will work with respect to ChecksumFileSystem as it exists in core. But the problem is with DistributedFileSystem. As Tom said that to break dependency of core on hdfs, we are promoting the setVerifyChecksum method from DistributedFileSystem to FileSystem. And once we choose to promote then ChecksumFileSystem should honor it.
Does the current patch make sense with respect to making ChecksumFileSystem honor setVerifyChecksum api ?
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648436#action_12648436 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
+1. The patch looks good to me.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Fix For: 0.20.0
>
> Attachments: 4185_v1.patch, 4185_v2.patch, 4185_v3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646963#action_12646963 ]
Doug Cutting commented on HADOOP-4185:
--------------------------------------
> clients cannot tell whether the fs supports checksum
We could have the method return a boolean.
/** @returns true if data verification is enabled. */
public boolean setVerifyData(boolean) { return false; }
But do clients actually care whether the fs supports verification? At this point the FsShell does not care. All that it requires is that one can say, "if you support checksums, disable them", which is what the current patch implements. If we someday in the future need to support such inquiries, then we can add support for that then. But right now, I don't see that that is needed.
I'm +1 for the patch as-is.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646689#action_12646689 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
Why do you need the method setVerifyChecksum? A ChecksumFileSystem wraps around a raw file system. If a user needs to read a file without verifying its checksum, the user could use the raw file system handle instead.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647136#action_12647136 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
I meant adding an open method that alllow the user to disable checksum verification to FileSystem.
public FSDataInputStream open(Path f, boolean verifyChecksum) throws IOException;
How does it sound?
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646725#action_12646725 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-4185:
------------------------------------------------
Instead of adding setVerifyChecksum(...) to FileSystem, how about putting it to a new interface, say Checksumable, so that DFS and other FS subclasses may implement it. Then, the codes in FsShell should be
{code}
if (srcFs instanceof Checksumable) {
((Checksumable)srcFs).setVerifyChecksum(verifyChecksum);
}
{code}
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646738#action_12646738 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-4185:
------------------------------------------------
I agree that we should avoid casting,
However, the current codes introduce a new empty method setVerifyChecksum(...) in FileSystem. Clients cannot tell whether calling this method is effective or not, i.e. clients cannot tell whether the fs supports checksum. In this design, we probably should add another method for telling whether the file system supports setVerifyChecksum(..).
BTW, the name setVerifyChecksum may be confusing. I suggest changing it to setVerifyData. File system may have mechanism other checksum for verifying data.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648542#action_12648542 ]
Sharad Agarwal commented on HADOOP-4185:
----------------------------------------
all core tests passed on my machine. Also ant test :
{code}
[exec] +1 overall.
[exec] +1 @author. The patch does not contain any @author tags.
[exec] +1 tests included. The patch appears to include 4 new or modified tests.
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
{code}
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Fix For: 0.20.0
>
> Attachments: 4185_v1.patch, 4185_v2.patch, 4185_v3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-4185:
--------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Sharad!
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Fix For: 0.20.0
>
> Attachments: 4185_v1.patch, 4185_v2.patch, 4185_v3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-4185:
------------------------------------
Component/s: fs
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647701#action_12647701 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
> What do you think of changing (in a separate issue) open and create to an options-style API?
This sounds like a great idea to me!
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch, 4185_v2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646998#action_12646998 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
Does it make more sense if we make "verifyChecksum" as a a parameter to open instead of setting it as an attribute to a file system? File system handles are cached. Setting "verifyChecksum" to be false may bring subtle side effect to later user of the file system handle.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sharad Agarwal updated HADOOP-4185:
-----------------------------------
Attachment: 4185_v2.patch
Incorporated Raghu's comment. Passing verifyChecksum to FSInputChecker
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch, 4185_v2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646750#action_12646750 ]
Hairong Kuang commented on HADOOP-4185:
---------------------------------------
Hadoop only supports two kinds of file systems that support checksum:
1. HDFS. We already have a way to bypass checksum verification in place.
2. ChecksumFileSystem: it wraps around a raw file system which has no idea of checksum. To bypass checksum verification, we could get a handle of the raw FS by calling ChecksumFileSystem.getRawFileSystem() and reading a file using the raw file system handle.
So we could add the following line to FsShell.getSrcFileSystem:
{code}
if (!verifyChecksum && srcFs instanceof ChecksumFileSystem) {
srcFs = ((ChecksumFileSystem)srcFs).getRawFileSystem();
}
{code}
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Sharad Agarwal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sharad Agarwal updated HADOOP-4185:
-----------------------------------
Fix Version/s: 0.20.0
Status: Patch Available (was: Open)
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Fix For: 0.20.0
>
> Attachments: 4185_v1.patch, 4185_v2.patch, 4185_v3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4185) Add setVerifyChecksum() method to
FileSystem
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646732#action_12646732 ]
Doug Cutting commented on HADOOP-4185:
--------------------------------------
> how about putting it to a new interface, say Checksumable
If any FileSystem might implement this interface then I don't see how this is functionally different than adding this to FileSystem.java. It just adds ugly code whenever you call setVerifyChecksum. Casting and 'instanceof' are indications of poor object modeling. Sometimes they're required, but we shouldn't use them except as a last resort.
> Add setVerifyChecksum() method to FileSystem
> --------------------------------------------
>
> Key: HADOOP-4185
> URL: https://issues.apache.org/jira/browse/HADOOP-4185
> Project: Hadoop Core
> Issue Type: Sub-task
> Components: fs
> Reporter: Tom White
> Assignee: Sharad Agarwal
> Attachments: 4185_v1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.