[jira] Updated: (HADOOP-3750) Fix and enforce module dependencies

["Tom White (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HADOOP-3750:
------------------------------

    Attachment: hadoop-3750.patch

Here's a patch which fixes the easier inter-module dependencies. There are a few left which require a bit more effort/discussion:

h4. Core
* FsShell depends on DistributedFileSystem to call setVerifyChecksum on it. Should we add setVerifyChecksum to FileSystem? If so we need to make ChecksumFileSystem honour it.
* HarFileSystem uses LineRecordReader to read lines. Replace with own line-reading code.
* ReflectionUtils depends on JobConf and JobConfigurable to set config. Not sure what to do here. Have a MapRed ReflectionUtils that does this extra configuration?

h4. HDFS
* DataNode, FSNamesystem, SecondaryNameNode all depends on StatusHttpServer which is in mapred. Split out common part and put in core.

h4. MapRed
* Task depends on DistributedFileSystem to update statistics for all known filesystems. Should we get this from the FileSystem cache?

> Fix and enforce module dependencies
> -----------------------------------
>
>                 Key: HADOOP-3750
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3750
>             Project: Hadoop Core
>          Issue Type: Improvement
>            Reporter: Tom White
>             Fix For: 0.19.0
>
>         Attachments: hadoop-3750.patch
>
>
> Since HADOOP-2916 Hadoop Core consists of modules in independent source trees: core, hdfs, mapred (and others). The dependencies between them should be enforced to avoid cyclic dependencies. At present they all have dependencies on each other.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.