[jira] [Commented] (TAJO-983) Worker should directly read Intermediate data stored in localhost rather than fetching

["Tajo QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TAJO-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121161#comment-14121161 ] 

Tajo QA commented on TAJO-983:
------------------------------

{color:red}*-1 overall.*{color}  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12666435/TAJO-983.140904.patch
  against master revision 0e43627.

    {color:green}+1 @author.{color}  The patch does not contain any @author tags.

    {color:green}+1 tests included.{color}  The patch appears to include 1 new or modified test files.

    {color:green}+1 javac.{color}  The applied patch does not increase the total number of javac compiler warnings.

    {color:green}+1 javadoc.{color}  The applied patch does not increase the total number of javadoc warnings.

    {color:green}+1 checkstyle.{color}  The patch generated 0 code style errors.

    {color:red}-1 findbugs.{color}  The patch appears to introduce 222 new Findbugs (version 2.0.3) warnings.

    {color:red}-1 release audit.{color}  The applied patch generated 101 release audit warnings.

    {color:green}+1 core tests.{color}  The patch passed unit tests in tajo-core tajo-yarn-pullserver.

Test results: https://builds.apache.org/job/PreCommit-TAJO-Build/484//testReport/
Release audit warnings: https://builds.apache.org/job/PreCommit-TAJO-Build/484//artifact/incubator-tajo/patchprocess/patchReleaseAuditProblems.txt
Findbugs warnings: https://builds.apache.org/job/PreCommit-TAJO-Build/484//artifact/incubator-tajo/patchprocess/newPatchFindbugsWarningstajo-core.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-TAJO-Build/484//artifact/incubator-tajo/patchprocess/newPatchFindbugsWarningstajo-yarn-pullserver.html
Console output: https://builds.apache.org/job/PreCommit-TAJO-Build/484//console

This message is automatically generated.

> Worker should directly read Intermediate data stored in localhost rather than fetching
> --------------------------------------------------------------------------------------
>
>                 Key: TAJO-983
>                 URL: https://issues.apache.org/jira/browse/TAJO-983
>             Project: Tajo
>          Issue Type: Bug
>          Components: data shuffle
>            Reporter: Hyunsik Choi
>            Assignee: Mai Hai Thanh
>         Attachments: TAJO-983.140820.0.patch.txt, TAJO-983.140822.patch.txt, TAJO-983.140825.1.patch.txt, TAJO-983.140902.patch, TAJO-983.140904.patch
>
>
> Currently, worker always fetches all intermediate via Fetcher and than store them in local file system even though some intermediate data already are  stored in local file system. It is inefficient and causes unnecessary I/O and extra storage occupation. We should improve it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)