You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bhallamudi Venkata Siva Kamesh (Created) (JIRA)" <ji...@apache.org> on 2012/03/13 14:33:39 UTC
[jira] [Created] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
MultiFileWordCount job fails if the input path is not from default file system
------------------------------------------------------------------------------
Key: MAPREDUCE-4002
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: examples
Affects Versions: 0.24.0, 0.23.3
Reporter: Bhallamudi Venkata Siva Kamesh
In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
{noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279702#comment-13279702 ]
Hudson commented on MAPREDUCE-4002:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2290 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2290/])
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1340630)
Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1340630
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reassigned MAPREDUCE-4002:
--------------------------------------
Assignee: Bhallamudi Venkata Siva Kamesh
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Ahmed Radwan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263155#comment-13263155 ]
Ahmed Radwan commented on MAPREDUCE-4002:
-----------------------------------------
+1, change lgtm. Thanks!
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279764#comment-13279764 ]
Hudson commented on MAPREDUCE-4002:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1085 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1085/])
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1340630)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1340630
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228857#comment-13228857 ]
Hadoop QA commented on MAPREDUCE-4002:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12518184/MAPREDUCE-4002.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2046//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2046//console
This message is automatically generated.
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated MAPREDUCE-4002:
-----------------------------------
Resolution: Fixed
Fix Version/s: 2.0.1
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to branch-2 and trunk. Thanks, Bhallamudi.
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279728#comment-13279728 ]
Hudson commented on MAPREDUCE-4002:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1051 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1051/])
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1340630)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1340630
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Bhallamudi Venkata Siva Kamesh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279957#comment-13279957 ]
Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-4002:
-----------------------------------------------------------
Thanks Todd.
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279691#comment-13279691 ]
Hudson commented on MAPREDUCE-4002:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2345 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2345/])
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1340630)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1340630
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4002:
------------------------------------------------------
Status: Patch Available (was: Open)
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-4002.
------------------------------------
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.2-alpha
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279690#comment-13279690 ]
Hudson commented on MAPREDUCE-4002:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2272 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2272/])
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. (Revision 1340630)
Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1340630
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Assignee: Bhallamudi Venkata Siva Kamesh
> Fix For: 2.0.1
>
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228904#comment-13228904 ]
Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-4002:
-----------------------------------------------------------
As this is an examples related patch, I *think* testcase is not required. Please review it.
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4002) MultiFileWordCount job fails if
the input path is not from default file system
Posted by "Bhallamudi Venkata Siva Kamesh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bhallamudi Venkata Siva Kamesh updated MAPREDUCE-4002:
------------------------------------------------------
Attachment: MAPREDUCE-4002.patch
Attaching a patch, which gets path specific file system
> MultiFileWordCount job fails if the input path is not from default file system
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4002
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Affects Versions: 0.24.0, 0.23.3
> Reporter: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-4002.patch
>
>
> In the MultiFileWordCount#CombineFileLineRecordReader, filesystem object has been initialized in the following way
> {noformat}fs = FileSystem.get(context.getConfiguration());{noformat}
> This causes, *fs* to be initialized with default filesystem. Therefore *fs* searchs for the input files on the default file system, which fails if the input path is from different source.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira