You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Aaron T. Myers (Created) (JIRA)" <ji...@apache.org> on 2012/04/07 02:17:19 UTC
[jira] [Created] (HADOOP-8261) Har file system doesn't deal with FS
URIs with a host but no port
Har file system doesn't deal with FS URIs with a host but no port
-----------------------------------------------------------------
Key: HADOOP-8261
URL: https://issues.apache.org/jira/browse/HADOOP-8261
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 2.0.0
Reporter: Aaron T. Myers
Assignee: Aaron T. Myers
If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
{noformat}
java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8261) Har file system doesn't deal with FS
URIs with a host but no port
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8261:
-----------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I've just committed this to trunk and branch-2. Thanks again for the review, Todd.
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249692#comment-13249692 ]
Hadoop QA commented on HADOOP-8261:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12521910/HADOOP-8261.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.fs.viewfs.TestViewFsTrash
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/839//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/839//console
This message is automatically generated.
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8261) Har file system doesn't deal with FS
URIs with a host but no port
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8261:
-----------------------------------
Attachment: HADOOP-8261-with-test-in-HDFS.patch
Here's the complete patch, including cross-project test in HDFS.
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249663#comment-13249663 ]
Todd Lipcon commented on HADOOP-8261:
-------------------------------------
Nit: spurious 'a' here at the end of the sentence
{code}
+ * port specified, as is often the case with an HA setup.a
{code}
Another nit: I think the test case should be capitalized "WithHA" instead of "WithHa" to match our other test cases which all have the keyword "HA" in them (makes it easy to run mvn test '-Dtest=*HA*')
+1 once you fix these
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249693#comment-13249693 ]
Hudson commented on HADOOP-8261:
--------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2103 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2103/])
HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. (Revision 1311133)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311133
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHarFileSystemWithHA.java
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249698#comment-13249698 ]
Hudson commented on HADOOP-8261:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2039 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2039/])
HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. (Revision 1311133)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311133
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHarFileSystemWithHA.java
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8261) Har file system doesn't deal with FS
URIs with a host but no port
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8261:
-----------------------------------
Attachment: HADOOP-8261.patch
Here's a patch which addresses the issue.
I've written a test for this fix, but the test was easiest written in the HDFS project. I'm going to upload another patch in a moment which is the complete change, but uploading just the fix in Common here so that test-patch can run.
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249694#comment-13249694 ]
Hudson commented on HADOOP-8261:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #2028 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2028/])
HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. (Revision 1311133)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311133
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHarFileSystemWithHA.java
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249825#comment-13249825 ]
Hudson commented on HADOOP-8261:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk #1044 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1044/])
HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. (Revision 1311133)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311133
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHarFileSystemWithHA.java
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249806#comment-13249806 ]
Hudson commented on HADOOP-8261:
--------------------------------
Integrated in Hadoop-Hdfs-trunk #1009 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1009/])
HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. (Revision 1311133)
Result = FAILURE
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1311133
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHarFileSystemWithHA.java
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Fix For: 2.0.0
>
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8261) Har file system doesn't deal with
FS URIs with a host but no port
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249197#comment-13249197 ]
Hadoop QA commented on HADOOP-8261:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12521807/HADOOP-8261-with-test-in-HDFS.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/836//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/836//console
This message is automatically generated.
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8261) Har file system doesn't deal with FS
URIs with a host but no port
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8261:
-----------------------------------
Status: Patch Available (was: Open)
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-8261) Har file system doesn't deal with FS
URIs with a host but no port
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HADOOP-8261:
-----------------------------------
Attachment: HADOOP-8261.patch
Thanks a lot for the review, Todd. Here's an updated patch which addresses your feedback. I'm going to commit this momentarily.
> Har file system doesn't deal with FS URIs with a host but no port
> -----------------------------------------------------------------
>
> Key: HADOOP-8261
> URL: https://issues.apache.org/jira/browse/HADOOP-8261
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 2.0.0
> Reporter: Aaron T. Myers
> Assignee: Aaron T. Myers
> Attachments: HADOOP-8261-with-test-in-HDFS.patch, HADOOP-8261.patch, HADOOP-8261.patch
>
>
> If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:
> {noformat}
> java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira