You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Zhihong Yu (JIRA)" <ji...@apache.org> on 2012/04/25 21:04:18 UTC
[jira] [Created] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Zhihong Yu created HBASE-5876:
---------------------------------
Summary: TestImportExport has been failing against hadoop 0.23 profile
Key: HBASE-5876
URL: https://issues.apache.org/jira/browse/HBASE-5876
Project: HBase
Issue Type: Bug
Reporter: Zhihong Yu
TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.94.1
0.96.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Thanks for reviews ted and stack. Committed to 0.94 and 0.96/trunk.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406709#comment-13406709 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
Its been a few days, I'm going to commit later today unless I hear anything suggesting not to.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Affects Version/s: 0.96.0
0.94.0
This test was introduced for HBase 0.94 in HBASE-4682 and seems to have never succeeded against 0.23 hadoop.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Attachment: hbase-5876-v2.patch
v2 of the trunk patch includes better comments about where some of the magic property strings come from.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Summary: TestImportExport has been failing against hadoop 0.23 profile (was: TestImportExport has been failing against hadoop 2.0/0.23 profile)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267310#comment-13267310 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
This is related to HBASE-5697 -- it has to do with some sort of inconsistencies with old mr properties (fs.default.name) and new mr properties (fs.defaultFs). When only using the new hadoop 23 properties, this test passes consistently.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268194#comment-13268194 ]
Hudson commented on HBASE-5876:
-------------------------------
Integrated in HBase-0.94 #178 (See [https://builds.apache.org/job/HBase-0.94/178/])
HBASE-5876 TestImportExport has been failing against hadoop 0.23 profile (Revision 1333777)
Result = SUCCESS
jmhsieh :
Files :
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269013#comment-13269013 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
Interesting, the old version of TestImportExport (before my previous attempt) used the LocalMRRunner instead of the RPC to the MiniMRCluster. TestImportTsv always uses the RPC/MiniMRCluster.
Use of the localmrrunner when miniMRcluster is spun up seems wrong. I'm going to force usage of the minimrcluster/rpc/runner in TestImportExport.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268037#comment-13268037 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
@Ted. Yes. If I actually use the constant the code will not compile under hadoop 1.x. I'll add to the comment about that before I commit.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268209#comment-13268209 ]
Hudson commented on HBASE-5876:
-------------------------------
Integrated in HBase-TRUNK #2847 (See [https://builds.apache.org/job/HBase-TRUNK/2847/])
HBASE-5876 TestImportExport has been failing against hadoop 0.23 profile (Revision 1333778)
Result = FAILURE
jmhsieh :
Files :
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/MapreduceTestingShim.java
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Zhihong Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267965#comment-13267965 ]
Zhihong Yu commented on HBASE-5876:
-----------------------------------
{code}
+ // o.a.h.mapreduce.lib.output FileOutputFormat.OUTDIR
+ return "mapreduce.output.fileoutputformat.outputdir";
{code}
Does the first line above note where the constant comes from ?
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265893#comment-13265893 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
The first problem is that when running under the hadoop23 some how the TestImportExport job uses the "local" mapreduce.framework.name which assumes and eventually tries to read from a LocalFileSystem. It should use the "yarn" mapreduce.framework.name which will read from the instantiated minimrcluster/minidfs cluster.
This gets past the job submission step but test still fails later on.
Work continues.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Attachment: hbase-5876-trunk-v3.patch
hbase-5876-94-v3.patch
Updated patches that have tests passing for 0.94 and trunk. (0.92 was good).
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Status: Open (was: Patch Available)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268908#comment-13268908 ]
Hudson commented on HBASE-5876:
-------------------------------
Integrated in HBase-TRUNK-security #192 (See [https://builds.apache.org/job/HBase-TRUNK-security/192/])
HBASE-5876 TestImportExport has been failing against hadoop 0.23 profile (Revision 1333778)
Result = SUCCESS
jmhsieh :
Files :
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/MapreduceTestingShim.java
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Status: Patch Available (was: Reopened)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "ramkrishna.s.vasudevan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406455#comment-13406455 ]
ramkrishna.s.vasudevan commented on HBASE-5876:
-----------------------------------------------
I tried running the patch for 0.94 on hadoop 2.0. It passed(but not much aware of the changes). :)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh reopened HBASE-5876:
-----------------------------------
Ted noticed that the test is still failing. Reopening and reinvestigating.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268098#comment-13268098 ]
Hadoop QA commented on HBASE-5876:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12525558/hbase-5876-94.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 hadoop23. The patch compiles against the hadoop 0.23.x profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks
org.apache.hadoop.hbase.master.TestAssignmentManager
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1761//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1761//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1761//console
This message is automatically generated.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl closed HBASE-5876.
--------------------------------
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.94.1, 0.96.0
>
> Attachments: hbase-5876-94.patch, hbase-5876-94-v3.patch, hbase-5876.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404622#comment-13404622 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
I believe this is still broken -- and I haven't gotten back to fixing it. I believe the export part of the test wrote to either hdfs/localfs and then the re-import part tried to read from the other, causing the test to fail. IIRC something happened with the mini mr dirs between 0.92 and 0.94 which broke the test.
I'll give it another stab, and I don't get it done this weekend I'll revert it.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Status: Patch Available (was: Open)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh reassigned HBASE-5876:
-------------------------------------
Assignee: Jonathan Hsieh (was: Uma Maheswara Rao G)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264212#comment-13264212 ]
Ted Yu commented on HBASE-5876:
-------------------------------
>From https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-23/156/testReport/org.apache.hadoop.hbase.mapreduce/TestImportTsv/testMROnTableWithCustomMapper/:
{code}
2012-04-27 00:47:47,745 ERROR [pool-1-thread-1] service.CompositeService(72): Error starting services org.apache.hadoop.mapred.MiniMRCluster
org.apache.hadoop.yarn.YarnException: java.io.IOException: ResourceManager failed to start. Final state is INITED
at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.start(MiniYARNCluster.java:152)
at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at org.apache.hadoop.mapred.MiniMRClientClusterFactory.create(MiniMRClientClusterFactory.java:67)
at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:180)
at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:170)
at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:162)
at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:154)
at org.apache.hadoop.mapred.MiniMRCluster.<init>(MiniMRCluster.java:147)
{code}
>From https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-23/156/testReport/org.apache.hadoop.hbase.mapreduce/TestImportExport/testWithDeletes/:
{code}
java.io.FileNotFoundException: File does not exist: /home/hudson/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/0.23.2-SNAPSHOT/hadoop-mapreduce-client-core-0.23.2-SNAPSHOT.jar
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:729)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:208)
at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:71)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:246)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:284)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:355)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1221)
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1218)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1218)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1239)
at org.apache.hadoop.hbase.mapreduce.TestImportExport.testWithDeletes(TestImportExport.java:181)
{code}
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (HBASE-5876) TestImportExport has
been failing against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269013#comment-13269013 ]
Jonathan Hsieh edited comment on HBASE-5876 at 5/5/12 5:12 PM:
---------------------------------------------------------------
Interesting, the old version of TestImportExport against hadoop 1.0 (before my previous attempt) used the LocalMRRunner instead of the RPC to the MiniMRCluster. TestImportTsv always uses the RPC/MiniMRCluster.
Use of the localmrrunner when miniMRcluster is spun up seems wrong. I'm going to force usage of the minimrcluster/rpc/runner in TestImportExport.
was (Author: jmhsieh):
Interesting, the old version of TestImportExport (before my previous attempt) used the LocalMRRunner instead of the RPC to the MiniMRCluster. TestImportTsv always uses the RPC/MiniMRCluster.
Use of the localmrrunner when miniMRcluster is spun up seems wrong. I'm going to force usage of the minimrcluster/rpc/runner in TestImportExport.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Zhihong Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268773#comment-13268773 ]
Zhihong Yu commented on HBASE-5876:
-----------------------------------
Strange, I saw this after the fix went in:
https://builds.apache.org/view/G-L/view/HBase/job/HBase-TRUNK-on-Hadoop-23/167/testReport/junit/org.apache.hadoop.hbase.mapreduce/TestImportExport/testSimpleCase/
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406878#comment-13406878 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
Since its been along time since other parts of this code was committed, I'm going to complete this as HBASE-6330, and close this one out.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262006#comment-13262006 ]
Uma Maheswara Rao G commented on HBASE-5876:
--------------------------------------------
{quote}
2012-04-26 01:23:47,790 ERROR [main] common.Util(58): Syntax error in URI E:\Repoitories\Hbase\target\test-data\79fa72c8-f019-4c29-be3d-cc67230f70cd\dfscluster_177a4b0f-5ebc-4dfc-9d89-867fefec2c6a\dfs\name2. Please check hdfs configuration.
java.net.URISyntaxException: Illegal character in opaque part at index 2: E:\Repoitories\Hbase\target\test-data\79fa72c8-f019-4c29-be3d-cc67230f70cd\dfscluster_177a4b0f-5ebc-4dfc-9d89-867fefec2c6a\dfs\name2
at java.net.URI$Parser.fail(Unknown Source)
at java.net.URI$Parser.checkChars(Unknown Source)
at java.net.URI$Parser.parse(Unknown Source)
at java.net.URI.<init>(Unknown Source)
at org.apache.hadoop.hdfs.server.common.Util.stringAsURI(Util.java:56)
at org.apache.hadoop.hdfs.server.common.Util.stringCollectionAsURIs(Util.java:106)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getStorageDirs(FSNamesystem.java:761)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNamespaceEditsDirs(FSNamesystem.java:806)
{quote}
URI creation is failing with passed directory here. Let me take a look.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Uma Maheswara Rao G
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Attachment: (was: hbase-5876-94.patch)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268006#comment-13268006 ]
stack commented on HBASE-5876:
------------------------------
+1 on patch
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Zhihong Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262024#comment-13262024 ]
Zhihong Yu commented on HBASE-5876:
-----------------------------------
I face different issue on Macbook. See:
https://issues.apache.org/jira/browse/HBASE-5870?focusedCommentId=13261773&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13261773
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Uma Maheswara Rao G
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267984#comment-13267984 ]
Hadoop QA commented on HBASE-5876:
----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12525533/hbase-5876.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 hadoop23. The patch compiles against the hadoop 0.23.x profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1757//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1757//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1757//console
This message is automatically generated.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268079#comment-13268079 ]
Hadoop QA commented on HBASE-5876:
----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12525556/hbase-5876-v2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 hadoop23. The patch compiles against the hadoop 0.23.x profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/1760//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/1760//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1760//console
This message is automatically generated.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Status: Patch Available (was: Open)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 2.0/0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Summary: TestImportExport has been failing against hadoop 2.0/0.23 profile (was: TestImportExport has been failing against hadoop 0.23 profile)
> TestImportExport has been failing against hadoop 2.0/0.23 profile
> -----------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94-v3.patch, hbase-5876-94.patch, hbase-5876-trunk-v3.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267513#comment-13267513 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
Problems in previous code:
# yarn execution framework not used because HBaseTestingUtility.startMiniCluster().getConfiguration() used instead of the HBaseTestingUtility.getConfiguration().
# hadoop 1's mapred.output.dir and hadoop 2's fileoutputformat.outputdir caused export job's data to get lost.
Currently running full builds against hadoop 1.0 and hadoop 0.23.x.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263875#comment-13263875 ]
Uma Maheswara Rao G commented on HBASE-5876:
--------------------------------------------
Thanks a lot, Jon for signing up this. Actually I thought to take a look on this weekend. Unfortunately I may not be able to look on this weekend as came out of station. Thanks for taking this:-)
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Attachment: hbase-5876.patch
This works against hadoop 1 and hadoop 23, but isn't pretty (manual selection of yarn).
Other tests use the configuration from HBaseTestingUtility instead of the conf associated with the MiniCluster.
I spent a bit of time trying to fold this in to use HBaseTestingUtlity but it seems to be have problems with the mapred.local.dir and mapred.job.tracker.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Attachment: hbase-5876-94.patch
Uploaded correct 0.94 version of the patch. This patch didn't need to JobConf stuff -- makes me thing that the trunk one could be simplified and that another patch forced it to be more complicated.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405184#comment-13405184 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
An update: I have a patch that works with both 0.94 (default 1.0.x and -Dhadoop.profile=23) and trunk (default 1.0.x and -Dhadoop.profile=2.0) but reopens the problem of having *partition* dirs in the project root directory instead of the target dir.
I'm looking into fixing that problem now -- I believe it is hadoop.tmp.dir and using oozie's minicluster setup as an examplar
https://github.com/apache/oozie/blob/trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java#L656
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268833#comment-13268833 ]
Hudson commented on HBASE-5876:
-------------------------------
Integrated in HBase-0.94-security #26 (See [https://builds.apache.org/job/HBase-0.94-security/26/])
HBASE-5876 TestImportExport has been failing against hadoop 0.23 profile (Revision 1333777)
Result = SUCCESS
jmhsieh :
Files :
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262020#comment-13262020 ]
Uma Maheswara Rao G commented on HBASE-5876:
--------------------------------------------
@Ted, is it the same issue you are facing?
This failure is on my windows box. Actually problem due to backward slash in windows i think. Simple URI creation also fails with the same reason. Once I changed it to forward slash '/' , it started working.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Uma Maheswara Rao G
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5876:
----------------------------------
Attachment: hbase-5876-94.patch
0.94 branch (around rc3 time frame) compiles but has failing TestImportExport unit test against hadoop 23. This patch for 0.94 fixes that.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
> Attachments: hbase-5876-94.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uma Maheswara Rao G reassigned HBASE-5876:
------------------------------------------
Assignee: Uma Maheswara Rao G
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Uma Maheswara Rao G
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404557#comment-13404557 ]
Lars Hofhansl commented on HBASE-5876:
--------------------------------------
Change for this issue were committed to both 0.96 and 0.94. Is this fixed, or should we close this issue?
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.0, 0.96.0
> Reporter: Zhihong Ted Yu
> Assignee: Jonathan Hsieh
> Fix For: 0.96.0, 0.94.1
>
> Attachments: hbase-5876-94.patch, hbase-5876-v2.patch, hbase-5876.patch
>
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5876) TestImportExport has been failing
against hadoop 0.23 profile
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264138#comment-13264138 ]
Jonathan Hsieh commented on HBASE-5876:
---------------------------------------
I started going down the path and chatting with alejandro -- one of the guys involved with MAPREDUCE-3169 (new MiniMRCluster for 23). It is likely a problem with job submission and will take a little digging.
> TestImportExport has been failing against hadoop 0.23 profile
> -------------------------------------------------------------
>
> Key: HBASE-5876
> URL: https://issues.apache.org/jira/browse/HBASE-5876
> Project: HBase
> Issue Type: Bug
> Reporter: Zhihong Yu
> Assignee: Jonathan Hsieh
>
> TestImportExport has been failing against hadoop 0.23 profile
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira