You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Gregory Chanan (Created) (JIRA)" <ji...@apache.org> on 2012/02/07 22:42:59 UTC
[jira] [Created] (HBASE-5346) Fix testColumnFamilyCompression and
test_TIMERANGE in TestHFileOutputFormat
Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
----------------------------------------------------------------------------
Key: HBASE-5346
URL: https://issues.apache.org/jira/browse/HBASE-5346
Project: HBase
Issue Type: Sub-task
Components: mapreduce, test
Affects Versions: 0.92.0, 0.90.4
Reporter: Gregory Chanan
Assignee: Gregory Chanan
Running
mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
Tests in error:
test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203039#comment-13203039 ]
Hadoop QA commented on HBASE-5346:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12513691/HBASE-5346-v0.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
-1 javadoc. The javadoc tool appears to have generated -136 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 156 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.io.hfile.TestHFileBlock
org.apache.hadoop.hbase.mapreduce.TestImportTsv
org.apache.hadoop.hbase.mapred.TestTableMapReduce
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/918//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/918//artifact/trunk/patchprocess/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/918//console
This message is automatically generated.
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "Gregory Chanan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204775#comment-13204775 ]
Gregory Chanan commented on HBASE-5346:
---------------------------------------
It looks like the tests testColumnFamilyCompression and test_TIMERANGE passed, if my reading of the results is correct.
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5346) Fix testColumnFamilyCompression and
test_TIMERANGE in TestHFileOutputFormat
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5346:
-------------------------
Resolution: Fixed
Fix Version/s: 0.94.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to TRUNK.
There are failures in TestHFileOutputFormat because of a patch submitted around this time but those fails seem independent of this patch (We need to dig in)
Thanks for the fix Gregory.
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Fix For: 0.94.0
>
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211136#comment-13211136 ]
Hudson commented on HBASE-5346:
-------------------------------
Integrated in HBase-TRUNK #2665 (See [https://builds.apache.org/job/HBase-TRUNK/2665/])
HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat (Revision 1245280)
Result = FAILURE
stack :
Files :
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat.java
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Fix For: 0.94.0, 0.92.0
>
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "Gregory Chanan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209952#comment-13209952 ]
Gregory Chanan commented on HBASE-5346:
---------------------------------------
Thanks!
Can we get this into 0.92 as well? Do I have to do anything to make that happen?
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Fix For: 0.94.0
>
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202986#comment-13202986 ]
stack commented on HBASE-5346:
------------------------------
Patch looks good to me. Let me submit the patch to see if it breaks when we run on 1.0.0 hadoop.
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5346) Fix testColumnFamilyCompression and
test_TIMERANGE in TestHFileOutputFormat
Posted by "Gregory Chanan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gregory Chanan updated HBASE-5346:
----------------------------------
Affects Version/s: (was: 0.90.4)
0.94.0
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "Gregory Chanan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209019#comment-13209019 ]
Gregory Chanan commented on HBASE-5346:
---------------------------------------
@stack:
Any comment on my previous message? It looks like this can be committed, but my reading of the results could be wrong.
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5346) Fix testColumnFamilyCompression and
test_TIMERANGE in TestHFileOutputFormat
Posted by "Gregory Chanan (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gregory Chanan updated HBASE-5346:
----------------------------------
Attachment: HBASE-5346-v0.patch
*Attached HBASE-5346-v0.patch*
This patch causes testColumnFamilyCompression and test_TIMERANGE to pass. (Note: this is equivalent to HBASE-5317-v0.patch -- I am moving the patch to address the subtask).
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5346) Fix testColumnFamilyCompression and
test_TIMERANGE in TestHFileOutputFormat
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5346:
-------------------------
Status: Patch Available (was: Open)
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.92.0, 0.90.4
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5346) Fix testColumnFamilyCompression
and test_TIMERANGE in TestHFileOutputFormat
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210074#comment-13210074 ]
Hudson commented on HBASE-5346:
-------------------------------
Integrated in HBase-TRUNK-security #113 (See [https://builds.apache.org/job/HBase-TRUNK-security/113/])
HBASE-5346 Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat (Revision 1245280)
Result = FAILURE
stack :
Files :
* /hbase/trunk/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHFileOutputFormat.java
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Fix For: 0.94.0
>
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5346) Fix testColumnFamilyCompression and
test_TIMERANGE in TestHFileOutputFormat
Posted by "stack (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-5346:
-------------------------
Fix Version/s: 0.92.0
Committed to 0.92 too...
> Fix testColumnFamilyCompression and test_TIMERANGE in TestHFileOutputFormat
> ----------------------------------------------------------------------------
>
> Key: HBASE-5346
> URL: https://issues.apache.org/jira/browse/HBASE-5346
> Project: HBase
> Issue Type: Sub-task
> Components: mapreduce, test
> Affects Versions: 0.94.0, 0.92.0
> Reporter: Gregory Chanan
> Assignee: Gregory Chanan
> Fix For: 0.94.0, 0.92.0
>
> Attachments: HBASE-5346-v0.patch
>
>
> Running
> mvn -Dhadoop.profile=23 test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
> yields this on 0.92 (for testColumnFamilyCompression and test_TIMERANGE):
> Failed tests: testColumnFamilyCompression(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): HFile for column family info-A not found
> Tests in error:
> test_TIMERANGE(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat): /home/gchanan/workspace/apache92/target/test-data/276cbd0c-c771-4f81-9ba8-c464c9dd7486/test_TIMERANGE_present/_temporary/0/_temporary/_attempt_200707121733_0001_m_000000_0 (Is a directory)
> The problem is that these tests make incorrect assumptions about the output of mapreduce jobs. Prior to 0.23, temporary data was in, for example:
> ./_temporary/_attempt__0000_r_000000_0/b/1979617994050536795
> Now that has changed. The correct way to get that path is based on getDefaultWorkFile.
> Also, the data is not moved into the outputPath until both the Task and Job are committed.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira