You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Ted Yu (JIRA)" <ji...@apache.org> on 2010/11/23 22:58:13 UTC
[jira] Created: (HBASE-3271) Allow .META. table to be exported
Allow .META. table to be exported
---------------------------------
Key: HBASE-3271
URL: https://issues.apache.org/jira/browse/HBASE-3271
Project: HBase
Issue Type: Improvement
Components: util
Affects Versions: 0.20.6
Reporter: Ted Yu
I tried to export .META. table in 0.20.6 and got:
[hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
...
10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
Exception in thread "main" java.io.IOException: Expecting at least one region.
at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
Related code is:
if (keys == null || keys.getFirst() == null ||
keys.getFirst().length == 0) {
throw new IOException("Expecting at least one region.");
}
My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-3271) Allow .META. table to be exported
Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12935184#action_12935184 ]
Ted Yu commented on HBASE-3271:
-------------------------------
I used this code:
if (keys == null || keys.getFirst() == null ||
keys.getFirst().length == 0) {
HRegionLocation regLoc = table.getRegionLocation(HConstants.EMPTY_BYTE_ARRAY);
if (null == regLoc)
throw new IOException("Expecting at least one region.");
List<InputSplit> splits = new ArrayList<InputSplit>(1);
InputSplit split = new TableSplit(table.getTableName(),
HConstants.EMPTY_BYTE_ARRAY, HConstants.EMPTY_BYTE_ARRAY,
regLoc.getServerAddress().getHostname());
splits.add(split);
return splits;
}
The following command only exports rows in .META. which have 'packageindex' (refer to HBASE-3255):
bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0 packageindex
-rwxrwxrwx 1 hadoop users 90700 Nov 24 03:31 h-meta/part-m-00000
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "liang xie (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439295#comment-13439295 ]
liang xie commented on HBASE-3271:
----------------------------------
I tested as following steps:
1) ran new test case : mvn test -P localTests -Dtest=org.apache.hadoop.hbase.mapreduce.TestImportExport
Failed as expected:
Running org.apache.hadoop.hbase.mapreduce.TestImportExport
2012-08-22 13:18:03.351 java[2329:1903] Unable to load realm info from SCDynamicStore
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 124.011 sec <<< FAILURE!
Results :
Tests in error:
testMetaExport(org.apache.hadoop.hbase.mapreduce.TestImportExport): Expecting at least one region.
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0
2) After applied patch, the test case passed as expected
3) Finally, i verified sucessfully at a real cluster manually as well
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "liang xie (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439297#comment-13439297 ]
liang xie commented on HBASE-3271:
----------------------------------
@Stack @Ted or some other guys, could you kindly help to review? thanks in advance:)
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440779#comment-13440779 ]
Hudson commented on HBASE-3271:
-------------------------------
Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #144 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/144/])
HBASE-3271 Allow .META. table to be exported (Liang Xie) (Revision 1376487)
Result = FAILURE
Tedyu :
Files :
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (HBASE-3271) Allow .META. table to be
exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12935184#comment-12935184 ]
Zhihong Ted Yu edited comment on HBASE-3271 at 6/4/12 11:32 PM:
----------------------------------------------------------------
I used this code:
{code}
if (keys == null || keys.getFirst() == null ||
keys.getFirst().length == 0) {
HRegionLocation regLoc = table.getRegionLocation(HConstants.EMPTY_BYTE_ARRAY);
if (null == regLoc)
throw new IOException("Expecting at least one region.");
List<InputSplit> splits = new ArrayList<InputSplit>(1);
InputSplit split = new TableSplit(table.getTableName(),
HConstants.EMPTY_BYTE_ARRAY, HConstants.EMPTY_BYTE_ARRAY,
regLoc.getServerAddress().getHostname());
splits.add(split);
return splits;
}
{code}
The following command only exports rows in .META. which have 'packageindex' (refer to HBASE-3255):
bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0 packageindex
-rwxrwxrwx 1 hadoop users 90700 Nov 24 03:31 h-meta/part-m-00000
was (Author: yuzhihong@gmail.com):
I used this code:
if (keys == null || keys.getFirst() == null ||
keys.getFirst().length == 0) {
HRegionLocation regLoc = table.getRegionLocation(HConstants.EMPTY_BYTE_ARRAY);
if (null == regLoc)
throw new IOException("Expecting at least one region.");
List<InputSplit> splits = new ArrayList<InputSplit>(1);
InputSplit split = new TableSplit(table.getTableName(),
HConstants.EMPTY_BYTE_ARRAY, HConstants.EMPTY_BYTE_ARRAY,
regLoc.getServerAddress().getHostname());
splits.add(split);
return splits;
}
The following command only exports rows in .META. which have 'packageindex' (refer to HBASE-3255):
bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0 packageindex
-rwxrwxrwx 1 hadoop users 90700 Nov 24 03:31 h-meta/part-m-00000
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448308#comment-13448308 ]
Hudson commented on HBASE-3271:
-------------------------------
Integrated in HBase-0.94-security-on-Hadoop-23 #7 (See [https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/7/])
HBASE-3271 Allow .META. table to be exported (Liang Xie) (Revision 1376807)
Result = FAILURE
Tedyu :
Files :
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Assignee: liang xie
> Fix For: 0.96.0, 0.94.2
>
> Attachments: 3271.94, HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440897#comment-13440897 ]
Hudson commented on HBASE-3271:
-------------------------------
Integrated in HBase-0.94 #425 (See [https://builds.apache.org/job/HBase-0.94/425/])
HBASE-3271 Allow .META. table to be exported (Liang Xie) (Revision 1376807)
Result = FAILURE
Tedyu :
Files :
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0, 0.94.2
>
> Attachments: 3271.94, HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "liang xie (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440045#comment-13440045 ]
liang xie commented on HBASE-3271:
----------------------------------
@Ted, what should i do for "QA run was aborted" ? or could you kindly just kick another QA run instead?
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440105#comment-13440105 ]
Hadoop QA commented on HBASE-3271:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12542086/HBASE-3271-v2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).
-1 findbugs. The patch appears to introduce 7 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.io.encoding.TestUpgradeFromHFileV1ToEncoding
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2657//console
This message is automatically generated.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440051#comment-13440051 ]
Zhihong Ted Yu commented on HBASE-3271:
---------------------------------------
Please address my comment @ 22/Aug/12 18:03 and attach new patch.
Thanks
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439744#comment-13439744 ]
Zhihong Ted Yu commented on HBASE-3271:
---------------------------------------
According to https://builds.apache.org/job/PreCommit-HBASE-Build/2649/console, QA run was aborted.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3271) Allow .META. table to be exported
Posted by "liang xie (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liang xie updated HBASE-3271:
-----------------------------
Attachment: HBASE-3271-v2.patch
Modified per Ted's comments
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Ted Yu updated HBASE-3271:
----------------------------------
Attachment: 3271.94
Patch for 0.94 branch.
TestImportExport passes.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: 3271.94, HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Ted Yu updated HBASE-3271:
----------------------------------
Fix Version/s: 0.96.0
Hadoop Flags: Reviewed
Status: Patch Available (was: Open)
nit: the following line is too long:
{code}
+ InputSplit split = new TableSplit(table.getTableName(), HConstants.EMPTY_BYTE_ARRAY, HConstants.EMPTY_BYTE_ARRAY,
{code}
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Ted Yu updated HBASE-3271:
----------------------------------
Status: Open (was: Patch Available)
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440289#comment-13440289 ]
Zhihong Ted Yu commented on HBASE-3271:
---------------------------------------
{code}
Running org.apache.hadoop.hbase.mapreduce.TestImportExport
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.517 sec
{code}
Failed test is not related to this patch.
Patch integrated to trunk.
Thanks for the patch, Liang.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439305#comment-13439305 ]
stack commented on HBASE-3271:
------------------------------
Patch looks fine to me. Will integrate in next day or so unless objection.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3271) Allow .META. table to be exported
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12935190#action_12935190 ]
stack commented on HBASE-3271:
------------------------------
Any chance of your making the code above into a patch and attaching it to this issue so we can review it Ted? (This might be of help: http://www.apache.org/dev/contributors.html#patches). Thanks.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Commented] (HBASE-3271) Allow .META. table to be exported
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440355#comment-13440355 ]
Hudson commented on HBASE-3271:
-------------------------------
Integrated in HBase-TRUNK #3257 (See [https://builds.apache.org/job/HBase-TRUNK/3257/])
HBASE-3271 Allow .META. table to be exported (Liang Xie) (Revision 1376487)
Result = SUCCESS
Tedyu :
Files :
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (HBASE-3271) Allow .META. table to be
exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439684#comment-13439684 ]
Zhihong Ted Yu edited comment on HBASE-3271 at 8/23/12 4:07 AM:
----------------------------------------------------------------
nit: the following two lines are too long:
{code}
+ GenericOptionsParser opts = new GenericOptionsParser(new Configuration(cluster.getConfiguration()), args);
...
+ InputSplit split = new TableSplit(table.getTableName(), HConstants.EMPTY_BYTE_ARRAY, HConstants.EMPTY_BYTE_ARRAY,
{code}
was (Author: zhihyu@ebaysf.com):
nit: the following line is too long:
{code}
+ InputSplit split = new TableSplit(table.getTableName(), HConstants.EMPTY_BYTE_ARRAY, HConstants.EMPTY_BYTE_ARRAY,
{code}
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0
>
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3271) Allow .META. table to be exported
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhihong Ted Yu updated HBASE-3271:
----------------------------------
Fix Version/s: 0.94.2
Release Note: mapreduce.Export is able to export .META. table
Integrated to 0.94 branch as well.
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Fix For: 0.96.0, 0.94.2
>
> Attachments: 3271.94, HBASE-3271.patch, HBASE-3271-v2.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3271) Allow .META. table to be exported
Posted by "liang xie (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liang xie updated HBASE-3271:
-----------------------------
Attachment: HBASE-3271.patch
Seems this issue is still existing, at least for TRUNK. I just tidied Ted's old code, changed a DEPRECATED method call, and created a new test case for this corner case
> Allow .META. table to be exported
> ---------------------------------
>
> Key: HBASE-3271
> URL: https://issues.apache.org/jira/browse/HBASE-3271
> Project: HBase
> Issue Type: Improvement
> Components: util
> Affects Versions: 0.20.6
> Reporter: Ted Yu
> Attachments: HBASE-3271.patch
>
>
> I tried to export .META. table in 0.20.6 and got:
> [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase org.apache.hadoop.hbase.mapreduce.Export .META. h-meta 1 0 0
> 10/11/23 20:59:05 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2010-11-23 20:59:05.255::INFO: Logging to STDERR via org.mortbay.log.StdErrLog
> 2010-11-23 20:59:05.255::INFO: verisons=1, starttime=0, endtime=9223372036854775807
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.2.2-888565, built on 12/08/2009 21:51 GMT
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:host.name=us01-ciqps1-name01.carrieriq.com
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_21
> 10/11/23 20:59:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
> ...
> 10/11/23 20:59:05 INFO zookeeper.ClientCnxn: Server connection successful
> 10/11/23 20:59:05 DEBUG zookeeper.ZooKeeperWrapper: Read ZNode /hbase/root-region-server got 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Found ROOT at 10.202.50.112:60020
> 10/11/23 20:59:05 DEBUG client.HConnectionManager$TableServers: Cached location for .META.,,1 is us01-ciqps1-grid02.carrieriq.com:60020
> Exception in thread "main" java.io.IOException: Expecting at least one region.
> at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:281)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at org.apache.hadoop.hbase.mapreduce.Export.main(Export.java:146)
> Related code is:
> if (keys == null || keys.getFirst() == null ||
> keys.getFirst().length == 0) {
> throw new IOException("Expecting at least one region.");
> }
> My intention was to save the dangling rows in .META. (for future investigation) which prevented a table from being created.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira