You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by outpost <ou...@ykt.ru> on 2008/08/11 07:23:41 UTC
question about RetriesExhaustedException
I had set cluster HBase and wroted Java-class to extract data
==================================================================
public String getContent(String rowKey, HTable htable) {
String result = null;
try {
System.out.println(new Date() + " getContentTag1");
Cell cell = htable.get(rowKey, "c:s");
System.out.println(new Date() + " length=" +
cell.getValue().length);
result = Bytes.toString(cell.getValue());
} catch (IOException ex) {
Logger.getLogger(DbHbase.class.getName()).log(Level.SEVERE,
null, ex);
}
return result;
}
public String getTitle(String rowKey, HTable htable) {
String result = null;
try {
System.out.println(new Date() + " getTitle");
Cell cell = getUrlTable().get(hostId_urlId.toString(), "t:t");
System.out.println(new Date());
result = Bytes.toString(cell.getValue());
} catch (IOException ex) {
Logger.getLogger(DbHbase.class.getName()).log(Level.SEVERE,
null, ex);
}
return result;
}
==================================================================
That method is called from "for()" loop. And there is problem:
- Method HTable.get() hangs up on some iterations and hbase is retrying
to contact region server, but can't.
- Some different iterations is proceeded very fast and some wait until
RetriesExhaustedException raised.
Also I tried to play with HBaseConfiguration() like,
config.set("hbase.client.pause", "1000");
config.set("hbase.client.retries.number", "10");
but it didn't help;
Here goes output from methods:
==============================================================
Mon Aug 11 13:57:20 YAKST 2008 getContentTag1
11.08.2008 13:57:20 sinetsoft.search.database.postgresql.DbHbase getHTable
SEVERE: Table url disabled
Mon Aug 11 13:57:20 YAKST 2008 length=467253
Mon Aug 11 13:57:20 YAKST 2008 getTitle
11.08.2008 13:58:11 sinetsoft.search.database.postgresql.DbHbase getTitle
SEVERE: null
org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
contact region server 10.10.10.123:60020 for region url,,1218240473947,
row '214_346654', but failed after 6 attempts.
Exceptions:
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:885)
Mon Aug 11 13:58:11 YAKST 2008 getContentTag1
Mon Aug 11 13:58:11 YAKST 2008 length=454793
Mon Aug 11 13:58:11 YAKST 2008 getTitle
at org.apache.hadoop.hbase.client.HTable.get(HTable.java:378)
at org.apache.hadoop.hbase.client.HTable.get(HTable.java:351)
at
sinetsoft.search.database.postgresql.DbHbase.getTitle(DbHbase.java:163)
at
sinetsoft.search.algorithmsNew.Loader.loadAnswerUrlFromTableUrl(Loader.java:56)
at sinetsoft.search.algorithmsNew.Search.makeSnippets(Search.java:35)
at sinetsoft.search.profiler.Main.main(Main.java:41)
11.08.2008 13:59:02 sinetsoft.search.database.postgresql.DbHbase getTitle
SEVERE: null
org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
contact region server 10.10.10.123:60020 for region url,,1218240473947,
row '214_346655', but failed after 6 attempts.
Exceptions:
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.io.IOException: java.lang.NullPointerException
at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:885)
at org.apache.hadoop.hbase.client.HTable.get(HTable.java:378)
at org.apache.hadoop.hbase.client.HTable.get(HTable.java:351)
at
sinetsoft.search.database.postgresql.DbHbase.getTitle(DbHbase.java:163)
at
sinetsoft.search.algorithmsNew.Loader.loadAnswerUrlFromTableUrl(Loader.java:56)
at sinetsoft.search.algorithmsNew.Search.makeSnippets(Search.java:35)
at sinetsoft.search.profiler.Main.main(Main.java:41)
Mon Aug 11 13:59:02 YAKST 2008 getContentTag1
Mon Aug 11 13:59:02 YAKST 2008 length=264167
Mon Aug 11 13:59:02 YAKST 2008 getTitle
Mon Aug 11 13:59:02 YAKST 2008
Mon Aug 11 13:59:02 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=278765
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=5396
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=42810
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=21015
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=22343
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=14975
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
Mon Aug 11 13:59:03 YAKST 2008 length=11434
Mon Aug 11 13:59:03 YAKST 2008 getTitle
Mon Aug 11 13:59:03 YAKST 2008
=============================================================
ВСТО по дну Лены: не будьте равнодушны, это касается всех.
Не ждите пока нефть придет к вам из крана дома,
приплывет в виде мертвой рыбы или заставит забыть об отдыхе на реке
на много лет. Заходите на savelena.ykt.ru, поддержите акцию!
Re: question about RetriesExhaustedException
Posted by stack <st...@duboce.net>.
What hbase version?
Thanks,
St.Ack
outpost wrote:
> I had set cluster HBase and wroted Java-class to extract data
>
>
> ==================================================================
> public String getContent(String rowKey, HTable htable) {
> String result = null;
> try {
> System.out.println(new Date() + " getContentTag1");
> Cell cell = htable.get(rowKey, "c:s");
> System.out.println(new Date() + " length=" +
> cell.getValue().length);
> result = Bytes.toString(cell.getValue());
> } catch (IOException ex) {
> Logger.getLogger(DbHbase.class.getName()).log(Level.SEVERE,
> null, ex);
> }
> return result;
> }
>
> public String getTitle(String rowKey, HTable htable) {
> String result = null;
> try {
> System.out.println(new Date() + " getTitle");
> Cell cell = getUrlTable().get(hostId_urlId.toString(), "t:t");
> System.out.println(new Date());
> result = Bytes.toString(cell.getValue());
> } catch (IOException ex) {
> Logger.getLogger(DbHbase.class.getName()).log(Level.SEVERE,
> null, ex);
> }
> return result;
> }
> ==================================================================
>
>
> That method is called from "for()" loop. And there is problem:
> - Method HTable.get() hangs up on some iterations and hbase is retrying
> to contact region server, but can't.
> - Some different iterations is proceeded very fast and some wait until
> RetriesExhaustedException raised.
>
> Also I tried to play with HBaseConfiguration() like,
> config.set("hbase.client.pause", "1000");
> config.set("hbase.client.retries.number", "10");
> but it didn't help;
>
> Here goes output from methods:
>
> ==============================================================
> Mon Aug 11 13:57:20 YAKST 2008 getContentTag1
> 11.08.2008 13:57:20 sinetsoft.search.database.postgresql.DbHbase getHTable
> SEVERE: Table url disabled
> Mon Aug 11 13:57:20 YAKST 2008 length=467253
> Mon Aug 11 13:57:20 YAKST 2008 getTitle
> 11.08.2008 13:58:11 sinetsoft.search.database.postgresql.DbHbase getTitle
> SEVERE: null
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.10.10.123:60020 for region url,,1218240473947,
> row '214_346654', but failed after 6 attempts.
> Exceptions:
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
>
> at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:885)
> Mon Aug 11 13:58:11 YAKST 2008 getContentTag1
> Mon Aug 11 13:58:11 YAKST 2008 length=454793
> Mon Aug 11 13:58:11 YAKST 2008 getTitle
> at org.apache.hadoop.hbase.client.HTable.get(HTable.java:378)
> at org.apache.hadoop.hbase.client.HTable.get(HTable.java:351)
> at
> sinetsoft.search.database.postgresql.DbHbase.getTitle(DbHbase.java:163)
> at
> sinetsoft.search.algorithmsNew.Loader.loadAnswerUrlFromTableUrl(Loader.java:56)
> at sinetsoft.search.algorithmsNew.Search.makeSnippets(Search.java:35)
> at sinetsoft.search.profiler.Main.main(Main.java:41)
> 11.08.2008 13:59:02 sinetsoft.search.database.postgresql.DbHbase getTitle
> SEVERE: null
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.10.10.123:60020 for region url,,1218240473947,
> row '214_346655', but failed after 6 attempts.
> Exceptions:
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
> java.io.IOException: java.io.IOException: java.lang.NullPointerException
>
>
> at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:885)
> at org.apache.hadoop.hbase.client.HTable.get(HTable.java:378)
> at org.apache.hadoop.hbase.client.HTable.get(HTable.java:351)
> at
> sinetsoft.search.database.postgresql.DbHbase.getTitle(DbHbase.java:163)
> at
> sinetsoft.search.algorithmsNew.Loader.loadAnswerUrlFromTableUrl(Loader.java:56)
> at sinetsoft.search.algorithmsNew.Search.makeSnippets(Search.java:35)
> at sinetsoft.search.profiler.Main.main(Main.java:41)
> Mon Aug 11 13:59:02 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:02 YAKST 2008 length=264167
> Mon Aug 11 13:59:02 YAKST 2008 getTitle
> Mon Aug 11 13:59:02 YAKST 2008
> Mon Aug 11 13:59:02 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=278765
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
> Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=5396
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
> Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=42810
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
> Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=21015
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
> Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=22343
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
> Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=14975
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
> Mon Aug 11 13:59:03 YAKST 2008 getContentTag1
> Mon Aug 11 13:59:03 YAKST 2008 length=11434
> Mon Aug 11 13:59:03 YAKST 2008 getTitle
> Mon Aug 11 13:59:03 YAKST 2008
>
>
> =============================================================
> ВСТО по дну Лены: не будьте равнодушны, это касается всех.
> Не ждите пока нефть придет к вам из крана дома,
> приплывет в виде мертвой рыбы или заставит забыть об отдыхе на реке
> на много лет. Заходите на savelena.ykt.ru, поддержите акцию!
>
>