You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by baggio liu <ba...@gmail.com> on 2010/09/25 09:10:39 UTC
too slower in loadStoreFile
Hi HBaser,
We meet aproblem when we use HBase. Our environment is HBase 0.20.6 +
Hadoop (CDH3b2). 5 region server and 5 datanode with 2193 region and
48.95 TB data in HDFS.
And our client is put 5 column family and 5 qualifier in one row, and
commit to HBase every 500 rows.
We start 8 clients in one machine (have 6 machines, totally we have 48
clients)
When batch put , we found cost of loadFileInfo became more and more after
spliting region , from several ms to tens of seconds, even several minutes.
At last, it'll cause error like below.
*org.apache.hadoop.hbase.client.NoServerForRegionException: No server
address listed in .META. for region *
BTW: After profiling, we found performance waste in readIndex. (mainly
in a loop sequencly read byte array from HDFS. ) As putting, readIndex
become more slowly.
Has any body meet similar issue ?? And help me to explain why read HDFS
become slowly.
Thanks & Best regards
LiuJinglong