You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jiajun Chen <cj...@gmail.com> on 2012/06/15 05:53:18 UTC

Re: why responseTooSlow ?

running:

Compacting store data (since 59sec ago)

Flushing data: creating writer (since 1mins, 34sec ago)

Compaction complete (since 59sec ago)

On 12 May 2012 12:48, Stack <st...@duboce.net> wrote:

> On Fri, May 11, 2012 at 5:17 AM, Jiajun Chen <cj...@gmail.com> wrote:
> > 2012-05-11 16:07:19,988 WARN org.apache.hadoop.ipc.HBaseServer:
> > (responseTooSlow):
> >
> {"processingtimems":12439,"call":"multi(org.apache.hadoop.hbase.client.MultiAction@1fce9e31
> ),
> > rpc version=1, client version=29, methodsFingerPrint=54742778","client":"
> > 192.168.0.234:37918
> >
> ","starttimems":1336723627547,"queuetimems":0,"class":"HRegionServer","responsesize":0,"method":"multi"}
> > 2012-05-11 16:07:19,989 WARN org.apache.hadoop.ipc.HBaseServer:
> > (responseTooSlow):
> >
> {"processingtimems":12438,"call":"multi(org.apache.hadoop.hbase.client.MultiAction@5781142c
> ),
> > rpc version=1, client version=29, methodsFingerPrint=54742778","client":"
> > 192.168.0.229:50104
> >
> ","starttimems":1336723627550,"queuetimems":0,"class":"HRegionServer","responsesize":0,"method":"multi"}
> > 2012-05-11 16:07:19,990 WARN org.apache.hadoop.ipc.HBaseServer:
> > (operationTooSlow):
> > {"processingtimems":12439,"ts":9223372036854775807,"client":"
> > 192.168.0.246:60974
> >
> ","starttimems":1336723627548,"queuetimems":0,"class":"HRegionServer","responsesize":0,"method":"delete","totalColumns":1,"table":"WaitSaveHashLive","families":{"c":[{"timestamp":1336723627548,"qualifier":"","vlen":0}]},"row":"\\x05\\x00\\x00\\x017:\\xDB\\x9C`\\xC2\\xF9\\x05)n\\x97\\x93|\\x00\\x00\\x00\\x00\\x1B\\xA6o#"}
>
> What is going on on that machine when you see these logs in your
> regionserver?
> St.Ack
>



-- 

陈加俊  项目经理
优讯时代(北京)网络技术有限公司
优讯网 www.uuwatch.com

地址:北京市海淀区上地五街7号昊海大厦207

电话:010-82895510
传真:010-82896636
手机:15110038983
电邮:*cjjvictory@gmail.com*

Re: why responseTooSlow ?

Posted by Jiajun Chen <cj...@gmail.com>.
$ iostat 3 5

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          27.93    0.00    6.55    4.44    0.00   61.08

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda              39.58      1987.97      1360.10 2261558140 1547281856
sdb              40.86      1987.03      1332.68 2260488874 1516084944
sdc              40.65      1980.03      1336.28 2252523284 1520176912
sdd              39.92      1977.34      1337.84 2249469216 1521957664
md5             434.56      4638.72      3155.54 5277111826 3589814920
md3               0.96         2.95         6.90    3354290    7848232
md1               0.00         0.00         0.00       1072          0

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           5.67    0.00    5.33   36.92    0.00   52.08

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda             192.33      1656.00      2280.00       4968       6840
sdb             213.67      3418.67      1333.33      10256       4000
sdc             221.67      2085.33      1997.33       6256       5992
sdd             211.33      2882.67      1629.33       8648       4888
md5             511.67      4381.33      3402.67      13144      10208
md3              10.67         0.00        85.33          0        256
md1               0.00         0.00         0.00          0          0

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           5.83    0.00    3.58   43.67    0.00   46.92

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda             183.67      3221.33      1909.33       9664       5728
sdb             186.67      3397.33      1984.00      10192       5952
sdc             192.00      2949.33      2152.00       8848       6456
sdd             182.67      2957.33      1968.00       8872       5904
md5             523.33      4042.67      3762.67      12128      11288
md3               9.33         0.00        74.67          0        224
md1               0.00         0.00         0.00          0          0

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           4.48    0.00    2.79   19.61    0.00   73.12

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda             222.33      4618.67      2445.33      13856       7336
sdb             222.00      3610.67      2461.33      10832       7384
sdc             226.33      5656.00      1522.67      16968       4568
sdd             208.67      4584.00      1736.00      13752       5208
md5             569.33     10920.00      3968.00      32760      11904
md3              12.33         0.00        98.67          0        296
md1               0.00         0.00         0.00          0          0

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           2.31    0.00    2.22   35.67    0.00   59.80

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda             195.00      2976.00      2096.00       8928       6288
sdb             189.00      2960.00      2522.67       8880       7568
sdc             182.00      3768.00      1386.67      11304       4160
sdd             177.00      3069.33      1925.33       9208       5776
md5             525.33      5778.67      3808.00      17336      11424
md3               9.67         0.00        77.33          0        232
md1               0.00         0.00         0.00          0          0