You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2016/07/28 06:48:21 UTC
[jira] [Closed] (KYLIN-1787) Properly deal with limit clause in
CubeHBaseEndpointRPC (SELECT * problem)
[ https://issues.apache.org/jira/browse/KYLIN-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shaofeng SHI closed KYLIN-1787.
-------------------------------
Resolved in release 1.5.3 (2-16-07-28)
> Properly deal with limit clause in CubeHBaseEndpointRPC (SELECT * problem)
> --------------------------------------------------------------------------
>
> Key: KYLIN-1787
> URL: https://issues.apache.org/jira/browse/KYLIN-1787
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v1.5.2
> Reporter: hongbin ma
> Assignee: liyang
> Labels: newbie
> Fix For: v1.5.3
>
>
> what is the difference between "SELECT * FROM
> MEDIA_SNS.T_MAIL_POP3_LOGIN as T_MAIL_POP3_LOGIN limit 10“ and "SELECT
> count(*) FROM MEDIA_SNS.T_MAIL_POP3_LOGIN as T_MAIL_POP3_LOGIN limit 10"?
> the second one run success quickly,and the first one failed with:
> 2016-06-15 00:01:02,364 INFO [BadQueryDetector]
> service.BadQueryDetector:104 : Slow query has been running 10398.763 seconds
> (project:media_sns_mail, thread: 0x34) -- SELECT * FROM
> MEDIA_SNS.T_MAIL_POP3_LOGIN as T_MAIL_POP3_LOGIN limit 10
> the regionserver showes error info like:
> 2016-06-15 10:37:08,093 WARN
> [B.DefaultRpcServer.handler=54,queue=4,port=60020] ipc.RpcServer:
> (*responseTooLarge*): {"processingtimems":152140,"call":"ExecService(org.
> apache.hadoop.hbase.protobuf.generated.ClientProtos$CoprocessorServiceRequest)","client":"XXX.XXX.XXX.XXX:45264","starttimems":1465958075952,"queuetimems":0,"class":"HRe
> gionServer","responsesize":*494803440*,"method":"ExecService"}
> 2016-06-15 10:37:08,645 WARN
> [B.DefaultRpcServer.handler=54,queue=4,port=60020] ipc.RpcServer:
> RpcServer.respondercallId: 93695 service: ClientService methodName: Exe
> cService size: 913 connection: XXX.XXX.XXX.XXX:45264: output error
> 2016-06-15 10:37:08,648 WARN
> [B.DefaultRpcServer.handler=54,queue=4,port=60020] ipc.RpcServer:
> B.DefaultRpcServer.handler=54,queue=4,port=60020: caught a ClosedChanne
> lException, this means that the server XXX.XXX.XXX.XXX/XXX.XXX.XXX.XXX:60020
> was processing a request but the client went away. The error message was:
> null
> pleasse notice infomation about “responseTooLarge“ and
> "responsesize:494803440",but in my enviroment,i set(in kylin.properties):
> kylin.hbase.scan.cache_rows=10
> kylin.hbase.scan.max_result_size=102400
> my hbase is 0.98.16.1 and i notice HBASE-13527;and i also notice some
> difference between CubeHBaseScanRPC and CubeHBaseEndpointRPC
> CubeHBaseScanRPC has done something like buildScan(which call
> setMaxResultSize),while CubeHBaseEndpointRPC does not do things like this?
> may it be a problem?
> more to be added,the regionserver related with the second failing query
> will be down soon after dealing with this query,jvm gc happen frequentyl
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)