You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 李乐 <13...@qq.com> on 2017/01/20 02:05:13 UTC
cube已经为ready状态，但无法执行查询语句
dev您好：
请教您一个问题，我的cube已经为ready状态，但在执行查询语句时报如下错误，请问这个什么问题？谢谢！
错误日志如下：
Error while executing SQL "select * from kylin_sales LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not sent back? In coprocessor Self-termination is checked every 100 scanned rows, the configured timeout(324000000) cannot support this many scans?
------------------
交易业务支撑部外援 法本 李乐
手机：+86 13925520593
Email：2278575412@qq.com
联系地址： 深圳市福田区滨河大道澳知浩大楼5A室
Re: cube已经为ready状态，但无法执行查询语句
Posted by Alberto Ramón <a....@gmail.com>.
"Timeout visiting cube" is because HBase take long time to response to
Apache Kylin
Check: The status of your HBase and if design your cube is adequate to your
query "select part_dt, sum(price)
as total_selled, count(distinct seller_id) as sellers from kylin_sales group
by part_dt order by part_dt" (Example the order of Dim in the RowKey)
On 25 July 2017 at 06:43, zephyrli <ya...@gmail.com> wrote:
> All versions are here:
> hadoop: hadoop-2.6.0-cdh5.7.1
> hbase: hbase-1.2.0-cdh5.7.1
> hive: hive-1.1.0-cdh5.7.1
> kylin: 2.0.0
>
> And I just run the sql on sample project, and meet the same problem, could
> you please help me checking it?
>
> There aren't error logs of Hbase region server(not even before or after)，
> logs are like:
>
> 2017-07-25 10:38:04,042 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] common.KylinConfig: Resetting
> SYS_ENV_INSTANCE by a input stream: 320199326
> 2017-07-25 10:38:04,065 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> Checking custom measure types from kylin config
> 2017-07-25 10:38:04,065 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering COUNT_DISTINCT(hllc), class
> org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
> 2017-07-25 10:38:04,068 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering COUNT_DISTINCT(bitmap), class
> org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
> 2017-07-25 10:38:04,073 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering TOP_N(topn), class
> org.apache.kylin.measure.topn.TopNMeasureType$Factory
> 2017-07-25 10:38:04,074 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering RAW(raw), class
> org.apache.kylin.measure.raw.RawMeasureType$Factory
> 2017-07-25 10:38:04,075 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering EXTENDED_COLUMN(extendedcolumn), class
> org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
> 2017-07-25 10:38:04,076 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering PERCENTILE(percentile), class
> org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
> 2017-07-25 10:38:04,100 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] gridtable.GTScanRequest: pre
> aggregation is not beneficial, skip it
> 2017-07-25 10:38:04,109 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Total
> scanned 1 rows and 200 bytes
> 2017-07-25 10:38:04,110 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Size
> of
> final result = 55 (46 before compressing)
>
>
>
>
> and kylin.log is like this:
>
>
> 2017-07-25 10:38:02,636 DEBUG [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-101] enumerator.OLAPEnumerator:122 :
> return TupleIterator...
> 2017-07-25 10:38:02,636 ERROR [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-101] service.QueryService:382 :
> Exception when execute sql
> java.sql.SQLException: Error while executing SQL "select part_dt,
> sum(price)
> as total_selled, count(distinct seller_id) as sellers from kylin_sales
> group
> by part_dt order by part_dt
> LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not
> sent back? In coprocessor Self-termination is checked every 100 scanned
> rows, the configured timeout(324000000) cannot support this many scans?
> at org.apache.calcite.avatica.Helper.createException(Helper.
> java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.
> java:41)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(
> AvaticaStatement.java:156)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(
> AvaticaStatement.java:218)
> at
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:562)
> at
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(
> QueryService.java:466)
> at
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:153)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(
> QueryService.java:357)
> at
> org.apache.kylin.rest.controller.QueryController.
> query(QueryController.java:69)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(
> InvocableHandlerMethod.java:221)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:136)
> at
> org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:104)
> at
> org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandleMethod(
> RequestMappingHandlerAdapter.java:743)
> at
> org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:672)
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.
> handle(AbstractHandlerMethodAdapter.java:82)
> at
> org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:933)
> at
> org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:867)
> at
> org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:867)
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(
> FrameworkServlet.java:951)
> at
> org.springframework.web.servlet.FrameworkServlet.
> doPost(FrameworkServlet.java:853)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> at
> org.springframework.web.servlet.FrameworkServlet.
> service(FrameworkServlet.java:827)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> ....
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/cube-ready-tp7004p8538.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: cube已经为ready状态，但无法执行查询语句
Posted by zephyrli <ya...@gmail.com>.
All versions are here:
hadoop: hadoop-2.6.0-cdh5.7.1
hbase: hbase-1.2.0-cdh5.7.1
hive: hive-1.1.0-cdh5.7.1
kylin: 2.0.0
And I just run the sql on sample project, and meet the same problem, could
you please help me checking it?
There aren't error logs of Hbase region server(not even before or after)，
logs are like:
2017-07-25 10:38:04,042 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] common.KylinConfig: Resetting
SYS_ENV_INSTANCE by a input stream: 320199326
2017-07-25 10:38:04,065 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
Checking custom measure types from kylin config
2017-07-25 10:38:04,065 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering COUNT_DISTINCT(hllc), class
org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
2017-07-25 10:38:04,068 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering COUNT_DISTINCT(bitmap), class
org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
2017-07-25 10:38:04,073 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering TOP_N(topn), class
org.apache.kylin.measure.topn.TopNMeasureType$Factory
2017-07-25 10:38:04,074 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering RAW(raw), class
org.apache.kylin.measure.raw.RawMeasureType$Factory
2017-07-25 10:38:04,075 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering EXTENDED_COLUMN(extendedcolumn), class
org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
2017-07-25 10:38:04,076 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering PERCENTILE(percentile), class
org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
2017-07-25 10:38:04,100 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] gridtable.GTScanRequest: pre
aggregation is not beneficial, skip it
2017-07-25 10:38:04,109 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Total
scanned 1 rows and 200 bytes
2017-07-25 10:38:04,110 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Size of
final result = 55 (46 before compressing)
and kylin.log is like this:
2017-07-25 10:38:02,636 DEBUG [Query
58afb8da-5466-45ee-b30a-fa4451b54562-101] enumerator.OLAPEnumerator:122 :
return TupleIterator...
2017-07-25 10:38:02,636 ERROR [Query
58afb8da-5466-45ee-b30a-fa4451b54562-101] service.QueryService:382 :
Exception when execute sql
java.sql.SQLException: Error while executing SQL "select part_dt, sum(price)
as total_selled, count(distinct seller_id) as sellers from kylin_sales group
by part_dt order by part_dt
LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not
sent back? In coprocessor Self-termination is checked every 100 scanned
rows, the configured timeout(324000000) cannot support this many scans?
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:562)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:466)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:153)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:357)
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:853)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
....
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/cube-ready-tp7004p8538.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: cube已经为ready状态，但无法执行查询语句
Posted by Li Yang <li...@apache.org>.
Also look into your HBase region server log. Might got some exception there.
If you just upgraded to a new version of kylin, make sure coprocessor is
re-deployed.
Cheers
On Sun, Jan 22, 2017 at 10:55 AM, ShaoFeng Shi <sh...@apache.org>
wrote:
> Hi Li Le, what's your Kylin and HBase version?
>
> 在 2017年1月20日 上午10:05，李乐 <13...@qq.com>写道：
>
> > dev您好：
> > 请教您一个问题，我的cube已经为ready状态，但在执行查询语句时报如下错误，请问这个什么问题？谢谢！
> > 错误日志如下：
> > Error while executing SQL "select * from kylin_sales LIMIT 50000":
> > Timeout visiting cube! Check why coprocessor exception is not sent back?
> > In coprocessor Self-termination is checked every 100 scanned rows, the
> > configured timeout(324000000) cannot support this many scans?
> >
> > ------------------
> > 交易业务支撑部外援 法本 李乐
> >
> > 手机：+86 13925520593
> > Email：2278575412@qq.com
> > 联系地址： 深圳市福田区滨河大道澳知浩大楼5A室
>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
Re: cube已经为ready状态，但无法执行查询语句
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Li Le, what's your Kylin and HBase version?
在 2017年1月20日 上午10:05，李乐 <13...@qq.com>写道：
> dev您好：
> 请教您一个问题，我的cube已经为ready状态，但在执行查询语句时报如下错误，请问这个什么问题？谢谢！
> 错误日志如下：
> Error while executing SQL "select * from kylin_sales LIMIT 50000":
> Timeout visiting cube! Check why coprocessor exception is not sent back?
> In coprocessor Self-termination is checked every 100 scanned rows, the
> configured timeout(324000000) cannot support this many scans?
>
> ------------------
> 交易业务支撑部外援 法本 李乐
>
> 手机：+86 13925520593
> Email：2278575412@qq.com
> 联系地址： 深圳市福田区滨河大道澳知浩大楼5A室
--
Best regards,
Shaofeng Shi 史少锋