You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by zephyrli <ya...@gmail.com> on 2017/07/25 05:43:18 UTC
Re: cube已经为ready状态，但无法执行查询语句
All versions are here:
hadoop: hadoop-2.6.0-cdh5.7.1
hbase: hbase-1.2.0-cdh5.7.1
hive: hive-1.1.0-cdh5.7.1
kylin: 2.0.0
And I just run the sql on sample project, and meet the same problem, could
you please help me checking it?
There aren't error logs of Hbase region server(not even before or after)，
logs are like:
2017-07-25 10:38:04,042 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] common.KylinConfig: Resetting
SYS_ENV_INSTANCE by a input stream: 320199326
2017-07-25 10:38:04,065 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
Checking custom measure types from kylin config
2017-07-25 10:38:04,065 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering COUNT_DISTINCT(hllc), class
org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
2017-07-25 10:38:04,068 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering COUNT_DISTINCT(bitmap), class
org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
2017-07-25 10:38:04,073 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering TOP_N(topn), class
org.apache.kylin.measure.topn.TopNMeasureType$Factory
2017-07-25 10:38:04,074 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering RAW(raw), class
org.apache.kylin.measure.raw.RawMeasureType$Factory
2017-07-25 10:38:04,075 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering EXTENDED_COLUMN(extendedcolumn), class
org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
2017-07-25 10:38:04,076 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering PERCENTILE(percentile), class
org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
2017-07-25 10:38:04,100 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] gridtable.GTScanRequest: pre
aggregation is not beneficial, skip it
2017-07-25 10:38:04,109 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Total
scanned 1 rows and 200 bytes
2017-07-25 10:38:04,110 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Size of
final result = 55 (46 before compressing)
and kylin.log is like this:
2017-07-25 10:38:02,636 DEBUG [Query
58afb8da-5466-45ee-b30a-fa4451b54562-101] enumerator.OLAPEnumerator:122 :
return TupleIterator...
2017-07-25 10:38:02,636 ERROR [Query
58afb8da-5466-45ee-b30a-fa4451b54562-101] service.QueryService:382 :
Exception when execute sql
java.sql.SQLException: Error while executing SQL "select part_dt, sum(price)
as total_selled, count(distinct seller_id) as sellers from kylin_sales group
by part_dt order by part_dt
LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not
sent back? In coprocessor Self-termination is checked every 100 scanned
rows, the configured timeout(324000000) cannot support this many scans?
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:562)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:466)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:153)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:357)
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:853)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
....
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/cube-ready-tp7004p8538.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: cube已经为ready状态，但无法执行查询语句
Posted by Alberto Ramón <a....@gmail.com>.
"Timeout visiting cube" is because HBase take long time to response to
Apache Kylin
Check: The status of your HBase and if design your cube is adequate to your
query "select part_dt, sum(price)
as total_selled, count(distinct seller_id) as sellers from kylin_sales group
by part_dt order by part_dt" (Example the order of Dim in the RowKey)
On 25 July 2017 at 06:43, zephyrli <ya...@gmail.com> wrote:
> All versions are here:
> hadoop: hadoop-2.6.0-cdh5.7.1
> hbase: hbase-1.2.0-cdh5.7.1
> hive: hive-1.1.0-cdh5.7.1
> kylin: 2.0.0
>
> And I just run the sql on sample project, and meet the same problem, could
> you please help me checking it?
>
> There aren't error logs of Hbase region server(not even before or after)，
> logs are like:
>
> 2017-07-25 10:38:04,042 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] common.KylinConfig: Resetting
> SYS_ENV_INSTANCE by a input stream: 320199326
> 2017-07-25 10:38:04,065 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> Checking custom measure types from kylin config
> 2017-07-25 10:38:04,065 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering COUNT_DISTINCT(hllc), class
> org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
> 2017-07-25 10:38:04,068 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering COUNT_DISTINCT(bitmap), class
> org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
> 2017-07-25 10:38:04,073 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering TOP_N(topn), class
> org.apache.kylin.measure.topn.TopNMeasureType$Factory
> 2017-07-25 10:38:04,074 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering RAW(raw), class
> org.apache.kylin.measure.raw.RawMeasureType$Factory
> 2017-07-25 10:38:04,075 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering EXTENDED_COLUMN(extendedcolumn), class
> org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
> 2017-07-25 10:38:04,076 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
> registering PERCENTILE(percentile), class
> org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
> 2017-07-25 10:38:04,100 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] gridtable.GTScanRequest: pre
> aggregation is not beneficial, skip it
> 2017-07-25 10:38:04,109 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Total
> scanned 1 rows and 200 bytes
> 2017-07-25 10:38:04,110 INFO [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Size
> of
> final result = 55 (46 before compressing)
>
>
>
>
> and kylin.log is like this:
>
>
> 2017-07-25 10:38:02,636 DEBUG [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-101] enumerator.OLAPEnumerator:122 :
> return TupleIterator...
> 2017-07-25 10:38:02,636 ERROR [Query
> 58afb8da-5466-45ee-b30a-fa4451b54562-101] service.QueryService:382 :
> Exception when execute sql
> java.sql.SQLException: Error while executing SQL "select part_dt,
> sum(price)
> as total_selled, count(distinct seller_id) as sellers from kylin_sales
> group
> by part_dt order by part_dt
> LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not
> sent back? In coprocessor Self-termination is checked every 100 scanned
> rows, the configured timeout(324000000) cannot support this many scans?
> at org.apache.calcite.avatica.Helper.createException(Helper.
> java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.
> java:41)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(
> AvaticaStatement.java:156)
> at
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(
> AvaticaStatement.java:218)
> at
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:562)
> at
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(
> QueryService.java:466)
> at
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:153)
> at
> org.apache.kylin.rest.service.QueryService.doQueryWithCache(
> QueryService.java:357)
> at
> org.apache.kylin.rest.controller.QueryController.
> query(QueryController.java:69)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(
> InvocableHandlerMethod.java:221)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:136)
> at
> org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:104)
> at
> org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandleMethod(
> RequestMappingHandlerAdapter.java:743)
> at
> org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:672)
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.
> handle(AbstractHandlerMethodAdapter.java:82)
> at
> org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:933)
> at
> org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:867)
> at
> org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:867)
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(
> FrameworkServlet.java:951)
> at
> org.springframework.web.servlet.FrameworkServlet.
> doPost(FrameworkServlet.java:853)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
> at
> org.springframework.web.servlet.FrameworkServlet.
> service(FrameworkServlet.java:827)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> ....
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/cube-ready-tp7004p8538.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>