You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by zephyrli <ya...@gmail.com> on 2017/07/25 05:54:12 UTC
Timeout visiting cube
My envs are here:
hadoop: hadoop-2.6.0-cdh5.7.1
hbase: hbase-1.2.0-cdh5.7.1
hive: hive-1.1.0-cdh5.7.1
kylin: 2.0.0
I just run the sql on sample project, and try to make a query like below,
"Timeout visiting cubes" happended. Could you please help me checking it?
Thank you!
Error while executing SQL "select part_dt, sum(price) as total_selled,
count(distinct seller_id) as sellers from kylin_sales group by part_dt order
by part_dt
LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not
sent back? In coprocessor Self-termination is checked every 100 scanned
rows, the configured timeout(324000000) cannot support this many scans
*There aren't error logs of Hbase region server(not even before or after)*，
logs are like:
2017-07-25 10:38:04,042 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] common.KylinConfig: Resetting
SYS_ENV_INSTANCE by a input stream: 320199326
2017-07-25 10:38:04,065 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
Checking custom measure types from kylin config
2017-07-25 10:38:04,065 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering COUNT_DISTINCT(hllc), class
org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
2017-07-25 10:38:04,068 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering COUNT_DISTINCT(bitmap), class
org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
2017-07-25 10:38:04,073 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering TOP_N(topn), class
org.apache.kylin.measure.topn.TopNMeasureType$Factory
2017-07-25 10:38:04,074 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering RAW(raw), class
org.apache.kylin.measure.raw.RawMeasureType$Factory
2017-07-25 10:38:04,075 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering EXTENDED_COLUMN(extendedcolumn), class
org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
2017-07-25 10:38:04,076 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] measure.MeasureTypeFactory:
registering PERCENTILE(percentile), class
org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
2017-07-25 10:38:04,100 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] gridtable.GTScanRequest: pre
aggregation is not beneficial, skip it
2017-07-25 10:38:04,109 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Total
scanned 1 rows and 200 bytes
2017-07-25 10:38:04,110 INFO [Query
58afb8da-5466-45ee-b30a-fa4451b54562-74] endpoint.CubeVisitService: Size of
final result = 55 (46 before compressing)
*and kylin.log is like this*:
2017-07-25 10:38:02,636 DEBUG [Query
58afb8da-5466-45ee-b30a-fa4451b54562-101] enumerator.OLAPEnumerator:122 :
return TupleIterator...
2017-07-25 10:38:02,636 ERROR [Query
58afb8da-5466-45ee-b30a-fa4451b54562-101] service.QueryService:382 :
Exception when execute sql
java.sql.SQLException: Error while executing SQL "select part_dt, sum(price)
as total_selled, count(distinct seller_id) as sellers from kylin_sales group
by part_dt order by part_dt
LIMIT 50000": Timeout visiting cube! Check why coprocessor exception is not
sent back? In coprocessor Self-termination is checked every 100 scanned
rows, the configured timeout(324000000) cannot support this many scans?
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at
org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156)
at
org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218)
at
org.apache.kylin.rest.service.QueryService.execute(QueryService.java:562)
at
org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:466)
at
org.apache.kylin.rest.service.QueryService.query(QueryService.java:153)
at
org.apache.kylin.rest.service.QueryService.doQueryWithCache(QueryService.java:357)
at
org.apache.kylin.rest.controller.QueryController.query(QueryController.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:853)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
....
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/Timeout-visiting-cube-tp8540.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: Timeout visiting cube
Posted by zephyrli <ya...@gmail.com>.
Thank you so much! I'll try sandbox.
2017-07-25 18:23 GMT+08:00 shaofengshi [via Apache Kylin] <
ml+s74782n8548h67@n6.nabble.com>:
> If there is no log in region server log, it is very likely that it didn't
> receive the request. You may need check the hbase healthy status and
> configurations.
>
> Besides, running Hadoop in Mac is not recommended; Please try to use a
> pre-built sandbox vm for trial. If you want to setup a dev environment,
> follow this guide: https://kylin.apache.org/development/dev_env.html
>
> 2017-07-25 14:00 GMT+08:00 zephyrli <[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=8548&i=0>>:
>
> > I've tried this： $KYLIN_HOME/bin/kylin.sh
> > org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
> > $KYLIN_HOME/lib/kylin-coprocessor-*.jar all
> > but it's not working.
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> > nabble.com/Timeout-visiting-cube-tp8540p8541.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-kylin.74782.x6.nabble.com/Timeout-visiting-
> cubes-tp8540p8548.html
> To unsubscribe from Timeout visiting cubes, click here
> <http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=8540&code=eWF6aGVsaTA3QGdtYWlsLmNvbXw4NTQwfDEwOTM0MTE1NDQ=>
> .
> NAML
> <http://apache-kylin.74782.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
YazheLi (李雅哲)
Dept. of Computer Science and Technology
Tsinghua University, Beijing, P.R. China, 100084
Tel: 18518472195
Email: yazheli07@gmail.com
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/Timeout-visiting-cubes-tp8540p8549.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: Timeout visiting cube
Posted by ShaoFeng Shi <sh...@apache.org>.
If there is no log in region server log, it is very likely that it didn't
receive the request. You may need check the hbase healthy status and
configurations.
Besides, running Hadoop in Mac is not recommended; Please try to use a
pre-built sandbox vm for trial. If you want to setup a dev environment,
follow this guide: https://kylin.apache.org/development/dev_env.html
2017-07-25 14:00 GMT+08:00 zephyrli <ya...@gmail.com>:
> I've tried this： $KYLIN_HOME/bin/kylin.sh
> org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
> $KYLIN_HOME/lib/kylin-coprocessor-*.jar all
> but it's not working.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Timeout-visiting-cube-tp8540p8541.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Timeout visiting cube
Posted by zephyrli <ya...@gmail.com>.
I've tried this： $KYLIN_HOME/bin/kylin.sh
org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI
$KYLIN_HOME/lib/kylin-coprocessor-*.jar all
but it's not working.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/Timeout-visiting-cube-tp8540p8541.html
Sent from the Apache Kylin mailing list archive at Nabble.com.