You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Phillip Rhodes <pr...@mammothdata.com> on 2016/05/02 21:51:26 UTC
NullPointerException in .CubeHBaseEndpointRPC$1.run
Kylin crew:
I'm still trying to get Kylin working on MapR Hadoop, and now I'm seeing
the following error when trying to run a query through the Kylin web interface.
Building the cube seems to work OK, but this happens at query time. Any ideas?
---------------------------------------------------
2016-05-03 04:34:25,036 DEBUG [http-bio-7070-exec-8]
service.CacheService:149 : The new temp olap json is :{
"version": "1.0",
"defaultSchema": "DEFAULT",
"schemas": [
{
"type": "custom",
"name": "DEFAULT",
"factory": "org.apache.kylin.query.schema.OLAPSchemaFactory",
"operand": {
"project": "LEARN_KYLIN"
},
"functions": [
{
name: 'MASSIN',
className: 'org.apache.kylin.query.udf.MassInUDF'
}
]
}
]
}
2016-05-03 04:34:25,055 DEBUG [http-bio-7070-exec-8]
service.QueryService:289 : getting table metas
2016-05-03 04:34:25,056 DEBUG [http-bio-7070-exec-8]
service.QueryService:307 : getting column metas
2016-05-03 04:34:25,068 DEBUG [http-bio-7070-exec-8]
service.QueryService:321 : done column metas
2016-05-03 04:34:30,695 INFO [http-bio-7070-exec-3]
controller.QueryController:174 : Using project: learn_kylin
2016-05-03 04:34:30,696 INFO [http-bio-7070-exec-3]
controller.QueryController:175 : The original query: select part_dt,
sum(price)
as total_selled, count(distinct seller_id) as sellers from kylin_sales
group by part_dt order by part_dt
2016-05-03 04:34:30,697 INFO [http-bio-7070-exec-3]
service.QueryService:265 : The corrected query: select part_dt,
sum(price) as tot
al_selled, count(distinct seller_id) as sellers from kylin_sales group
by part_dt order by part_dt
LIMIT 50000
2016-05-03 04:34:31,218 INFO [http-bio-7070-exec-3]
routing.QueryRouter:48 : The project manager's reference is
org.apache.kylin.meta
data.project.ProjectManager@5c4a45fc
2016-05-03 04:34:31,219 INFO [http-bio-7070-exec-3]
routing.QueryRouter:60 : Find candidates by table DEFAULT.KYLIN_SALES
and project
=LEARN_KYLIN : org.apache.kylin.query.routing.Candidate@408561ee
2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3]
routing.QueryRouter:49 : Applying rule: class
org.apache.kylin.query.routing.rule
s.RemoveUncapableRealizationsRule, realizations before:
[kylin_sales_cube(CUBE)], realizations after: [kylin_sales_cube(CUBE)]
2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3]
routing.QueryRouter:49 : Applying rule: class
org.apache.kylin.query.routing.rule
s.RealizationSortRule, realizations before: [kylin_sales_cube(CUBE)],
realizations after: [kylin_sales_cube(CUBE)]
2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3]
routing.QueryRouter:72 : The realizations remaining:
[kylin_sales_cube(CUBE)] And
the final chosen one is the first one
2016-05-03 04:34:31,513 DEBUG [http-bio-7070-exec-3]
enumerator.OLAPEnumerator:107 : query storage...
2016-05-03 04:34:31,522 INFO [http-bio-7070-exec-3]
v2.CubeStorageQuery:251 : exactAggregation is true
2016-05-03 04:34:31,522 INFO [http-bio-7070-exec-3]
v2.CubeStorageQuery:357 : Memory budget is set to: 3109290
2016-05-03 04:34:31,550 DEBUG [http-bio-7070-exec-3]
v2.CubeHBaseEndpointRPC:256 : New scanner for current segment
kylin_sales_cube[20
120101000000_20160501000000] will use SCAN_FILTER_AGGR_CHECKMEM as
endpoint's behavior
2016-05-03 04:34:31,562 DEBUG [http-bio-7070-exec-3]
v2.CubeHBaseEndpointRPC:291 : Serialized scanRequestBytes 321 bytes,
rawScanBytes
String 46 bytes
2016-05-03 04:34:31,562 INFO [http-bio-7070-exec-3]
v2.CubeHBaseEndpointRPC:294 : The scan(s) info for current segment is
as below, s
hard part of start/end key is set to 0
2016-05-03 04:34:31,562 INFO [http-bio-7070-exec-3]
v2.CubeHBaseRPC:309 : Visiting hbase table KYLIN_JFVKIFVB8S: cuboid
exact match,
from 64 to 64 Start:
\x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00
(\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00) Stop: \
x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\x00
(\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\x00), No Fuzzy Key
2016-05-03 04:34:31,563 DEBUG [http-bio-7070-exec-3]
v2.CubeHBaseEndpointRPC:300 : Submitting rpc to 1 shards starting from
shard 0, s
can requests count 1
2016-05-03 04:34:31,582 INFO [http-bio-7070-exec-3]
v2.CubeHBaseEndpointRPC:125 : Timeout for ExpectedSizeIterator is
60000
2016-05-03 04:34:31,588 DEBUG [http-bio-7070-exec-3]
enumerator.OLAPEnumerator:127 : return TupleIterator...
2016-05-03 04:34:31,592 ERROR [pool-9-thread-1]
v2.CubeHBaseEndpointRPC:98 : Execution exception when running task in
pool-9-thread-1
2016-05-03 04:34:31,592 ERROR [pool-9-thread-1]
v2.CubeHBaseEndpointRPC:108 : Caught exception in thread
pool-9-thread-1:
java.lang.NullPointerException
at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:326)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2016-05-03 04:35:05,120 INFO [pool-1-thread-1]
threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual
running, 0 ready, 2
others
2016-05-03 04:35:31,589 ERROR [http-bio-7070-exec-3]
controller.QueryController:209 : Exception when execute sql
java.sql.SQLException: Error while executing SQL "select part_dt,
sum(price) as total_selled, count(distinct seller_id) as sellers fro
m kylin_sales group by part_dt order by part_dt
LIMIT 50000": Timeout visiting cube!
at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143)
at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186)
at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:356)
at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:272)
at org.apache.kylin.rest.service.QueryService.query(QueryService.java:118)
at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618)
at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$c9bef1fc.query(<generated>)
at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192)
at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandler
Method.java:96)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandle
rAdapter.java:617)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdap
ter.java:578)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:1
13)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequ
estFilter.java:54)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilt
er.java:91)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProce
ssingFilter.java:183)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87
)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:195)
at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Timeout visiting cube!
at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:142)
at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:113)
at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48)
at com.google.common.collect.Iterators$6.hasNext(Iterators.java:583)
at org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleIterator.hasNext(SequentialCubeTupleIterator.java:96)
at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:74)
at Baz$1$1.moveNext(Unknown Source)
at org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:819)
at org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:754)
at org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:302)
at Baz.bind(Unknown Source)
at org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:326)
at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:281)
at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:545)
at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:536)
at org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:187)
at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:65)
at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:44)
at org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:566)
at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:578)
at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571)
at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135)
... 80 more
2016-05-03 04:35:31,591 INFO [http-bio-7070-exec-3]
service.QueryService:249 :
==========================[QUERY]===============================
SQL: select part_dt, sum(price) as total_selled, count(distinct
seller_id) as sellers from kylin_sales group by part_dt order by part_
dt
User: ADMIN
Success: false
Duration: 0.0
Project: learn_kylin
Realization Names: [kylin_sales_cube]
Cuboid Ids: [64]
Total scan count: 0
Result row count: 0
Accept Partial: true
Is Partial Result: false
Hit Exception Cache: false
Storage cache used: false
Message: Error while executing SQL "select part_dt, sum(price) as
total_selled, count(distinct seller_id) as sellers from kylin_sales
group by part_dt order by part_dt LIMIT 50000": Timeout visiting cube!
==========================[QUERY]===============================
2016-05-03 04:35:31,592 ERROR [http-bio-7070-exec-3]
controller.BasicController:44 :
org.apache.kylin.rest.exception.InternalErrorException: Error while
executing SQL "select part_dt, sum(price) as total_selled, count(d
istinct seller_id) as sellers from kylin_sales group by part_dt order
by part_dt LIMIT 50000": Timeout visiting cube!
at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224)
at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandler
Method.java:96)
-------------------
Thanks,
Phil
Re: NullPointerException in .CubeHBaseEndpointRPC$1.run
Posted by Phillip Rhodes <pr...@mammothdata.com>.
Another view of that error message, but more focused this time:
2016-05-03 05:01:21,430 DEBUG [http-bio-7070-exec-6]
enumerator.OLAPEnumerator:107 : query storage...
2016-05-03 05:01:21,448 INFO [http-bio-7070-exec-6]
v2.CubeStorageQuery:251 : exactAggregation is true
2016-05-03 05:01:21,453 INFO [http-bio-7070-exec-6]
v2.CubeStorageQuery:357 : Memory budget is set to: 3109290
2016-05-03 05:01:21,467 INFO [http-bio-7070-exec-6]
dict.DictionaryManager:385 : DictionaryManager(293972208) loading
DictionaryInfo(
loadDictObj:true) at
/dict/DEFAULT.KYLIN_CAL_DT/CAL_DT/1e616ceb-1028-4268-a743-38a79c2d09ae.dict
2016-05-03 05:01:21,506 DEBUG [http-bio-7070-exec-6]
v2.CubeHBaseEndpointRPC:256 : New scanner for current segment
kylin_sales_cube[20
120101000000_20160501000000] will use SCAN_FILTER_AGGR_CHECKMEM as
endpoint's behavior
2016-05-03 05:01:21,524 DEBUG [http-bio-7070-exec-6]
v2.CubeHBaseEndpointRPC:291 : Serialized scanRequestBytes 321 bytes,
rawScanBytes
String 46 bytes
2016-05-03 05:01:21,524 INFO [http-bio-7070-exec-6]
v2.CubeHBaseEndpointRPC:294 : The scan(s) info for current segment is
as below, s
hard part of start/end key is set to 0
2016-05-03 05:01:21,526 INFO [http-bio-7070-exec-6]
v2.CubeHBaseRPC:309 : Visiting hbase table KYLIN_JFVKIFVB8S: cuboid
exact match,
from 64 to 64 Start:
\x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00
(\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00) Stop: \
x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\x00
(\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\x00), No Fuzzy Key
2016-05-03 05:01:21,527 DEBUG [http-bio-7070-exec-6]
v2.CubeHBaseEndpointRPC:300 : Submitting rpc to 1 shards starting from
shard 0, s
can requests count 1
2016-05-03 05:01:21,613 INFO [http-bio-7070-exec-6]
v2.CubeHBaseEndpointRPC:125 : Timeout for ExpectedSizeIterator is
60000
2016-05-03 05:01:21,625 DEBUG [http-bio-7070-exec-6]
enumerator.OLAPEnumerator:127 : return TupleIterator...
2016-05-03 05:01:21,630 ERROR [pool-3-thread-1]
v2.CubeHBaseEndpointRPC:98 : Execution exception when running task in
pool-3-thread-1
2016-05-03 05:01:21,632 ERROR [pool-3-thread-1]
v2.CubeHBaseEndpointRPC:108 : Caught exception in thread
pool-3-thread-1:
java.lang.NullPointerException
at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:326)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Thanks,
Phil
On Mon, May 2, 2016 at 3:51 PM, Phillip Rhodes <pr...@mammothdata.com> wrote:
> Kylin crew:
>
> I'm still trying to get Kylin working on MapR Hadoop, and now I'm seeing
> the following error when trying to run a query through the Kylin web interface.
>
> Building the cube seems to work OK, but this happens at query time. Any ideas?
>
> ---------------------------------------------------
> 2016-05-03 04:34:25,036 DEBUG [http-bio-7070-exec-8]
> service.CacheService:149 : The new temp olap json is :{
> "version": "1.0",
> "defaultSchema": "DEFAULT",
> "schemas": [
> {
> "type": "custom",
> "name": "DEFAULT",
> "factory": "org.apache.kylin.query.schema.OLAPSchemaFactory",
> "operand": {
> "project": "LEARN_KYLIN"
> },
> "functions": [
> {
> name: 'MASSIN',
> className: 'org.apache.kylin.query.udf.MassInUDF'
> }
> ]
> }
> ]
> }
>
> 2016-05-03 04:34:25,055 DEBUG [http-bio-7070-exec-8]
> service.QueryService:289 : getting table metas
> 2016-05-03 04:34:25,056 DEBUG [http-bio-7070-exec-8]
> service.QueryService:307 : getting column metas
> 2016-05-03 04:34:25,068 DEBUG [http-bio-7070-exec-8]
> service.QueryService:321 : done column metas
> 2016-05-03 04:34:30,695 INFO [http-bio-7070-exec-3]
> controller.QueryController:174 : Using project: learn_kylin
> 2016-05-03 04:34:30,696 INFO [http-bio-7070-exec-3]
> controller.QueryController:175 : The original query: select part_dt,
> sum(price)
> as total_selled, count(distinct seller_id) as sellers from kylin_sales
> group by part_dt order by part_dt
> 2016-05-03 04:34:30,697 INFO [http-bio-7070-exec-3]
> service.QueryService:265 : The corrected query: select part_dt,
> sum(price) as tot
> al_selled, count(distinct seller_id) as sellers from kylin_sales group
> by part_dt order by part_dt
> LIMIT 50000
> 2016-05-03 04:34:31,218 INFO [http-bio-7070-exec-3]
> routing.QueryRouter:48 : The project manager's reference is
> org.apache.kylin.meta
> data.project.ProjectManager@5c4a45fc
> 2016-05-03 04:34:31,219 INFO [http-bio-7070-exec-3]
> routing.QueryRouter:60 : Find candidates by table DEFAULT.KYLIN_SALES
> and project
> =LEARN_KYLIN : org.apache.kylin.query.routing.Candidate@408561ee
> 2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3]
> routing.QueryRouter:49 : Applying rule: class
> org.apache.kylin.query.routing.rule
> s.RemoveUncapableRealizationsRule, realizations before:
> [kylin_sales_cube(CUBE)], realizations after: [kylin_sales_cube(CUBE)]
> 2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3]
> routing.QueryRouter:49 : Applying rule: class
> org.apache.kylin.query.routing.rule
> s.RealizationSortRule, realizations before: [kylin_sales_cube(CUBE)],
> realizations after: [kylin_sales_cube(CUBE)]
> 2016-05-03 04:34:31,222 INFO [http-bio-7070-exec-3]
> routing.QueryRouter:72 : The realizations remaining:
> [kylin_sales_cube(CUBE)] And
> the final chosen one is the first one
> 2016-05-03 04:34:31,513 DEBUG [http-bio-7070-exec-3]
> enumerator.OLAPEnumerator:107 : query storage...
> 2016-05-03 04:34:31,522 INFO [http-bio-7070-exec-3]
> v2.CubeStorageQuery:251 : exactAggregation is true
> 2016-05-03 04:34:31,522 INFO [http-bio-7070-exec-3]
> v2.CubeStorageQuery:357 : Memory budget is set to: 3109290
> 2016-05-03 04:34:31,550 DEBUG [http-bio-7070-exec-3]
> v2.CubeHBaseEndpointRPC:256 : New scanner for current segment
> kylin_sales_cube[20
> 120101000000_20160501000000] will use SCAN_FILTER_AGGR_CHECKMEM as
> endpoint's behavior
> 2016-05-03 04:34:31,562 DEBUG [http-bio-7070-exec-3]
> v2.CubeHBaseEndpointRPC:291 : Serialized scanRequestBytes 321 bytes,
> rawScanBytes
> String 46 bytes
> 2016-05-03 04:34:31,562 INFO [http-bio-7070-exec-3]
> v2.CubeHBaseEndpointRPC:294 : The scan(s) info for current segment is
> as below, s
> hard part of start/end key is set to 0
> 2016-05-03 04:34:31,562 INFO [http-bio-7070-exec-3]
> v2.CubeHBaseRPC:309 : Visiting hbase table KYLIN_JFVKIFVB8S: cuboid
> exact match,
> from 64 to 64 Start:
> \x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00) Stop: \
> x00\x00\x00\x00\x00\x00\x00\x00\x00\x40\xFF\xFF\xFF\x00
> (\x00\x00\x00\x00\x00\x00\x00\x00\x00@\xFF\xFF\xFF\x00), No Fuzzy Key
> 2016-05-03 04:34:31,563 DEBUG [http-bio-7070-exec-3]
> v2.CubeHBaseEndpointRPC:300 : Submitting rpc to 1 shards starting from
> shard 0, s
> can requests count 1
> 2016-05-03 04:34:31,582 INFO [http-bio-7070-exec-3]
> v2.CubeHBaseEndpointRPC:125 : Timeout for ExpectedSizeIterator is
> 60000
> 2016-05-03 04:34:31,588 DEBUG [http-bio-7070-exec-3]
> enumerator.OLAPEnumerator:127 : return TupleIterator...
> 2016-05-03 04:34:31,592 ERROR [pool-9-thread-1]
> v2.CubeHBaseEndpointRPC:98 : Execution exception when running task in
> pool-9-thread-1
> 2016-05-03 04:34:31,592 ERROR [pool-9-thread-1]
> v2.CubeHBaseEndpointRPC:108 : Caught exception in thread
> pool-9-thread-1:
> java.lang.NullPointerException
> at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$1.run(CubeHBaseEndpointRPC.java:326)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2016-05-03 04:35:05,120 INFO [pool-1-thread-1]
> threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual
> running, 0 ready, 2
> others
> 2016-05-03 04:35:31,589 ERROR [http-bio-7070-exec-3]
> controller.QueryController:209 : Exception when execute sql
> java.sql.SQLException: Error while executing SQL "select part_dt,
> sum(price) as total_selled, count(distinct seller_id) as sellers fro
> m kylin_sales group by part_dt order by part_dt
> LIMIT 50000": Timeout visiting cube!
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143)
> at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186)
> at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:356)
> at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:272)
> at org.apache.kylin.rest.service.QueryService.query(QueryService.java:118)
> at org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:618)
> at org.apache.kylin.rest.service.QueryService$$EnhancerByCGLIB$$c9bef1fc.query(<generated>)
> at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:192)
> at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandler
> Method.java:96)
> at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandle
> rAdapter.java:617)
> at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdap
> ter.java:578)
> at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
> at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
> at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:1
> 13)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequ
> estFilter.java:54)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:150)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilt
> er.java:91)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProce
> ssingFilter.java:183)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87
> )
> at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
> at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
> at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
> at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
> at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:195)
> at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:504)
> at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
> at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
> at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421)
> at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074)
> at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611)
> at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: Timeout visiting cube!
> at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:142)
> at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:113)
> at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48)
> at com.google.common.collect.Iterators$6.hasNext(Iterators.java:583)
> at org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleIterator.hasNext(SequentialCubeTupleIterator.java:96)
> at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:74)
> at Baz$1$1.moveNext(Unknown Source)
> at org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:819)
> at org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:754)
> at org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:302)
> at Baz.bind(Unknown Source)
> at org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:326)
> at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:281)
> at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:545)
> at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:536)
> at org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:187)
> at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:65)
> at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:44)
> at org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:566)
> at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:578)
> at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:571)
> at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:135)
> ... 80 more
> 2016-05-03 04:35:31,591 INFO [http-bio-7070-exec-3]
> service.QueryService:249 :
> ==========================[QUERY]===============================
> SQL: select part_dt, sum(price) as total_selled, count(distinct
> seller_id) as sellers from kylin_sales group by part_dt order by part_
> dt
> User: ADMIN
> Success: false
> Duration: 0.0
> Project: learn_kylin
> Realization Names: [kylin_sales_cube]
> Cuboid Ids: [64]
> Total scan count: 0
> Result row count: 0
> Accept Partial: true
> Is Partial Result: false
> Hit Exception Cache: false
> Storage cache used: false
> Message: Error while executing SQL "select part_dt, sum(price) as
> total_selled, count(distinct seller_id) as sellers from kylin_sales
> group by part_dt order by part_dt LIMIT 50000": Timeout visiting cube!
> ==========================[QUERY]===============================
>
> 2016-05-03 04:35:31,592 ERROR [http-bio-7070-exec-3]
> controller.BasicController:44 :
> org.apache.kylin.rest.exception.InternalErrorException: Error while
> executing SQL "select part_dt, sum(price) as total_selled, count(d
> istinct seller_id) as sellers from kylin_sales group by part_dt order
> by part_dt LIMIT 50000": Timeout visiting cube!
> at org.apache.kylin.rest.controller.QueryController.doQueryWithCache(QueryController.java:224)
> at org.apache.kylin.rest.controller.QueryController.query(QueryController.java:94)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandler
> Method.java:96)
>
> -------------------
>
>
>
> Thanks,
>
>
> Phil