You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by jianhui yi <ch...@gmail.com> on 2017/09/12 01:22:36 UTC

V1 job engine does not support building sharded cubes

Hi all
I want to use kylin 2.1 to build my streaming cube ,but when i submit build
job it happend a error "V1 job engine does not support building sharded
cubes",plz tell me how can i repair this error ,thanks

2017-09-12 09:21:18,938 ERROR [http-bio-7070-exec-23]
controller.CubeController:305 : V1 job engine does not support building
sharded cubes
java.lang.IllegalArgumentException: V1 job engine does not support building
sharded cubes
        at
com.google.common.base.Preconditions.checkArgument(Preconditions.java:92)
        at
org.apache.kylin.engine.mr.BatchCubingJobBuilder.<init>(BatchCubingJobBuilder.java:45)
        at
org.apache.kylin.engine.mr.MRBatchCubingEngine.createBatchCubingJob(MRBatchCubingEngine.java:42)
        at
org.apache.kylin.engine.EngineFactory.createBatchCubingJob(EngineFactory.java:56)
        at
org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:238)
        at
org.apache.kylin.rest.service.JobService.submitJob(JobService.java:208)
        at
org.apache.kylin.rest.service.JobService$$FastClassBySpringCGLIB$$83a44b2a.invoke(<generated>)
        at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
        at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:720)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
        at
org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
        at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:655)
        at
org.apache.kylin.rest.service.JobService$$EnhancerBySpringCGLIB$$99822bd.submitJob(<generated>)
        at
org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:302)
        at
org.apache.kylin.rest.controller.CubeController.rebuild2(CubeController.java:290)
        at
org.apache.kylin.rest.controller.CubeController.build2(CubeController.java:283)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)
        at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136)
        at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:110)
        at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:832)
        at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:743)
        at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
        at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:961)
        at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:895)
        at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:967)
        at
org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:880)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
        at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:843)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
        at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
        at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

Re: V1 job engine does not support building sharded cubes

Posted by jianhui yi <ch...@gmail.com>.
Thank you shaofeng
This hint appears when you use the UI to create a cube but do not choose to
execute the engine,I think the execution engine options is required,When
you choose, the problem is solved

2017-09-12 11:40 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:

> V1 engine has been deprecated for a long time. Since Kylin 1.5, the V2
> engine becomes the default engine. If you create Cube from Kylin GUI, there
> isn't such problem. And we plan to remove the V1 engine code totally:
> https://issues.apache.org/jira/browse/KYLIN-2797
>
> So, how did you create the Cube, from Kylin Web GUI or with your code? Can
> you share the Cube JSON for investigation?
>
> 2017-09-12 9:22 GMT+08:00 jianhui yi <ch...@gmail.com>:
>
>> Hi all
>> I want to use kylin 2.1 to build my streaming cube ,but when i submit
>> build job it happend a error "V1 job engine does not support building
>> sharded cubes",plz tell me how can i repair this error ,thanks
>>
>> 2017-09-12 09:21:18,938 ERROR [http-bio-7070-exec-23]
>> controller.CubeController:305 : V1 job engine does not support building
>> sharded cubes
>> java.lang.IllegalArgumentException: V1 job engine does not support
>> building sharded cubes
>>         at com.google.common.base.Preconditions.checkArgument(Precondit
>> ions.java:92)
>>         at org.apache.kylin.engine.mr.BatchCubingJobBuilder.<init>(Batc
>> hCubingJobBuilder.java:45)
>>         at org.apache.kylin.engine.mr.MRBatchCubingEngine.createBatchCu
>> bingJob(MRBatchCubingEngine.java:42)
>>         at org.apache.kylin.engine.EngineFactory.createBatchCubingJob(E
>> ngineFactory.java:56)
>>         at org.apache.kylin.rest.service.JobService.submitJobInternal(J
>> obService.java:238)
>>         at org.apache.kylin.rest.service.JobService.submitJob(JobServic
>> e.java:208)
>>         at org.apache.kylin.rest.service.JobService$$FastClassBySpringC
>> GLIB$$83a44b2a.invoke(<generated>)
>>         at org.springframework.cglib.proxy.MethodProxy.invoke(MethodPro
>> xy.java:204)
>>         at org.springframework.aop.framework.CglibAopProxy$CglibMethodI
>> nvocation.invokeJoinpoint(CglibAopProxy.java:720)
>>         at org.springframework.aop.framework.ReflectiveMethodInvocation
>> .proceed(ReflectiveMethodInvocation.java:157)
>>         at org.springframework.security.access.intercept.aopalliance.Me
>> thodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68)
>>         at org.springframework.aop.framework.ReflectiveMethodInvocation
>> .proceed(ReflectiveMethodInvocation.java:179)
>>         at org.springframework.aop.framework.CglibAopProxy$DynamicAdvis
>> edInterceptor.intercept(CglibAopProxy.java:655)
>>         at org.apache.kylin.rest.service.JobService$$EnhancerBySpringCG
>> LIB$$99822bd.submitJob(<generated>)
>>         at org.apache.kylin.rest.controller.CubeController.buildInterna
>> l(CubeController.java:302)
>>         at org.apache.kylin.rest.controller.CubeController.rebuild2(
>> CubeController.java:290)
>>         at org.apache.kylin.rest.controller.CubeController.build2(
>> CubeController.java:283)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAcce
>> ssorImpl.java:57)
>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe
>> thodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:606)
>>         at org.springframework.web.method.support.InvocableHandlerMetho
>> d.doInvoke(InvocableHandlerMethod.java:221)
>>         at org.springframework.web.method.support.InvocableHandlerMetho
>> d.invokeForRequest(InvocableHandlerMethod.java:136)
>>         at org.springframework.web.servlet.mvc.method.annotation.Servle
>> tInvocableHandlerMethod.invokeAndHandle(ServletInvocableHand
>> lerMethod.java:110)
>>         at org.springframework.web.servlet.mvc.method.annotation.Reques
>> tMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHan
>> dlerAdapter.java:832)
>>         at org.springframework.web.servlet.mvc.method.annotation.Reques
>> tMappingHandlerAdapter.handleInternal(RequestMappingHandlerA
>> dapter.java:743)
>>         at org.springframework.web.servlet.mvc.method.AbstractHandlerMe
>> thodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
>>         at org.springframework.web.servlet.DispatcherServlet.doDispatch
>> (DispatcherServlet.java:961)
>>         at org.springframework.web.servlet.DispatcherServlet.doService(
>> DispatcherServlet.java:895)
>>         at org.springframework.web.servlet.FrameworkServlet.processRequ
>> est(FrameworkServlet.java:967)
>>         at org.springframework.web.servlet.FrameworkServlet.doPut(
>> FrameworkServlet.java:880)
>>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
>>         at org.springframework.web.servlet.FrameworkServlet.service(
>> FrameworkServlet.java:843)
>>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
>>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>> lter(ApplicationFilterChain.java:303)
>>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(App
>> licationFilterChain.java:208)
>>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilte
>> r.java:52)
>>         at org.apache.catalina.core.ApplicationFilterChain.internalDoFi
>> lter(ApplicationFilterChain.java:241)
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>

Re: V1 job engine does not support building sharded cubes

Posted by ShaoFeng Shi <sh...@apache.org>.
V1 engine has been deprecated for a long time. Since Kylin 1.5, the V2
engine becomes the default engine. If you create Cube from Kylin GUI, there
isn't such problem. And we plan to remove the V1 engine code totally:
https://issues.apache.org/jira/browse/KYLIN-2797

So, how did you create the Cube, from Kylin Web GUI or with your code? Can
you share the Cube JSON for investigation?

2017-09-12 9:22 GMT+08:00 jianhui yi <ch...@gmail.com>:

> Hi all
> I want to use kylin 2.1 to build my streaming cube ,but when i submit
> build job it happend a error "V1 job engine does not support building
> sharded cubes",plz tell me how can i repair this error ,thanks
>
> 2017-09-12 09:21:18,938 ERROR [http-bio-7070-exec-23]
> controller.CubeController:305 : V1 job engine does not support building
> sharded cubes
> java.lang.IllegalArgumentException: V1 job engine does not support
> building sharded cubes
>         at com.google.common.base.Preconditions.checkArgument(
> Preconditions.java:92)
>         at org.apache.kylin.engine.mr.BatchCubingJobBuilder.<init>(
> BatchCubingJobBuilder.java:45)
>         at org.apache.kylin.engine.mr.MRBatchCubingEngine.
> createBatchCubingJob(MRBatchCubingEngine.java:42)
>         at org.apache.kylin.engine.EngineFactory.createBatchCubingJob(
> EngineFactory.java:56)
>         at org.apache.kylin.rest.service.JobService.submitJobInternal(
> JobService.java:238)
>         at org.apache.kylin.rest.service.JobService.submitJob(
> JobService.java:208)
>         at org.apache.kylin.rest.service.JobService$$
> FastClassBySpringCGLIB$$83a44b2a.invoke(<generated>)
>         at org.springframework.cglib.proxy.MethodProxy.invoke(
> MethodProxy.java:204)
>         at org.springframework.aop.framework.CglibAopProxy$
> CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:720)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:157)
>         at org.springframework.security.access.intercept.aopalliance.
> MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68)
>         at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:179)
>         at org.springframework.aop.framework.CglibAopProxy$
> DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:655)
>         at org.apache.kylin.rest.service.JobService$$
> EnhancerBySpringCGLIB$$99822bd.submitJob(<generated>)
>         at org.apache.kylin.rest.controller.CubeController.
> buildInternal(CubeController.java:302)
>         at org.apache.kylin.rest.controller.CubeController.
> rebuild2(CubeController.java:290)
>         at org.apache.kylin.rest.controller.CubeController.
> build2(CubeController.java:283)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at org.springframework.web.method.support.InvocableHandlerMethod.
> doInvoke(InvocableHandlerMethod.java:221)
>         at org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:136)
>         at org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:110)
>         at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandlerMethod(
> RequestMappingHandlerAdapter.java:832)
>         at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:743)
>         at org.springframework.web.servlet.mvc.method.
> AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
>         at org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:961)
>         at org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:895)
>         at org.springframework.web.servlet.FrameworkServlet.
> processRequest(FrameworkServlet.java:967)
>         at org.springframework.web.servlet.FrameworkServlet.
> doPut(FrameworkServlet.java:880)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
>         at org.springframework.web.servlet.FrameworkServlet.
> service(FrameworkServlet.java:843)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
>         at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:303)
>         at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>         at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>         at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>


-- 
Best regards,

Shaofeng Shi 史少锋