You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Chester Liu (Jira)" <ji...@apache.org> on 2020/03/06 07:50:00 UTC

[jira] [Updated] (KYLIN-4405) Internal exception when trying to build cube whose modal has null PartitionDesc

     [ https://issues.apache.org/jira/browse/KYLIN-4405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chester Liu updated KYLIN-4405:
-------------------------------
    Description: 
We are using 2.6.2 in our production environment and came upon this exception. We build our model and cube using the REST api, which allows null partitionDesc in a kylin model. However, when we try to build the cube related to the model, this exception occurs:

 

{{org.apache.kylin.rest.exception.InternalErrorException}}

{{org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:398)org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:354)}}

{{org.apache.kylin.rest.controller.CubeController.build(CubeController.java:343)}}

{{sun.reflect.GeneratedMethodAccessor233.invoke(Unknown Source)sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)}}

{{java.lang.reflect.Method.invoke(Method.java:497)}}

{{...}}

{{org.apache.kylin.cube.CubeManager$SegmentAssist.appendSegment(CubeManager.java:695)}}

{{org.apache.kylin.cube.CubeManager.appendSegment(CubeManager.java:638)}}

{{org.apache.kylin.cube.CubeManager.appendSegment(CubeManager.java:630)}}

{{org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:233)}}

{{org.apache.kylin.rest.service.JobService.submitJob(JobService.java:202)}}

{{org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394)}}



Our current solution is using a not-null partitionDesc with empty partitionDateColumn. But I think ultimately a null partitionDesc makes more sense to me when our date source is not partitioned in the first place.

I check the codebase for null-checking of partitionDesc and found several of them. So I think an extra null-check should be added.
 

  was:
We are using 2.6.2 in our production environment and came upon this exception. We build our model and cube using the REST api, which allows null partitionDesc in a kylin model. However, when we try to build the cube related to the model, this exception occurs:

 

{{org.apache.kylin.rest.exception.InternalErrorException}}

{{org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:398)org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:354)}}

{{org.apache.kylin.rest.controller.CubeController.build(CubeController.java:343)}}

{{sun.reflect.GeneratedMethodAccessor233.invoke(Unknown Source)sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)}}

{{java.lang.reflect.Method.invoke(Method.java:497)}}

{{...}}

{{org.apache.kylin.cube.CubeManager$SegmentAssist.appendSegment(CubeManager.java:695)}}

{{org.apache.kylin.cube.CubeManager.appendSegment(CubeManager.java:638)}}

{{org.apache.kylin.cube.CubeManager.appendSegment(CubeManager.java:630)}}

{{org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:233)}}

{{org.apache.kylin.rest.service.JobService.submitJob(JobService.java:202)}}

{{org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394)}}

{{}}

{{}}


> Internal exception when trying to build cube whose modal has null PartitionDesc 
> --------------------------------------------------------------------------------
>
>                 Key: KYLIN-4405
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4405
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v2.6.2
>            Reporter: Chester Liu
>            Priority: Minor
>
> We are using 2.6.2 in our production environment and came upon this exception. We build our model and cube using the REST api, which allows null partitionDesc in a kylin model. However, when we try to build the cube related to the model, this exception occurs:
>  
> {{org.apache.kylin.rest.exception.InternalErrorException}}
> {{org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:398)org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:354)}}
> {{org.apache.kylin.rest.controller.CubeController.build(CubeController.java:343)}}
> {{sun.reflect.GeneratedMethodAccessor233.invoke(Unknown Source)sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)}}
> {{java.lang.reflect.Method.invoke(Method.java:497)}}
> {{...}}
> {{org.apache.kylin.cube.CubeManager$SegmentAssist.appendSegment(CubeManager.java:695)}}
> {{org.apache.kylin.cube.CubeManager.appendSegment(CubeManager.java:638)}}
> {{org.apache.kylin.cube.CubeManager.appendSegment(CubeManager.java:630)}}
> {{org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:233)}}
> {{org.apache.kylin.rest.service.JobService.submitJob(JobService.java:202)}}
> {{org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394)}}
> Our current solution is using a not-null partitionDesc with empty partitionDateColumn. But I think ultimately a null partitionDesc makes more sense to me when our date source is not partitioned in the first place.
> I check the codebase for null-checking of partitionDesc and found several of them. So I think an extra null-check should be added.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)