You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by yu feng <ol...@gmail.com> on 2015/09/09 11:29:32 UTC

IllegalArgumentException happened while creating new cube

Hi
    I am trying to create a cube with 15 dimensions and 7 measures, But I
get IllegalArgumentException when saving this cube , Web UI has been
blocking for last 20 minutes. I check log find those :

[http-bio-7070-exec-2]:[2015-09-09
17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
- wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
[http-bio-7070-exec-2]:[2015-09-09
17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
- clean query cache...
[http-bio-7070-exec-2]:[2015-09-09
17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
- REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-7]:[2015-09-09
17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
- Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
kylin_metadata_1.0@hbase)
[pool-8-thread-1]:[2015-09-09
17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
- new broadcast event:BroadcastEvent{type=cube_desc,
name=NOS_CUBE_STATISTICS, action=create}
[http-bio-7070-exec-2]:[2015-09-09
17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
- wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
[http-bio-7070-exec-2]:[2015-09-09
17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
- Initializing CubeDescManager with config kylin_metadata_1.0@hbase
[http-bio-7070-exec-2]:[2015-09-09
17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
- Reloading Cube Metadata from folder
kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
[http-bio-7070-exec-2]:[2015-09-09
17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
- Loaded 3 Cube(s)
[http-bio-7070-exec-2]:[2015-09-09
17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
- clean query cache...
[http-bio-7070-exec-2]:[2015-09-09
17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
- REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[pool-6-thread-1]:[2015-09-09
17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
^[[B^[[A[pool-6-thread-1]:[2015-09-09
17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
[http-bio-7070-exec-10]:[2015-09-09
17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
- REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-3]:[2015-09-09
17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
- Get Kylin Runtime Config
[http-bio-7070-exec-3]:[2015-09-09
17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
- REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-8]:[2015-09-09
17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
- REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
[http-bio-7070-exec-9]:[2015-09-09
17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
- Loading L2 project cache for _null
[http-bio-7070-exec-9]:[2015-09-09
17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
- Failed to deal with the request.
java.lang.IllegalArgumentException: Project '_null' does not exist;
at
org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
at
org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
at
org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
at
org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
at
org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)


cube infomations in json like this :

{
  "name": "NOS_CUBE_STATISTICS",
  "description": "",
  "dimensions": [
    ...............
  ],
  "measures": [
    ...............
  ],
  "rowkey": {
    ...............
    ],
    "aggregation_groups": [
      [
        ..............
      ]
    ]
  },
  "notify_list": [],
  "capacity": "",
  "hbase_mapping": {
    "column_family": [
      {
        "name": "f1",
        "columns": [
          {
            "qualifier": "m",
            "measure_refs": [
              "_COUNT_",
              "DataSize",
              "UploaderCostTime",
              "LbsCostTime",
              "UploaderRetryCount",
              "ChunkRetryCount",
              "QueryRetryCount"
            ]
          }
        ]
      }
    ]
  },
  "retentionRange": "0",
  "project": "NOS_ANALYTICS_PROJECT",
  "model_name": "NOS_CUBE_STATISTICS"
}

Re: IllegalArgumentException happened while creating new cube

Posted by yu feng <ol...@gmail.com>.
OK, I do 'Ctrl + F5' some minutes before I create the cube , maybe it has
some effects..Thanks anyway..

2015-09-10 13:27 GMT+08:00 Jian Zhong <he...@gmail.com>:

> I build 1.0 again and tested,can't reproduce, may be it's browser cache
> issue, I suggest you clear cache and see if this will happen. :)
>
> On Thu, Sep 10, 2015 at 11:05 AM, yu feng <ol...@gmail.com> wrote:
>
> > I use kylin 1.0 and download source code from tag in github, I modify
> some
> > code such as add patch support different HDFS of hbase and
> > mapreduce、getting status from RM with kerberos、upload all jar to HDFS
> > before submit mapreduce job... I think those change will not cause this
> > exception..
> >
> > I felt werid that the cube is created and the web UI is blocking until
> > refresh it ...
> >
> > 2015-09-10 10:41 GMT+08:00 Jian Zhong <he...@gmail.com>:
> >
> > > Hi, may I know which version are you using, this issue has been fixed
> > month
> > > ago, are you building it yourself on staging branch?
> > >
> > > On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:
> > >
> > > > From the attached log, what I can tell is it has nothing to do with
> > cube
> > > > creation. Cube was created successfully, then you navigated to
> "Tables"
> > > > tab, and the strange thing is "java.lang.IllegalArgumentException:
> > > Project
> > > > '_null' does not exist;"
> > > >
> > > > Seems front-end passed a strange project name "_null" to /api/tables.
> > > >
> > > > Best Regards,
> > > > Dayue
> > > >
> > > > > 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
> > > > >
> > > > > However, After I refresh this page and find the cube has been
> created
> > > !!!
> > > > >
> > > > > 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
> > > > >
> > > > >> Hi
> > > > >>    I am trying to create a cube with 15 dimensions and 7 measures,
> > > But I
> > > > >> get IllegalArgumentException when saving this cube , Web UI has
> been
> > > > >> blocking for last 20 minutes. I check log find those :
> > > > >>
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> > > > >> - wipe cache type: DATA_MODEL event:CREATE
> name:NOS_CUBE_STATISTICS
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> > > > >> - clean query cache...
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > > >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> > > > >>
> > > >
> > >
> >
> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > > >> [http-bio-7070-exec-7]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> > > > >> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
> > > > >> kylin_metadata_1.0@hbase)
> > > > >> [pool-8-thread-1]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
> > > > >> - new broadcast event:BroadcastEvent{type=cube_desc,
> > > > >> name=NOS_CUBE_STATISTICS, action=create}
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> > > > >> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
> > > > >> - Initializing CubeDescManager with config
> kylin_metadata_1.0@hbase
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
> > > > >> - Reloading Cube Metadata from folder
> > > > >> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
> > > > >> - Loaded 3 Cube(s)
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> > > > >> - clean query cache...
> > > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > > >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> > > > >>
> > > >
> > >
> >
> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > > >> [pool-6-thread-1]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> > > > >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> > > > >> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> > > > >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> > > > >> [http-bio-7070-exec-10]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > > > >>
> > > >
> > >
> >
> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > > >> [http-bio-7070-exec-3]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
> > > > >> - Get Kylin Runtime Config
> > > > >> [http-bio-7070-exec-3]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > > > >>
> > > >
> > >
> >
> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > > >> [http-bio-7070-exec-8]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > > > >>
> > > >
> > >
> >
> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > > >> [http-bio-7070-exec-9]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
> > > > >> - Loading L2 project cache for _null
> > > > >> [http-bio-7070-exec-9]:[2015-09-09
> > > > >>
> > > >
> > >
> >
> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> > > > >> - Failed to deal with the request.
> > > > >> java.lang.IllegalArgumentException: Project '_null' does not
> exist;
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
> > > > >> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > >> at java.lang.reflect.Method.invoke(Method.java:606)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> > > > >> at
> > > > >>
> > > >
> > >
> >
> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
> > > > >>
> > > > >>
> > > > >> cube infomations in json like this :
> > > > >>
> > > > >> {
> > > > >>  "name": "NOS_CUBE_STATISTICS",
> > > > >>  "description": "",
> > > > >>  "dimensions": [
> > > > >>    ...............
> > > > >>  ],
> > > > >>  "measures": [
> > > > >>    ...............
> > > > >>  ],
> > > > >>  "rowkey": {
> > > > >>    ...............
> > > > >>    ],
> > > > >>    "aggregation_groups": [
> > > > >>      [
> > > > >>        ..............
> > > > >>      ]
> > > > >>    ]
> > > > >>  },
> > > > >>  "notify_list": [],
> > > > >>  "capacity": "",
> > > > >>  "hbase_mapping": {
> > > > >>    "column_family": [
> > > > >>      {
> > > > >>        "name": "f1",
> > > > >>        "columns": [
> > > > >>          {
> > > > >>            "qualifier": "m",
> > > > >>            "measure_refs": [
> > > > >>              "_COUNT_",
> > > > >>              "DataSize",
> > > > >>              "UploaderCostTime",
> > > > >>              "LbsCostTime",
> > > > >>              "UploaderRetryCount",
> > > > >>              "ChunkRetryCount",
> > > > >>              "QueryRetryCount"
> > > > >>            ]
> > > > >>          }
> > > > >>        ]
> > > > >>      }
> > > > >>    ]
> > > > >>  },
> > > > >>  "retentionRange": "0",
> > > > >>  "project": "NOS_ANALYTICS_PROJECT",
> > > > >>  "model_name": "NOS_CUBE_STATISTICS"
> > > > >> }
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > >
> >
>

Re: IllegalArgumentException happened while creating new cube

Posted by Jian Zhong <he...@gmail.com>.
I build 1.0 again and tested,can't reproduce, may be it's browser cache
issue, I suggest you clear cache and see if this will happen. :)

On Thu, Sep 10, 2015 at 11:05 AM, yu feng <ol...@gmail.com> wrote:

> I use kylin 1.0 and download source code from tag in github, I modify some
> code such as add patch support different HDFS of hbase and
> mapreduce、getting status from RM with kerberos、upload all jar to HDFS
> before submit mapreduce job... I think those change will not cause this
> exception..
>
> I felt werid that the cube is created and the web UI is blocking until
> refresh it ...
>
> 2015-09-10 10:41 GMT+08:00 Jian Zhong <he...@gmail.com>:
>
> > Hi, may I know which version are you using, this issue has been fixed
> month
> > ago, are you building it yourself on staging branch?
> >
> > On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:
> >
> > > From the attached log, what I can tell is it has nothing to do with
> cube
> > > creation. Cube was created successfully, then you navigated to "Tables"
> > > tab, and the strange thing is "java.lang.IllegalArgumentException:
> > Project
> > > '_null' does not exist;"
> > >
> > > Seems front-end passed a strange project name "_null" to /api/tables.
> > >
> > > Best Regards,
> > > Dayue
> > >
> > > > 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
> > > >
> > > > However, After I refresh this page and find the cube has been created
> > !!!
> > > >
> > > > 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
> > > >
> > > >> Hi
> > > >>    I am trying to create a cube with 15 dimensions and 7 measures,
> > But I
> > > >> get IllegalArgumentException when saving this cube , Web UI has been
> > > >> blocking for last 20 minutes. I check log find those :
> > > >>
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> > > >> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> > > >> - clean query cache...
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> > > >>
> > >
> >
> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > >> [http-bio-7070-exec-7]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> > > >> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
> > > >> kylin_metadata_1.0@hbase)
> > > >> [pool-8-thread-1]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
> > > >> - new broadcast event:BroadcastEvent{type=cube_desc,
> > > >> name=NOS_CUBE_STATISTICS, action=create}
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> > > >> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
> > > >> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
> > > >> - Reloading Cube Metadata from folder
> > > >> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
> > > >> - Loaded 3 Cube(s)
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> > > >> - clean query cache...
> > > >> [http-bio-7070-exec-2]:[2015-09-09
> > > >>
> > >
> >
> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> > > >>
> > >
> >
> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > >> [pool-6-thread-1]:[2015-09-09
> > > >>
> > >
> >
> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> > > >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> > > >> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
> > > >>
> > >
> >
> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> > > >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> > > >> [http-bio-7070-exec-10]:[2015-09-09
> > > >>
> > >
> >
> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > > >>
> > >
> >
> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > >> [http-bio-7070-exec-3]:[2015-09-09
> > > >>
> > >
> >
> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
> > > >> - Get Kylin Runtime Config
> > > >> [http-bio-7070-exec-3]:[2015-09-09
> > > >>
> > >
> >
> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > > >>
> > >
> >
> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > >> [http-bio-7070-exec-8]:[2015-09-09
> > > >>
> > >
> >
> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > > >>
> > >
> >
> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > > >> [http-bio-7070-exec-9]:[2015-09-09
> > > >>
> > >
> >
> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
> > > >> - Loading L2 project cache for _null
> > > >> [http-bio-7070-exec-9]:[2015-09-09
> > > >>
> > >
> >
> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> > > >> - Failed to deal with the request.
> > > >> java.lang.IllegalArgumentException: Project '_null' does not exist;
> > > >> at
> > > >>
> > >
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
> > > >> at
> > > >>
> > >
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
> > > >> at
> > > >>
> > >
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
> > > >> at
> > > >>
> > >
> >
> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
> > > >> at
> > > >>
> > >
> >
> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
> > > >> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
> > > >> at
> > > >>
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > >> at java.lang.reflect.Method.invoke(Method.java:606)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> > > >> at
> > > >>
> > >
> >
> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
> > > >>
> > > >>
> > > >> cube infomations in json like this :
> > > >>
> > > >> {
> > > >>  "name": "NOS_CUBE_STATISTICS",
> > > >>  "description": "",
> > > >>  "dimensions": [
> > > >>    ...............
> > > >>  ],
> > > >>  "measures": [
> > > >>    ...............
> > > >>  ],
> > > >>  "rowkey": {
> > > >>    ...............
> > > >>    ],
> > > >>    "aggregation_groups": [
> > > >>      [
> > > >>        ..............
> > > >>      ]
> > > >>    ]
> > > >>  },
> > > >>  "notify_list": [],
> > > >>  "capacity": "",
> > > >>  "hbase_mapping": {
> > > >>    "column_family": [
> > > >>      {
> > > >>        "name": "f1",
> > > >>        "columns": [
> > > >>          {
> > > >>            "qualifier": "m",
> > > >>            "measure_refs": [
> > > >>              "_COUNT_",
> > > >>              "DataSize",
> > > >>              "UploaderCostTime",
> > > >>              "LbsCostTime",
> > > >>              "UploaderRetryCount",
> > > >>              "ChunkRetryCount",
> > > >>              "QueryRetryCount"
> > > >>            ]
> > > >>          }
> > > >>        ]
> > > >>      }
> > > >>    ]
> > > >>  },
> > > >>  "retentionRange": "0",
> > > >>  "project": "NOS_ANALYTICS_PROJECT",
> > > >>  "model_name": "NOS_CUBE_STATISTICS"
> > > >> }
> > > >>
> > > >>
> > >
> > >
> > >
> >
>

Re: IllegalArgumentException happened while creating new cube

Posted by yu feng <ol...@gmail.com>.
I use kylin 1.0 and download source code from tag in github, I modify some
code such as add patch support different HDFS of hbase and
mapreduce、getting status from RM with kerberos、upload all jar to HDFS
before submit mapreduce job... I think those change will not cause this
exception..

I felt werid that the cube is created and the web UI is blocking until
refresh it ...

2015-09-10 10:41 GMT+08:00 Jian Zhong <he...@gmail.com>:

> Hi, may I know which version are you using, this issue has been fixed month
> ago, are you building it yourself on staging branch?
>
> On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:
>
> > From the attached log, what I can tell is it has nothing to do with cube
> > creation. Cube was created successfully, then you navigated to "Tables"
> > tab, and the strange thing is "java.lang.IllegalArgumentException:
> Project
> > '_null' does not exist;"
> >
> > Seems front-end passed a strange project name "_null" to /api/tables.
> >
> > Best Regards,
> > Dayue
> >
> > > 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
> > >
> > > However, After I refresh this page and find the cube has been created
> !!!
> > >
> > > 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
> > >
> > >> Hi
> > >>    I am trying to create a cube with 15 dimensions and 7 measures,
> But I
> > >> get IllegalArgumentException when saving this cube , Web UI has been
> > >> blocking for last 20 minutes. I check log find those :
> > >>
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> > >> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> > >> - clean query cache...
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> > >>
> >
> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > >> [http-bio-7070-exec-7]:[2015-09-09
> > >>
> >
> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> > >> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
> > >> kylin_metadata_1.0@hbase)
> > >> [pool-8-thread-1]:[2015-09-09
> > >>
> >
> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
> > >> - new broadcast event:BroadcastEvent{type=cube_desc,
> > >> name=NOS_CUBE_STATISTICS, action=create}
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> > >> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
> > >> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
> > >> - Reloading Cube Metadata from folder
> > >> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
> > >> - Loaded 3 Cube(s)
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> > >> - clean query cache...
> > >> [http-bio-7070-exec-2]:[2015-09-09
> > >>
> >
> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> > >>
> >
> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > >> [pool-6-thread-1]:[2015-09-09
> > >>
> >
> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> > >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> > >> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
> > >>
> >
> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> > >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> > >> [http-bio-7070-exec-10]:[2015-09-09
> > >>
> >
> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > >>
> >
> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > >> [http-bio-7070-exec-3]:[2015-09-09
> > >>
> >
> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
> > >> - Get Kylin Runtime Config
> > >> [http-bio-7070-exec-3]:[2015-09-09
> > >>
> >
> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > >>
> >
> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > >> [http-bio-7070-exec-8]:[2015-09-09
> > >>
> >
> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> > >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> > >>
> >
> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> > >> [http-bio-7070-exec-9]:[2015-09-09
> > >>
> >
> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
> > >> - Loading L2 project cache for _null
> > >> [http-bio-7070-exec-9]:[2015-09-09
> > >>
> >
> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> > >> - Failed to deal with the request.
> > >> java.lang.IllegalArgumentException: Project '_null' does not exist;
> > >> at
> > >>
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
> > >> at
> > >>
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
> > >> at
> > >>
> >
> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
> > >> at
> > >>
> >
> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
> > >> at
> > >>
> >
> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
> > >> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
> > >> at
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >> at java.lang.reflect.Method.invoke(Method.java:606)
> > >> at
> > >>
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> > >> at
> > >>
> >
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> > >> at
> > >>
> >
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> > >> at
> > >>
> >
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
> > >> at
> > >>
> >
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
> > >> at
> > >>
> >
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> > >> at
> > >>
> >
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> > >> at
> > >>
> >
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> > >> at
> > >>
> >
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> > >> at
> > >>
> >
> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
> > >>
> > >>
> > >> cube infomations in json like this :
> > >>
> > >> {
> > >>  "name": "NOS_CUBE_STATISTICS",
> > >>  "description": "",
> > >>  "dimensions": [
> > >>    ...............
> > >>  ],
> > >>  "measures": [
> > >>    ...............
> > >>  ],
> > >>  "rowkey": {
> > >>    ...............
> > >>    ],
> > >>    "aggregation_groups": [
> > >>      [
> > >>        ..............
> > >>      ]
> > >>    ]
> > >>  },
> > >>  "notify_list": [],
> > >>  "capacity": "",
> > >>  "hbase_mapping": {
> > >>    "column_family": [
> > >>      {
> > >>        "name": "f1",
> > >>        "columns": [
> > >>          {
> > >>            "qualifier": "m",
> > >>            "measure_refs": [
> > >>              "_COUNT_",
> > >>              "DataSize",
> > >>              "UploaderCostTime",
> > >>              "LbsCostTime",
> > >>              "UploaderRetryCount",
> > >>              "ChunkRetryCount",
> > >>              "QueryRetryCount"
> > >>            ]
> > >>          }
> > >>        ]
> > >>      }
> > >>    ]
> > >>  },
> > >>  "retentionRange": "0",
> > >>  "project": "NOS_ANALYTICS_PROJECT",
> > >>  "model_name": "NOS_CUBE_STATISTICS"
> > >> }
> > >>
> > >>
> >
> >
> >
>

Re: IllegalArgumentException happened while creating new cube

Posted by Jian Zhong <he...@gmail.com>.
Hi dayue,

thank you for reporting this, commit here, after this commit, will not send
'_null' to backend,it's only a workaround to deal some angularjs issue,need
to do some enhancement,but anyway it's not supposed to throw exception
again. please help double confirm that.

after kylin new version deployed, need to clear browser cache.

https://github.com/apache/incubator-kylin/commit/39bd19a9dd0d3c1fcb86a312775c8d70211339d7

On Thu, Sep 10, 2015 at 2:34 PM, Dayue Gao <da...@163.com> wrote:

> Hi Jian Zhong,
>
> Our user reported the same problem when creating project today. Could you
> provide a link to the commit which fixing this bug?
>
> Thanks,
> Dayue
>
> > 在 2015年9月10日,上午10:41,Jian Zhong <he...@gmail.com> 写道:
> >
> > Hi, may I know which version are you using, this issue has been fixed
> month
> > ago, are you building it yourself on staging branch?
> >
> > On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:
> >
> >> From the attached log, what I can tell is it has nothing to do with cube
> >> creation. Cube was created successfully, then you navigated to "Tables"
> >> tab, and the strange thing is "java.lang.IllegalArgumentException:
> Project
> >> '_null' does not exist;"
> >>
> >> Seems front-end passed a strange project name "_null" to /api/tables.
> >>
> >> Best Regards,
> >> Dayue
> >>
> >>> 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
> >>>
> >>> However, After I refresh this page and find the cube has been created
> !!!
> >>>
> >>> 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
> >>>
> >>>> Hi
> >>>>   I am trying to create a cube with 15 dimensions and 7 measures, But
> I
> >>>> get IllegalArgumentException when saving this cube , Web UI has been
> >>>> blocking for last 20 minutes. I check log find those :
> >>>>
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> >>>> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> >>>> - clean query cache...
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >>>> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> >>>>
> >>
> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >>>> [http-bio-7070-exec-7]:[2015-09-09
> >>>>
> >>
> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> >>>> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
> >>>> kylin_metadata_1.0@hbase)
> >>>> [pool-8-thread-1]:[2015-09-09
> >>>>
> >>
> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
> >>>> - new broadcast event:BroadcastEvent{type=cube_desc,
> >>>> name=NOS_CUBE_STATISTICS, action=create}
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> >>>> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
> >>>> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
> >>>> - Reloading Cube Metadata from folder
> >>>> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
> >>>> - Loaded 3 Cube(s)
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> >>>> - clean query cache...
> >>>> [http-bio-7070-exec-2]:[2015-09-09
> >>>>
> >>
> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >>>> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> >>>>
> >>
> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >>>> [pool-6-thread-1]:[2015-09-09
> >>>>
> >>
> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> >>>> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> >>>> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
> >>>>
> >>
> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> >>>> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> >>>> [http-bio-7070-exec-10]:[2015-09-09
> >>>>
> >>
> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >>>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> >>>>
> >>
> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >>>> [http-bio-7070-exec-3]:[2015-09-09
> >>>>
> >>
> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
> >>>> - Get Kylin Runtime Config
> >>>> [http-bio-7070-exec-3]:[2015-09-09
> >>>>
> >>
> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >>>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> >>>>
> >>
> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >>>> [http-bio-7070-exec-8]:[2015-09-09
> >>>>
> >>
> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >>>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> >>>>
> >>
> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >>>> [http-bio-7070-exec-9]:[2015-09-09
> >>>>
> >>
> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
> >>>> - Loading L2 project cache for _null
> >>>> [http-bio-7070-exec-9]:[2015-09-09
> >>>>
> >>
> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> >>>> - Failed to deal with the request.
> >>>> java.lang.IllegalArgumentException: Project '_null' does not exist;
> >>>> at
> >>>>
> >>
> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
> >>>> at
> >>>>
> >>
> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
> >>>> at
> >>>>
> >>
> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
> >>>> at
> >>>>
> >>
> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
> >>>> at
> >>>>
> >>
> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
> >>>> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
> >>>> at
> >>>>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>>> at java.lang.reflect.Method.invoke(Method.java:606)
> >>>> at
> >>>>
> >>
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> >>>> at
> >>>>
> >>
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> >>>> at
> >>>>
> >>
> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
> >>>>
> >>>>
> >>>> cube infomations in json like this :
> >>>>
> >>>> {
> >>>> "name": "NOS_CUBE_STATISTICS",
> >>>> "description": "",
> >>>> "dimensions": [
> >>>>   ...............
> >>>> ],
> >>>> "measures": [
> >>>>   ...............
> >>>> ],
> >>>> "rowkey": {
> >>>>   ...............
> >>>>   ],
> >>>>   "aggregation_groups": [
> >>>>     [
> >>>>       ..............
> >>>>     ]
> >>>>   ]
> >>>> },
> >>>> "notify_list": [],
> >>>> "capacity": "",
> >>>> "hbase_mapping": {
> >>>>   "column_family": [
> >>>>     {
> >>>>       "name": "f1",
> >>>>       "columns": [
> >>>>         {
> >>>>           "qualifier": "m",
> >>>>           "measure_refs": [
> >>>>             "_COUNT_",
> >>>>             "DataSize",
> >>>>             "UploaderCostTime",
> >>>>             "LbsCostTime",
> >>>>             "UploaderRetryCount",
> >>>>             "ChunkRetryCount",
> >>>>             "QueryRetryCount"
> >>>>           ]
> >>>>         }
> >>>>       ]
> >>>>     }
> >>>>   ]
> >>>> },
> >>>> "retentionRange": "0",
> >>>> "project": "NOS_ANALYTICS_PROJECT",
> >>>> "model_name": "NOS_CUBE_STATISTICS"
> >>>> }
> >>>>
> >>>>
> >>
> >>
> >>
>
>
>

Re: IllegalArgumentException happened while creating new cube

Posted by Dayue Gao <da...@163.com>.
Hi Jian Zhong,

Our user reported the same problem when creating project today. Could you provide a link to the commit which fixing this bug?

Thanks,
Dayue

> 在 2015年9月10日,上午10:41,Jian Zhong <he...@gmail.com> 写道:
> 
> Hi, may I know which version are you using, this issue has been fixed month
> ago, are you building it yourself on staging branch?
> 
> On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:
> 
>> From the attached log, what I can tell is it has nothing to do with cube
>> creation. Cube was created successfully, then you navigated to "Tables"
>> tab, and the strange thing is "java.lang.IllegalArgumentException: Project
>> '_null' does not exist;"
>> 
>> Seems front-end passed a strange project name "_null" to /api/tables.
>> 
>> Best Regards,
>> Dayue
>> 
>>> 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
>>> 
>>> However, After I refresh this page and find the cube has been created !!!
>>> 
>>> 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
>>> 
>>>> Hi
>>>>   I am trying to create a cube with 15 dimensions and 7 measures, But I
>>>> get IllegalArgumentException when saving this cube , Web UI has been
>>>> blocking for last 20 minutes. I check log find those :
>>>> 
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
>>>> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
>>>> - clean query cache...
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>>>> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
>>>> 
>> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>>>> [http-bio-7070-exec-7]:[2015-09-09
>>>> 
>> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
>>>> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
>>>> kylin_metadata_1.0@hbase)
>>>> [pool-8-thread-1]:[2015-09-09
>>>> 
>> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
>>>> - new broadcast event:BroadcastEvent{type=cube_desc,
>>>> name=NOS_CUBE_STATISTICS, action=create}
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
>>>> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
>>>> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
>>>> - Reloading Cube Metadata from folder
>>>> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
>>>> - Loaded 3 Cube(s)
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
>>>> - clean query cache...
>>>> [http-bio-7070-exec-2]:[2015-09-09
>>>> 
>> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>>>> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
>>>> 
>> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>>>> [pool-6-thread-1]:[2015-09-09
>>>> 
>> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
>>>> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
>>>> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
>>>> 
>> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
>>>> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
>>>> [http-bio-7070-exec-10]:[2015-09-09
>>>> 
>> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>>>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>>>> 
>> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>>>> [http-bio-7070-exec-3]:[2015-09-09
>>>> 
>> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
>>>> - Get Kylin Runtime Config
>>>> [http-bio-7070-exec-3]:[2015-09-09
>>>> 
>> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>>>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>>>> 
>> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>>>> [http-bio-7070-exec-8]:[2015-09-09
>>>> 
>> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>>>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>>>> 
>> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>>>> [http-bio-7070-exec-9]:[2015-09-09
>>>> 
>> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
>>>> - Loading L2 project cache for _null
>>>> [http-bio-7070-exec-9]:[2015-09-09
>>>> 
>> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
>>>> - Failed to deal with the request.
>>>> java.lang.IllegalArgumentException: Project '_null' does not exist;
>>>> at
>>>> 
>> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
>>>> at
>>>> 
>> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
>>>> at
>>>> 
>> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
>>>> at
>>>> 
>> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
>>>> at
>>>> 
>> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
>>>> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>>>> at
>>>> 
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>> 
>> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
>>>> at
>>>> 
>> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
>>>> at
>>>> 
>> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
>>>> at
>>>> 
>> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
>>>> at
>>>> 
>> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
>>>> at
>>>> 
>> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
>>>> at
>>>> 
>> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
>>>> at
>>>> 
>> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
>>>> at
>>>> 
>> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
>>>> at
>>>> 
>> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
>>>> 
>>>> 
>>>> cube infomations in json like this :
>>>> 
>>>> {
>>>> "name": "NOS_CUBE_STATISTICS",
>>>> "description": "",
>>>> "dimensions": [
>>>>   ...............
>>>> ],
>>>> "measures": [
>>>>   ...............
>>>> ],
>>>> "rowkey": {
>>>>   ...............
>>>>   ],
>>>>   "aggregation_groups": [
>>>>     [
>>>>       ..............
>>>>     ]
>>>>   ]
>>>> },
>>>> "notify_list": [],
>>>> "capacity": "",
>>>> "hbase_mapping": {
>>>>   "column_family": [
>>>>     {
>>>>       "name": "f1",
>>>>       "columns": [
>>>>         {
>>>>           "qualifier": "m",
>>>>           "measure_refs": [
>>>>             "_COUNT_",
>>>>             "DataSize",
>>>>             "UploaderCostTime",
>>>>             "LbsCostTime",
>>>>             "UploaderRetryCount",
>>>>             "ChunkRetryCount",
>>>>             "QueryRetryCount"
>>>>           ]
>>>>         }
>>>>       ]
>>>>     }
>>>>   ]
>>>> },
>>>> "retentionRange": "0",
>>>> "project": "NOS_ANALYTICS_PROJECT",
>>>> "model_name": "NOS_CUBE_STATISTICS"
>>>> }
>>>> 
>>>> 
>> 
>> 
>> 



Re: IllegalArgumentException happened while creating new cube

Posted by Jian Zhong <he...@gmail.com>.
@yufeng

On Thu, Sep 10, 2015 at 10:41 AM, Jian Zhong <he...@gmail.com> wrote:

> Hi, may I know which version are you using, this issue has been fixed
> month ago, are you building it yourself on staging branch?
>
> On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:
>
>> From the attached log, what I can tell is it has nothing to do with cube
>> creation. Cube was created successfully, then you navigated to "Tables"
>> tab, and the strange thing is "java.lang.IllegalArgumentException: Project
>> '_null' does not exist;"
>>
>> Seems front-end passed a strange project name "_null" to /api/tables.
>>
>> Best Regards,
>> Dayue
>>
>> > 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
>> >
>> > However, After I refresh this page and find the cube has been created
>> !!!
>> >
>> > 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
>> >
>> >> Hi
>> >>    I am trying to create a cube with 15 dimensions and 7 measures, But
>> I
>> >> get IllegalArgumentException when saving this cube , Web UI has been
>> >> blocking for last 20 minutes. I check log find those :
>> >>
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
>> >> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
>> >> - clean query cache...
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
>> >>
>> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> >> [http-bio-7070-exec-7]:[2015-09-09
>> >>
>> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
>> >> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
>> >> kylin_metadata_1.0@hbase)
>> >> [pool-8-thread-1]:[2015-09-09
>> >>
>> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
>> >> - new broadcast event:BroadcastEvent{type=cube_desc,
>> >> name=NOS_CUBE_STATISTICS, action=create}
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
>> >> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
>> >> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
>> >> - Reloading Cube Metadata from folder
>> >> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
>> >> - Loaded 3 Cube(s)
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
>> >> - clean query cache...
>> >> [http-bio-7070-exec-2]:[2015-09-09
>> >>
>> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
>> >>
>> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> >> [pool-6-thread-1]:[2015-09-09
>> >>
>> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
>> >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
>> >> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
>> >>
>> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
>> >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
>> >> [http-bio-7070-exec-10]:[2015-09-09
>> >>
>> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>> >>
>> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> >> [http-bio-7070-exec-3]:[2015-09-09
>> >>
>> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
>> >> - Get Kylin Runtime Config
>> >> [http-bio-7070-exec-3]:[2015-09-09
>> >>
>> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>> >>
>> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> >> [http-bio-7070-exec-8]:[2015-09-09
>> >>
>> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>> >>
>> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> >> [http-bio-7070-exec-9]:[2015-09-09
>> >>
>> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
>> >> - Loading L2 project cache for _null
>> >> [http-bio-7070-exec-9]:[2015-09-09
>> >>
>> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
>> >> - Failed to deal with the request.
>> >> java.lang.IllegalArgumentException: Project '_null' does not exist;
>> >> at
>> >>
>> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
>> >> at
>> >>
>> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
>> >> at
>> >>
>> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
>> >> at
>> >>
>> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
>> >> at
>> >>
>> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
>> >> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>> >> at
>> >>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >> at java.lang.reflect.Method.invoke(Method.java:606)
>> >> at
>> >>
>> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
>> >> at
>> >>
>> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
>> >> at
>> >>
>> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
>> >> at
>> >>
>> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
>> >> at
>> >>
>> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
>> >> at
>> >>
>> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
>> >> at
>> >>
>> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
>> >> at
>> >>
>> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
>> >> at
>> >>
>> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
>> >> at
>> >>
>> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
>> >>
>> >>
>> >> cube infomations in json like this :
>> >>
>> >> {
>> >>  "name": "NOS_CUBE_STATISTICS",
>> >>  "description": "",
>> >>  "dimensions": [
>> >>    ...............
>> >>  ],
>> >>  "measures": [
>> >>    ...............
>> >>  ],
>> >>  "rowkey": {
>> >>    ...............
>> >>    ],
>> >>    "aggregation_groups": [
>> >>      [
>> >>        ..............
>> >>      ]
>> >>    ]
>> >>  },
>> >>  "notify_list": [],
>> >>  "capacity": "",
>> >>  "hbase_mapping": {
>> >>    "column_family": [
>> >>      {
>> >>        "name": "f1",
>> >>        "columns": [
>> >>          {
>> >>            "qualifier": "m",
>> >>            "measure_refs": [
>> >>              "_COUNT_",
>> >>              "DataSize",
>> >>              "UploaderCostTime",
>> >>              "LbsCostTime",
>> >>              "UploaderRetryCount",
>> >>              "ChunkRetryCount",
>> >>              "QueryRetryCount"
>> >>            ]
>> >>          }
>> >>        ]
>> >>      }
>> >>    ]
>> >>  },
>> >>  "retentionRange": "0",
>> >>  "project": "NOS_ANALYTICS_PROJECT",
>> >>  "model_name": "NOS_CUBE_STATISTICS"
>> >> }
>> >>
>> >>
>>
>>
>>
>

Re: IllegalArgumentException happened while creating new cube

Posted by Jian Zhong <he...@gmail.com>.
Hi, may I know which version are you using, this issue has been fixed month
ago, are you building it yourself on staging branch?

On Wed, Sep 9, 2015 at 9:16 PM, Dayue Gao <da...@163.com> wrote:

> From the attached log, what I can tell is it has nothing to do with cube
> creation. Cube was created successfully, then you navigated to "Tables"
> tab, and the strange thing is "java.lang.IllegalArgumentException: Project
> '_null' does not exist;"
>
> Seems front-end passed a strange project name "_null" to /api/tables.
>
> Best Regards,
> Dayue
>
> > 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
> >
> > However, After I refresh this page and find the cube has been created !!!
> >
> > 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
> >
> >> Hi
> >>    I am trying to create a cube with 15 dimensions and 7 measures, But I
> >> get IllegalArgumentException when saving this cube , Web UI has been
> >> blocking for last 20 minutes. I check log find those :
> >>
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> >> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> >> - clean query cache...
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> >>
> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >> [http-bio-7070-exec-7]:[2015-09-09
> >>
> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> >> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
> >> kylin_metadata_1.0@hbase)
> >> [pool-8-thread-1]:[2015-09-09
> >>
> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
> >> - new broadcast event:BroadcastEvent{type=cube_desc,
> >> name=NOS_CUBE_STATISTICS, action=create}
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> >> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
> >> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
> >> - Reloading Cube Metadata from folder
> >> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
> >> - Loaded 3 Cube(s)
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> >> - clean query cache...
> >> [http-bio-7070-exec-2]:[2015-09-09
> >>
> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> >>
> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >> [pool-6-thread-1]:[2015-09-09
> >>
> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> >> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
> >>
> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> >> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> >> [http-bio-7070-exec-10]:[2015-09-09
> >>
> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> >>
> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >> [http-bio-7070-exec-3]:[2015-09-09
> >>
> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
> >> - Get Kylin Runtime Config
> >> [http-bio-7070-exec-3]:[2015-09-09
> >>
> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> >>
> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >> [http-bio-7070-exec-8]:[2015-09-09
> >>
> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> >> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> >>
> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> >> [http-bio-7070-exec-9]:[2015-09-09
> >>
> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
> >> - Loading L2 project cache for _null
> >> [http-bio-7070-exec-9]:[2015-09-09
> >>
> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> >> - Failed to deal with the request.
> >> java.lang.IllegalArgumentException: Project '_null' does not exist;
> >> at
> >>
> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
> >> at
> >>
> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
> >> at
> >>
> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
> >> at
> >>
> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
> >> at
> >>
> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
> >> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
> >> at
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> at java.lang.reflect.Method.invoke(Method.java:606)
> >> at
> >>
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> >> at
> >>
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> >> at
> >>
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> >> at
> >>
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
> >> at
> >>
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
> >> at
> >>
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> >> at
> >>
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> >> at
> >>
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> >> at
> >>
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> >> at
> >>
> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
> >>
> >>
> >> cube infomations in json like this :
> >>
> >> {
> >>  "name": "NOS_CUBE_STATISTICS",
> >>  "description": "",
> >>  "dimensions": [
> >>    ...............
> >>  ],
> >>  "measures": [
> >>    ...............
> >>  ],
> >>  "rowkey": {
> >>    ...............
> >>    ],
> >>    "aggregation_groups": [
> >>      [
> >>        ..............
> >>      ]
> >>    ]
> >>  },
> >>  "notify_list": [],
> >>  "capacity": "",
> >>  "hbase_mapping": {
> >>    "column_family": [
> >>      {
> >>        "name": "f1",
> >>        "columns": [
> >>          {
> >>            "qualifier": "m",
> >>            "measure_refs": [
> >>              "_COUNT_",
> >>              "DataSize",
> >>              "UploaderCostTime",
> >>              "LbsCostTime",
> >>              "UploaderRetryCount",
> >>              "ChunkRetryCount",
> >>              "QueryRetryCount"
> >>            ]
> >>          }
> >>        ]
> >>      }
> >>    ]
> >>  },
> >>  "retentionRange": "0",
> >>  "project": "NOS_ANALYTICS_PROJECT",
> >>  "model_name": "NOS_CUBE_STATISTICS"
> >> }
> >>
> >>
>
>
>

Re: IllegalArgumentException happened while creating new cube

Posted by Dayue Gao <da...@163.com>.
From the attached log, what I can tell is it has nothing to do with cube creation. Cube was created successfully, then you navigated to "Tables" tab, and the strange thing is "java.lang.IllegalArgumentException: Project '_null' does not exist;"

Seems front-end passed a strange project name "_null" to /api/tables.

Best Regards,
Dayue

> 在 2015年9月9日,下午5:31,yu feng <ol...@gmail.com> 写道:
> 
> However, After I refresh this page and find the cube has been created !!!
> 
> 2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:
> 
>> Hi
>>    I am trying to create a cube with 15 dimensions and 7 measures, But I
>> get IllegalArgumentException when saving this cube , Web UI has been
>> blocking for last 20 minutes. I check log find those :
>> 
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
>> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
>> - clean query cache...
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
>> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> [http-bio-7070-exec-7]:[2015-09-09
>> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
>> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
>> kylin_metadata_1.0@hbase)
>> [pool-8-thread-1]:[2015-09-09
>> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
>> - new broadcast event:BroadcastEvent{type=cube_desc,
>> name=NOS_CUBE_STATISTICS, action=create}
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
>> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
>> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
>> - Reloading Cube Metadata from folder
>> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
>> - Loaded 3 Cube(s)
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
>> - clean query cache...
>> [http-bio-7070-exec-2]:[2015-09-09
>> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
>> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> [pool-6-thread-1]:[2015-09-09
>> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
>> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
>> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
>> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
>> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
>> [http-bio-7070-exec-10]:[2015-09-09
>> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> [http-bio-7070-exec-3]:[2015-09-09
>> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
>> - Get Kylin Runtime Config
>> [http-bio-7070-exec-3]:[2015-09-09
>> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> [http-bio-7070-exec-8]:[2015-09-09
>> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
>> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
>> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
>> [http-bio-7070-exec-9]:[2015-09-09
>> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
>> - Loading L2 project cache for _null
>> [http-bio-7070-exec-9]:[2015-09-09
>> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
>> - Failed to deal with the request.
>> java.lang.IllegalArgumentException: Project '_null' does not exist;
>> at
>> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
>> at
>> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
>> at
>> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
>> at
>> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
>> at
>> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
>> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at
>> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
>> at
>> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
>> at
>> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
>> at
>> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
>> at
>> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
>> at
>> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
>> at
>> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
>> at
>> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
>> at
>> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
>> at
>> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
>> 
>> 
>> cube infomations in json like this :
>> 
>> {
>>  "name": "NOS_CUBE_STATISTICS",
>>  "description": "",
>>  "dimensions": [
>>    ...............
>>  ],
>>  "measures": [
>>    ...............
>>  ],
>>  "rowkey": {
>>    ...............
>>    ],
>>    "aggregation_groups": [
>>      [
>>        ..............
>>      ]
>>    ]
>>  },
>>  "notify_list": [],
>>  "capacity": "",
>>  "hbase_mapping": {
>>    "column_family": [
>>      {
>>        "name": "f1",
>>        "columns": [
>>          {
>>            "qualifier": "m",
>>            "measure_refs": [
>>              "_COUNT_",
>>              "DataSize",
>>              "UploaderCostTime",
>>              "LbsCostTime",
>>              "UploaderRetryCount",
>>              "ChunkRetryCount",
>>              "QueryRetryCount"
>>            ]
>>          }
>>        ]
>>      }
>>    ]
>>  },
>>  "retentionRange": "0",
>>  "project": "NOS_ANALYTICS_PROJECT",
>>  "model_name": "NOS_CUBE_STATISTICS"
>> }
>> 
>> 



Re: IllegalArgumentException happened while creating new cube

Posted by yu feng <ol...@gmail.com>.
However, After I refresh this page and find the cube has been created !!!

2015-09-09 17:29 GMT+08:00 yu feng <ol...@gmail.com>:

> Hi
>     I am trying to create a cube with 15 dimensions and 7 measures, But I
> get IllegalArgumentException when saving this cube , Web UI has been
> blocking for last 20 minutes. I check log find those :
>
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:28,980][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> - wipe cache type: DATA_MODEL event:CREATE name:NOS_CUBE_STATISTICS
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:28,986][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> - clean query cache...
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:28,987][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> 02:05:28;URI=/kylin/api/cache/data_model/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> [http-bio-7070-exec-7]:[2015-09-09
> 17:05:29,009][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> - Saving resource /cube_desc/NOS_CUBE_STATISTICS.json (Store
> kylin_metadata_1.0@hbase)
> [pool-8-thread-1]:[2015-09-09
> 17:05:29,022][INFO][org.apache.kylin.common.restclient.Broadcaster$1.run(Broadcaster.java:74)]
> - new broadcast event:BroadcastEvent{type=cube_desc,
> name=NOS_CUBE_STATISTICS, action=create}
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:29,029][INFO][org.apache.kylin.rest.controller.CacheController.wipeCache(CacheController.java:64)]
> - wipe cache type: CUBE_DESC event:CREATE name:NOS_CUBE_STATISTICS
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:29,029][INFO][org.apache.kylin.cube.CubeDescManager.<init>(CubeDescManager.java:91)]
> - Initializing CubeDescManager with config kylin_metadata_1.0@hbase
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:29,030][INFO][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:192)]
> - Reloading Cube Metadata from folder
> kylin_metadata_1.0(key='/cube_desc')@kylin_metadata_1.0@hbase
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:29,101][DEBUG][org.apache.kylin.cube.CubeDescManager.reloadAllCubeDesc(CubeDescManager.java:217)]
> - Loaded 3 Cube(s)
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:29,108][DEBUG][org.apache.kylin.rest.service.BasicService.cleanDataCache(BasicService.java:140)]
> - clean query cache...
> [http-bio-7070-exec-2]:[2015-09-09
> 17:05:29,109][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> - REQUEST: REQUESTER=;REQ_TIME=PDT 2015-09-09
> 02:05:29;URI=/kylin/api/cache/cube_desc/NOS_CUBE_STATISTICS/create;METHOD=PUT;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> [pool-6-thread-1]:[2015-09-09
> 17:05:40,188][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> ^[[B^[[A[pool-6-thread-1]:[2015-09-09
> 17:06:40,105][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
> - Job Fetcher: 0 running, 0 actual running, 0 ready, 13 others
> [http-bio-7070-exec-10]:[2015-09-09
> 17:06:43,297][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> 02:06:43;URI=/kylin/api/projects;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> [http-bio-7070-exec-3]:[2015-09-09
> 17:06:43,299][DEBUG][org.apache.kylin.rest.service.AdminService.getConfigAsString(AdminService.java:90)]
> - Get Kylin Runtime Config
> [http-bio-7070-exec-3]:[2015-09-09
> 17:06:43,301][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> 02:06:43;URI=/kylin/api/admin/config;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> [http-bio-7070-exec-8]:[2015-09-09
> 17:06:43,304][DEBUG][org.apache.kylin.rest.filter.KylinApiFilter.logRequest(KylinApiFilter.java:120)]
> - REQUEST: REQUESTER=ADMIN;REQ_TIME=PDT 2015-09-09
> 02:06:43;URI=/kylin/api/user/authentication;METHOD=GET;QUERY_STRING=null;PAYLOAD=;RESP_STATUS=200;
> [http-bio-7070-exec-9]:[2015-09-09
> 17:06:43,372][INFO][org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:162)]
> - Loading L2 project cache for _null
> [http-bio-7070-exec-9]:[2015-09-09
> 17:06:43,373][ERROR][org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> - Failed to deal with the request.
> java.lang.IllegalArgumentException: Project '_null' does not exist;
> at
> org.apache.kylin.metadata.project.ProjectL2Cache.loadCache(ProjectL2Cache.java:168)
> at
> org.apache.kylin.metadata.project.ProjectL2Cache.getCache(ProjectL2Cache.java:155)
> at
> org.apache.kylin.metadata.project.ProjectL2Cache.listDefinedTables(ProjectL2Cache.java:63)
> at
> org.apache.kylin.metadata.project.ProjectManager.listDefinedTables(ProjectManager.java:288)
> at
> org.apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:72)
> at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
> at
> org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
> at
> org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
> at
> org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
> at
> org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
> at
> org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
> at
> org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
> at
> org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
> at
> org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
>
>
> cube infomations in json like this :
>
> {
>   "name": "NOS_CUBE_STATISTICS",
>   "description": "",
>   "dimensions": [
>     ...............
>   ],
>   "measures": [
>     ...............
>   ],
>   "rowkey": {
>     ...............
>     ],
>     "aggregation_groups": [
>       [
>         ..............
>       ]
>     ]
>   },
>   "notify_list": [],
>   "capacity": "",
>   "hbase_mapping": {
>     "column_family": [
>       {
>         "name": "f1",
>         "columns": [
>           {
>             "qualifier": "m",
>             "measure_refs": [
>               "_COUNT_",
>               "DataSize",
>               "UploaderCostTime",
>               "LbsCostTime",
>               "UploaderRetryCount",
>               "ChunkRetryCount",
>               "QueryRetryCount"
>             ]
>           }
>         ]
>       }
>     ]
>   },
>   "retentionRange": "0",
>   "project": "NOS_ANALYTICS_PROJECT",
>   "model_name": "NOS_CUBE_STATISTICS"
> }
>
>