You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 周湘伦 <ja...@gmail.com> on 2017/06/13 02:21:24 UTC
Overwriting conflict when i load table from hive
Hi,all
When i built project and loaded table from hive,some errors occurs.
[image: 内嵌图片 1]
But when i load table from hive which i created,it's ok.
I know it's time stamp,but i do not know how to fix it.
Can you tell me how to solve it?Thank you.
Re: Overwriting conflict when i load table from hive
Posted by 周湘伦 <ja...@gmail.com>.
It's OK .
I restarted kyliy,then i loaded table successfully...
Do not know why not yesterday.
Thank you.
2017-06-14 19:35 GMT+08:00 Billy Liu <bi...@apache.org>:
> When you run the sample.sh, it actually does two things. One is to generate
> a few tables in Hive, another one is to generate the table metadata in
> Kylin's learn_kylin project which is saved in the metastore. You need click
> "System" tab "Reload Metadata" button to reload the metadata. After that
> the inconsistency status between Kylin instance and metastore will
> disappear.
>
> 2017-06-14 9:51 GMT+08:00 周湘伦 <ja...@gmail.com>:
>
> > I'm sorry, my english is not good.
> > 1.
> > The error log is:
> > 09:33:59.822 [http-bio-7070-exec-4] ERROR
> > org.apache.kylin.rest.controller.BasicController -
> > org.apache.kylin.rest.exception.InternalErrorException: Overwriting
> > conflict /table/DEFAULT.KYLIN_CAL_DT.json, expect old TS 1496820166000,
> > but
> > it is 1496820707107
> > at
> > org.apache.kylin.rest.controller.TableController.loadHiveTables(
> > TableController.java:117)
> > ~[kylin-server-base-2.0.0.jar:2.0.0]
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > ~[?:1.8.0_131]
> > at
> > sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:
> > 62)
> > ~[?:1.8.0_131]
> > at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > DelegatingMethodAccessorImpl.java:43)
> > ~[?:1.8.0_131]
> > at java.lang.reflect.Method.invoke(Method.java:498)
> ~[?:1.8.0_131]
> >
> > 2.
> > I'm sorry,it was not clear.
> > I mean after i executed $KYLIN_HOME/bin/sample.sh,some
> > tables(KYLIN_SALES,KYLIN_CAL_DT...) are loaded into hive.
> > I also created a table which named test in hive myself.
> > Then i clicked the button on the web page(http://master:7070/kylin/
> models)
> > to load hive table from tree，i selected KYLIN_SALES and KYLIN_CAL_DT,
> after
> > i clicked on the sync button, the error which i said above occured.
> > But when i selected test table ,after i clicked on the sync button, the
> > page showed successfully.
> >
> > Thank you.
> >
> > 2017-06-13 22:34 GMT+08:00 Billy Liu <bi...@apache.org>:
> >
> > > First, the snapshot could not be shown.
> > >
> > > Second, you said "loaded table from hive, some errors occurs", and also
> > > "load table from hive which i created, it's ok." What do you mean "it's
> > > ok"? Load the table which you created is fine, but failed if load
> tables
> > > which created by others?
> > >
> > > 2017-06-13 19:32 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > >
> > > > Yes, i had reloaded the matedata,but it didn't work.
> > > > I even restarted kylin.
> > > >
> > > > 2017-06-13 15:15 GMT+08:00 Billy Liu <bi...@apache.org>:
> > > >
> > > > > Could you reload the metadata from system tab, and load the table
> > > again?
> > > > >
> > > > > 2017-06-13 10:21 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > > > >
> > > > > > Hi,all
> > > > > > When i built project and loaded table from hive,some errors
> occurs.
> > > > > > [image: 内嵌图片 1]
> > > > > > But when i load table from hive which i created,it's ok.
> > > > > > I know it's time stamp,but i do not know how to fix it.
> > > > > > Can you tell me how to solve it?Thank you.
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Overwriting conflict when i load table from hive
Posted by Billy Liu <bi...@apache.org>.
When you run the sample.sh, it actually does two things. One is to generate
a few tables in Hive, another one is to generate the table metadata in
Kylin's learn_kylin project which is saved in the metastore. You need click
"System" tab "Reload Metadata" button to reload the metadata. After that
the inconsistency status between Kylin instance and metastore will
disappear.
2017-06-14 9:51 GMT+08:00 周湘伦 <ja...@gmail.com>:
> I'm sorry, my english is not good.
> 1.
> The error log is:
> 09:33:59.822 [http-bio-7070-exec-4] ERROR
> org.apache.kylin.rest.controller.BasicController -
> org.apache.kylin.rest.exception.InternalErrorException: Overwriting
> conflict /table/DEFAULT.KYLIN_CAL_DT.json, expect old TS 1496820166000,
> but
> it is 1496820707107
> at
> org.apache.kylin.rest.controller.TableController.loadHiveTables(
> TableController.java:117)
> ~[kylin-server-base-2.0.0.jar:2.0.0]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_131]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
> ~[?:1.8.0_131]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_131]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
>
> 2.
> I'm sorry,it was not clear.
> I mean after i executed $KYLIN_HOME/bin/sample.sh,some
> tables(KYLIN_SALES,KYLIN_CAL_DT...) are loaded into hive.
> I also created a table which named test in hive myself.
> Then i clicked the button on the web page(http://master:7070/kylin/models)
> to load hive table from tree，i selected KYLIN_SALES and KYLIN_CAL_DT, after
> i clicked on the sync button, the error which i said above occured.
> But when i selected test table ,after i clicked on the sync button, the
> page showed successfully.
>
> Thank you.
>
> 2017-06-13 22:34 GMT+08:00 Billy Liu <bi...@apache.org>:
>
> > First, the snapshot could not be shown.
> >
> > Second, you said "loaded table from hive, some errors occurs", and also
> > "load table from hive which i created, it's ok." What do you mean "it's
> > ok"? Load the table which you created is fine, but failed if load tables
> > which created by others?
> >
> > 2017-06-13 19:32 GMT+08:00 周湘伦 <ja...@gmail.com>:
> >
> > > Yes, i had reloaded the matedata,but it didn't work.
> > > I even restarted kylin.
> > >
> > > 2017-06-13 15:15 GMT+08:00 Billy Liu <bi...@apache.org>:
> > >
> > > > Could you reload the metadata from system tab, and load the table
> > again?
> > > >
> > > > 2017-06-13 10:21 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > > >
> > > > > Hi,all
> > > > > When i built project and loaded table from hive,some errors occurs.
> > > > > [image: 内嵌图片 1]
> > > > > But when i load table from hive which i created,it's ok.
> > > > > I know it's time stamp,but i do not know how to fix it.
> > > > > Can you tell me how to solve it?Thank you.
> > > > >
> > > >
> > >
> >
>
Re: Overwriting conflict when i load table from hive
Posted by 周湘伦 <ja...@gmail.com>.
I'm sorry, my english is not good.
1.
The error log is:
09:33:59.822 [http-bio-7070-exec-4] ERROR
org.apache.kylin.rest.controller.BasicController -
org.apache.kylin.rest.exception.InternalErrorException: Overwriting
conflict /table/DEFAULT.KYLIN_CAL_DT.json, expect old TS 1496820166000, but
it is 1496820707107
at
org.apache.kylin.rest.controller.TableController.loadHiveTables(TableController.java:117)
~[kylin-server-base-2.0.0.jar:2.0.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_131]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_131]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_131]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
2.
I'm sorry,it was not clear.
I mean after i executed $KYLIN_HOME/bin/sample.sh,some
tables(KYLIN_SALES,KYLIN_CAL_DT...) are loaded into hive.
I also created a table which named test in hive myself.
Then i clicked the button on the web page(http://master:7070/kylin/models)
to load hive table from tree，i selected KYLIN_SALES and KYLIN_CAL_DT, after
i clicked on the sync button, the error which i said above occured.
But when i selected test table ,after i clicked on the sync button, the
page showed successfully.
Thank you.
2017-06-13 22:34 GMT+08:00 Billy Liu <bi...@apache.org>:
> First, the snapshot could not be shown.
>
> Second, you said "loaded table from hive, some errors occurs", and also
> "load table from hive which i created, it's ok." What do you mean "it's
> ok"? Load the table which you created is fine, but failed if load tables
> which created by others?
>
> 2017-06-13 19:32 GMT+08:00 周湘伦 <ja...@gmail.com>:
>
> > Yes, i had reloaded the matedata,but it didn't work.
> > I even restarted kylin.
> >
> > 2017-06-13 15:15 GMT+08:00 Billy Liu <bi...@apache.org>:
> >
> > > Could you reload the metadata from system tab, and load the table
> again?
> > >
> > > 2017-06-13 10:21 GMT+08:00 周湘伦 <ja...@gmail.com>:
> > >
> > > > Hi,all
> > > > When i built project and loaded table from hive,some errors occurs.
> > > > [image: 内嵌图片 1]
> > > > But when i load table from hive which i created,it's ok.
> > > > I know it's time stamp,but i do not know how to fix it.
> > > > Can you tell me how to solve it?Thank you.
> > > >
> > >
> >
>
Re: Overwriting conflict when i load table from hive
Posted by Billy Liu <bi...@apache.org>.
First, the snapshot could not be shown.
Second, you said "loaded table from hive, some errors occurs", and also
"load table from hive which i created, it's ok." What do you mean "it's
ok"? Load the table which you created is fine, but failed if load tables
which created by others?
2017-06-13 19:32 GMT+08:00 周湘伦 <ja...@gmail.com>:
> Yes, i had reloaded the matedata,but it didn't work.
> I even restarted kylin.
>
> 2017-06-13 15:15 GMT+08:00 Billy Liu <bi...@apache.org>:
>
> > Could you reload the metadata from system tab, and load the table again?
> >
> > 2017-06-13 10:21 GMT+08:00 周湘伦 <ja...@gmail.com>:
> >
> > > Hi,all
> > > When i built project and loaded table from hive,some errors occurs.
> > > [image: 内嵌图片 1]
> > > But when i load table from hive which i created,it's ok.
> > > I know it's time stamp,but i do not know how to fix it.
> > > Can you tell me how to solve it?Thank you.
> > >
> >
>
Re: Overwriting conflict when i load table from hive
Posted by 周湘伦 <ja...@gmail.com>.
Yes, i had reloaded the matedata,but it didn't work.
I even restarted kylin.
2017-06-13 15:15 GMT+08:00 Billy Liu <bi...@apache.org>:
> Could you reload the metadata from system tab, and load the table again?
>
> 2017-06-13 10:21 GMT+08:00 周湘伦 <ja...@gmail.com>:
>
> > Hi,all
> > When i built project and loaded table from hive,some errors occurs.
> > [image: 内嵌图片 1]
> > But when i load table from hive which i created,it's ok.
> > I know it's time stamp,but i do not know how to fix it.
> > Can you tell me how to solve it?Thank you.
> >
>
Re: Overwriting conflict when i load table from hive
Posted by Billy Liu <bi...@apache.org>.
Could you reload the metadata from system tab, and load the table again?
2017-06-13 10:21 GMT+08:00 周湘伦 <ja...@gmail.com>:
> Hi,all
> When i built project and loaded table from hive,some errors occurs.
> [image: 内嵌图片 1]
> But when i load table from hive which i created,it's ok.
> I know it's time stamp,but i do not know how to fix it.
> Can you tell me how to solve it?Thank you.
>