You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by yu feng <ol...@gmail.com> on 2015/11/24 08:50:01 UTC
problem about modify hive table metadata
Hi all:
when I want to change the column in hive source table and reload table in
kylin, I can not see any column in the table after reload, I restart kylin
server and reload the table , the column(name is modified) appeares
I write a test program like this(kylin do the same thing while reloading
table) :
HiveClient client = new HiveClient();
List<FieldSchema> fields = client.getHiveTableFields(database, table);
\\waiting here and modify table column name
fields = client.getHiveTableFields(database, table);
client.getHiveTableFields return all columns in the table at the first
time, and after I modify one column and recall client.getHiveTableFields
function, it return am empty list. It will return the same list if I do not
change the column name in the middle.
I doubt maybe something error in hive metastore, any help will
be appreciate...
Re: problem about modify hive table metadata
Posted by Luke Han <lu...@gmail.com>.
Cool
Best Regards!
---------------------
Luke Han
On Fri, Nov 27, 2015 at 2:28 PM, yu feng <ol...@gmail.com> wrote:
> I just create one at here :
> https://issues.apache.org/jira/browse/KYLIN-1173
>
> 2015-11-27 14:24 GMT+08:00 Luke Han <lu...@gmail.com>:
>
> > Do we have JIRA for this?
> >
> >
> > Best Regards!
> > ---------------------
> >
> > Luke Han
> >
> > On Fri, Nov 27, 2015 at 2:11 PM, yu feng <ol...@gmail.com> wrote:
> >
> > > OK, I will create it later.
> > >
> > > 2015-11-27 10:20 GMT+08:00 Li Yang <li...@apache.org>:
> > >
> > > > This is a bug. What I'm not sure is if it has been fixed in latest
> > > branch.
> > > >
> > > > Could you open a JIRA to track? Need to know the Kylin version.
> > > >
> > > > On Tue, Nov 24, 2015 at 3:50 PM, yu feng <ol...@gmail.com>
> wrote:
> > > >
> > > > > Hi all:
> > > > >
> > > > > when I want to change the column in hive source table and reload
> > table
> > > in
> > > > > kylin, I can not see any column in the table after reload, I
> restart
> > > > kylin
> > > > > server and reload the table , the column(name is modified) appeares
> > > > >
> > > > > I write a test program like this(kylin do the same thing while
> > > reloading
> > > > > table) :
> > > > >
> > > > > HiveClient client = new HiveClient();
> > > > > List<FieldSchema> fields = client.getHiveTableFields(database,
> > table);
> > > > > \\waiting here and modify table column name
> > > > > fields = client.getHiveTableFields(database, table);
> > > > >
> > > > > client.getHiveTableFields return all columns in the table at the
> > first
> > > > > time, and after I modify one column and recall
> > > client.getHiveTableFields
> > > > > function, it return am empty list. It will return the same list if
> I
> > do
> > > > not
> > > > > change the column name in the middle.
> > > > >
> > > > > I doubt maybe something error in hive metastore, any help will
> > > > > be appreciate...
> > > > >
> > > >
> > >
> >
>
Re: problem about modify hive table metadata
Posted by yu feng <ol...@gmail.com>.
I just create one at here : https://issues.apache.org/jira/browse/KYLIN-1173
2015-11-27 14:24 GMT+08:00 Luke Han <lu...@gmail.com>:
> Do we have JIRA for this?
>
>
> Best Regards!
> ---------------------
>
> Luke Han
>
> On Fri, Nov 27, 2015 at 2:11 PM, yu feng <ol...@gmail.com> wrote:
>
> > OK, I will create it later.
> >
> > 2015-11-27 10:20 GMT+08:00 Li Yang <li...@apache.org>:
> >
> > > This is a bug. What I'm not sure is if it has been fixed in latest
> > branch.
> > >
> > > Could you open a JIRA to track? Need to know the Kylin version.
> > >
> > > On Tue, Nov 24, 2015 at 3:50 PM, yu feng <ol...@gmail.com> wrote:
> > >
> > > > Hi all:
> > > >
> > > > when I want to change the column in hive source table and reload
> table
> > in
> > > > kylin, I can not see any column in the table after reload, I restart
> > > kylin
> > > > server and reload the table , the column(name is modified) appeares
> > > >
> > > > I write a test program like this(kylin do the same thing while
> > reloading
> > > > table) :
> > > >
> > > > HiveClient client = new HiveClient();
> > > > List<FieldSchema> fields = client.getHiveTableFields(database,
> table);
> > > > \\waiting here and modify table column name
> > > > fields = client.getHiveTableFields(database, table);
> > > >
> > > > client.getHiveTableFields return all columns in the table at the
> first
> > > > time, and after I modify one column and recall
> > client.getHiveTableFields
> > > > function, it return am empty list. It will return the same list if I
> do
> > > not
> > > > change the column name in the middle.
> > > >
> > > > I doubt maybe something error in hive metastore, any help will
> > > > be appreciate...
> > > >
> > >
> >
>
Re: problem about modify hive table metadata
Posted by Luke Han <lu...@gmail.com>.
Do we have JIRA for this?
Best Regards!
---------------------
Luke Han
On Fri, Nov 27, 2015 at 2:11 PM, yu feng <ol...@gmail.com> wrote:
> OK, I will create it later.
>
> 2015-11-27 10:20 GMT+08:00 Li Yang <li...@apache.org>:
>
> > This is a bug. What I'm not sure is if it has been fixed in latest
> branch.
> >
> > Could you open a JIRA to track? Need to know the Kylin version.
> >
> > On Tue, Nov 24, 2015 at 3:50 PM, yu feng <ol...@gmail.com> wrote:
> >
> > > Hi all:
> > >
> > > when I want to change the column in hive source table and reload table
> in
> > > kylin, I can not see any column in the table after reload, I restart
> > kylin
> > > server and reload the table , the column(name is modified) appeares
> > >
> > > I write a test program like this(kylin do the same thing while
> reloading
> > > table) :
> > >
> > > HiveClient client = new HiveClient();
> > > List<FieldSchema> fields = client.getHiveTableFields(database, table);
> > > \\waiting here and modify table column name
> > > fields = client.getHiveTableFields(database, table);
> > >
> > > client.getHiveTableFields return all columns in the table at the first
> > > time, and after I modify one column and recall
> client.getHiveTableFields
> > > function, it return am empty list. It will return the same list if I do
> > not
> > > change the column name in the middle.
> > >
> > > I doubt maybe something error in hive metastore, any help will
> > > be appreciate...
> > >
> >
>
Re: problem about modify hive table metadata
Posted by yu feng <ol...@gmail.com>.
OK, I will create it later.
2015-11-27 10:20 GMT+08:00 Li Yang <li...@apache.org>:
> This is a bug. What I'm not sure is if it has been fixed in latest branch.
>
> Could you open a JIRA to track? Need to know the Kylin version.
>
> On Tue, Nov 24, 2015 at 3:50 PM, yu feng <ol...@gmail.com> wrote:
>
> > Hi all:
> >
> > when I want to change the column in hive source table and reload table in
> > kylin, I can not see any column in the table after reload, I restart
> kylin
> > server and reload the table , the column(name is modified) appeares
> >
> > I write a test program like this(kylin do the same thing while reloading
> > table) :
> >
> > HiveClient client = new HiveClient();
> > List<FieldSchema> fields = client.getHiveTableFields(database, table);
> > \\waiting here and modify table column name
> > fields = client.getHiveTableFields(database, table);
> >
> > client.getHiveTableFields return all columns in the table at the first
> > time, and after I modify one column and recall client.getHiveTableFields
> > function, it return am empty list. It will return the same list if I do
> not
> > change the column name in the middle.
> >
> > I doubt maybe something error in hive metastore, any help will
> > be appreciate...
> >
>
Re: problem about modify hive table metadata
Posted by Li Yang <li...@apache.org>.
This is a bug. What I'm not sure is if it has been fixed in latest branch.
Could you open a JIRA to track? Need to know the Kylin version.
On Tue, Nov 24, 2015 at 3:50 PM, yu feng <ol...@gmail.com> wrote:
> Hi all:
>
> when I want to change the column in hive source table and reload table in
> kylin, I can not see any column in the table after reload, I restart kylin
> server and reload the table , the column(name is modified) appeares
>
> I write a test program like this(kylin do the same thing while reloading
> table) :
>
> HiveClient client = new HiveClient();
> List<FieldSchema> fields = client.getHiveTableFields(database, table);
> \\waiting here and modify table column name
> fields = client.getHiveTableFields(database, table);
>
> client.getHiveTableFields return all columns in the table at the first
> time, and after I modify one column and recall client.getHiveTableFields
> function, it return am empty list. It will return the same list if I do not
> change the column name in the middle.
>
> I doubt maybe something error in hive metastore, any help will
> be appreciate...
>