You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Jeff Zhang <zj...@gmail.com> on 2015/03/11 07:56:03 UTC
drop table command hang
I invoke a drop table command and it hangs there. Here's the log. I am
using mysql and I can invoke describe command and create table through
mysql console, so I assume mysql works properly. Can anyone help this ?
Thanks
2015-03-11 14:48:09,441 INFO [main]: ql.Driver
(Driver.java:checkConcurrency(161)) - Concurrency mode is disabled, not
creating a lock manager
2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=Driver.execute
from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,441 INFO [main]: ql.Driver (Driver.java:execute(1321))
- Starting command: drop table student_bucketed_s1
2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(148)) - </PERFLOG method=TimeToSubmit
start=1426056489421 end=1426056489441 duration=20
from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=runTasks
from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=task.DDL.Stage-0
from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,442 INFO [main]: ql.Driver
(Driver.java:launchTask(1640)) - Starting task [Stage-0:DDL] in serial mode
2015-03-11 14:48:09,442 INFO [main]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default
tbl=student_bucketed_s1
2015-03-11 14:48:09,443 INFO [main]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
cmd=get_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,458 INFO [main]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default
tbl=student_bucketed_s1
2015-03-11 14:48:09,458 INFO [main]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
cmd=get_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,474 INFO [main]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(743)) - 0: drop_table : db=default
tbl=student_bucketed_s1
2015-03-11 14:48:09,474 INFO [main]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
cmd=drop_table : db=default tbl=student_bucketed_s1
--
Best Regards
Jeff Zhang
Re: drop table command hang
Posted by Jeff Zhang <zj...@gmail.com>.
I think I got the error. When I started hive, it will throw mysql key too
long exception (only in log file but not in client log, this is very
unfriendly IMO )
2015-03-14 14:18:49,588 ERROR [main]: DataNucleus.Datastore
(Log4JLogger.java:error(115)) - An exception was thrown while
adding/validating class(es) : Specified key was too long; max key length is
767 bytes
On Sat, Mar 14, 2015 at 1:44 PM, Jeff Zhang <zj...@gmail.com> wrote:
> It doesn't matter whether I truncate the table, it always hangs there.
> Very werid.
>
>
>
> On Wed, Mar 11, 2015 at 3:06 PM, Mich Talebzadeh <mi...@peridale.co.uk>
> wrote:
>
>> Have you truncated the table before dropping it? I
>>
>>
>>
>> Truncate table <table_name>
>>
>> Drop table <rable_name>
>>
>>
>>
>> Mich Talebzadeh
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>> *Publications due shortly:*
>>
>> *Creating in-memory Data Grid for Trading Systems with Oracle TimesTen
>> and Coherence Cache*
>>
>>
>>
>> NOTE: The information in this email is proprietary and confidential. This
>> message is for the designated recipient only, if you are not the intended
>> recipient, you should destroy it immediately. Any information in this
>> message shall not be understood as given or endorsed by Peridale Ltd, its
>> subsidiaries or their employees, unless expressly so stated. It is the
>> responsibility of the recipient to ensure that this email is virus free,
>> therefore neither Peridale Ltd, its subsidiaries nor their employees accept
>> any responsibility.
>>
>>
>>
>> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
>> *Sent:* 11 March 2015 06:56
>> *To:* user@hive.apache.org
>> *Subject:* drop table command hang
>>
>>
>>
>> I invoke a drop table command and it hangs there. Here's the log. I am
>> using mysql and I can invoke describe command and create table through
>> mysql console, so I assume mysql works properly. Can anyone help this ?
>> Thanks
>>
>>
>>
>>
>>
>>
>>
>> 2015-03-11 14:48:09,441 INFO [main]: ql.Driver
>> (Driver.java:checkConcurrency(161)) - Concurrency mode is disabled, not
>> creating a lock manager
>>
>> 2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger
>> (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=Driver.execute
>> from=org.apache.hadoop.hive.ql.Driver>
>>
>> 2015-03-11 14:48:09,441 INFO [main]: ql.Driver
>> (Driver.java:execute(1321)) - Starting command: drop table
>> student_bucketed_s1
>>
>> 2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger
>> (PerfLogger.java:PerfLogEnd(148)) - </PERFLOG method=TimeToSubmit
>> start=1426056489421 end=1426056489441 duration=20
>> from=org.apache.hadoop.hive.ql.Driver>
>>
>> 2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger
>> (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=runTasks
>> from=org.apache.hadoop.hive.ql.Driver>
>>
>> 2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger
>> (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=task.DDL.Stage-0
>> from=org.apache.hadoop.hive.ql.Driver>
>>
>> 2015-03-11 14:48:09,442 INFO [main]: ql.Driver
>> (Driver.java:launchTask(1640)) - Starting task [Stage-0:DDL] in serial mode
>>
>> 2015-03-11 14:48:09,442 INFO [main]: metastore.HiveMetaStore
>> (HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default
>> tbl=student_bucketed_s1
>>
>> 2015-03-11 14:48:09,443 INFO [main]: HiveMetaStore.audit
>> (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
>> cmd=get_table : db=default tbl=student_bucketed_s1
>>
>> 2015-03-11 14:48:09,458 INFO [main]: metastore.HiveMetaStore
>> (HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default
>> tbl=student_bucketed_s1
>>
>> 2015-03-11 14:48:09,458 INFO [main]: HiveMetaStore.audit
>> (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
>> cmd=get_table : db=default tbl=student_bucketed_s1
>>
>> 2015-03-11 14:48:09,474 INFO [main]: metastore.HiveMetaStore
>> (HiveMetaStore.java:logInfo(743)) - 0: drop_table : db=default
>> tbl=student_bucketed_s1
>>
>> 2015-03-11 14:48:09,474 INFO [main]: HiveMetaStore.audit
>> (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
>> cmd=drop_table : db=default tbl=student_bucketed_s1
>>
>>
>>
>>
>>
>>
>> --
>>
>> Best Regards
>>
>> Jeff Zhang
>>
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
Re: drop table command hang
Posted by Jeff Zhang <zj...@gmail.com>.
It doesn't matter whether I truncate the table, it always hangs there. Very
werid.
On Wed, Mar 11, 2015 at 3:06 PM, Mich Talebzadeh <mi...@peridale.co.uk>
wrote:
> Have you truncated the table before dropping it? I
>
>
>
> Truncate table <table_name>
>
> Drop table <rable_name>
>
>
>
> Mich Talebzadeh
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> *Publications due shortly:*
>
> *Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and
> Coherence Cache*
>
>
>
> NOTE: The information in this email is proprietary and confidential. This
> message is for the designated recipient only, if you are not the intended
> recipient, you should destroy it immediately. Any information in this
> message shall not be understood as given or endorsed by Peridale Ltd, its
> subsidiaries or their employees, unless expressly so stated. It is the
> responsibility of the recipient to ensure that this email is virus free,
> therefore neither Peridale Ltd, its subsidiaries nor their employees accept
> any responsibility.
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* 11 March 2015 06:56
> *To:* user@hive.apache.org
> *Subject:* drop table command hang
>
>
>
> I invoke a drop table command and it hangs there. Here's the log. I am
> using mysql and I can invoke describe command and create table through
> mysql console, so I assume mysql works properly. Can anyone help this ?
> Thanks
>
>
>
>
>
>
>
> 2015-03-11 14:48:09,441 INFO [main]: ql.Driver
> (Driver.java:checkConcurrency(161)) - Concurrency mode is disabled, not
> creating a lock manager
>
> 2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger
> (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=Driver.execute
> from=org.apache.hadoop.hive.ql.Driver>
>
> 2015-03-11 14:48:09,441 INFO [main]: ql.Driver
> (Driver.java:execute(1321)) - Starting command: drop table
> student_bucketed_s1
>
> 2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger
> (PerfLogger.java:PerfLogEnd(148)) - </PERFLOG method=TimeToSubmit
> start=1426056489421 end=1426056489441 duration=20
> from=org.apache.hadoop.hive.ql.Driver>
>
> 2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger
> (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=runTasks
> from=org.apache.hadoop.hive.ql.Driver>
>
> 2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger
> (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=task.DDL.Stage-0
> from=org.apache.hadoop.hive.ql.Driver>
>
> 2015-03-11 14:48:09,442 INFO [main]: ql.Driver
> (Driver.java:launchTask(1640)) - Starting task [Stage-0:DDL] in serial mode
>
> 2015-03-11 14:48:09,442 INFO [main]: metastore.HiveMetaStore
> (HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default
> tbl=student_bucketed_s1
>
> 2015-03-11 14:48:09,443 INFO [main]: HiveMetaStore.audit
> (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
> cmd=get_table : db=default tbl=student_bucketed_s1
>
> 2015-03-11 14:48:09,458 INFO [main]: metastore.HiveMetaStore
> (HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default
> tbl=student_bucketed_s1
>
> 2015-03-11 14:48:09,458 INFO [main]: HiveMetaStore.audit
> (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
> cmd=get_table : db=default tbl=student_bucketed_s1
>
> 2015-03-11 14:48:09,474 INFO [main]: metastore.HiveMetaStore
> (HiveMetaStore.java:logInfo(743)) - 0: drop_table : db=default
> tbl=student_bucketed_s1
>
> 2015-03-11 14:48:09,474 INFO [main]: HiveMetaStore.audit
> (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr
> cmd=drop_table : db=default tbl=student_bucketed_s1
>
>
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
RE: drop table command hang
Posted by Mich Talebzadeh <mi...@peridale.co.uk>.
Have you truncated the table before dropping it? I
Truncate table <table_name>
Drop table <rable_name>
Mich Talebzadeh
http://talebzadehmich.wordpress.com
Publications due shortly:
Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache
NOTE: The information in this email is proprietary and confidential. This message is for the designated recipient only, if you are not the intended recipient, you should destroy it immediately. Any information in this message shall not be understood as given or endorsed by Peridale Ltd, its subsidiaries or their employees, unless expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility.
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: 11 March 2015 06:56
To: user@hive.apache.org
Subject: drop table command hang
I invoke a drop table command and it hangs there. Here's the log. I am using mysql and I can invoke describe command and create table through mysql console, so I assume mysql works properly. Can anyone help this ? Thanks
2015-03-11 14:48:09,441 INFO [main]: ql.Driver (Driver.java:checkConcurrency(161)) - Concurrency mode is disabled, not creating a lock manager
2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,441 INFO [main]: ql.Driver (Driver.java:execute(1321)) - Starting command: drop table student_bucketed_s1
2015-03-11 14:48:09,441 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - </PERFLOG method=TimeToSubmit start=1426056489421 end=1426056489441 duration=20 from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=runTasks from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,442 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - <PERFLOG method=task.DDL.Stage-0 from=org.apache.hadoop.hive.ql.Driver>
2015-03-11 14:48:09,442 INFO [main]: ql.Driver (Driver.java:launchTask(1640)) - Starting task [Stage-0:DDL] in serial mode
2015-03-11 14:48:09,442 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,443 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr cmd=get_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,458 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(743)) - 0: get_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,458 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr cmd=get_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,474 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(743)) - 0: drop_table : db=default tbl=student_bucketed_s1
2015-03-11 14:48:09,474 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr cmd=drop_table : db=default tbl=student_bucketed_s1
--
Best Regards
Jeff Zhang