You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by lei liu <li...@gmail.com> on 2010/10/25 13:29:23 UTC
hive server process is killed
I use the "nohup ./hive --service hiveserver 10000&" command to start hive
server.
But after some time, I find the hive server process is killed. I error
message like below :
2010-10-25 19:00:05,030 ERROR exec.DDLTask
(SessionState.java:printError(277)) - FAILED: Error in metadata:
java.lang.IllegalStateException: Shutdown in progress
org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.IllegalStateException: Shutdown in progress
at
org.apache.hadoop.hive.ql.metadata.Hive.createPartition(Hive.java:881)
at
org.apache.hadoop.hive.ql.exec.DDLTask.addPartition(DDLTask.java:291)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:191)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:633)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:506)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:384)
at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:115)
at
org.apache.hadoop.hive.service.ThriftHive$Processor$execute.process(ThriftHive.java:378)
at
org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:366)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:252)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at
java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:39)
at java.lang.Runtime.addShutdownHook(Runtime.java:192)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1381)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:215)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
at
org.apache.hadoop.hive.metastore.Warehouse.getFs(Warehouse.java:72)
at
org.apache.hadoop.hive.metastore.Warehouse.getDnsPath(Warehouse.java:104)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.add_partition_core(HiveMetaStore.java:1128)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.access$1000(HiveMetaStore.java:79)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler$18.run(HiveMetaStore.java:1172)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler$18.run(HiveMetaStore.java:1169)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.executeWithRetry(HiveMetaStore.java:234)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.add_partition(HiveMetaStore.java:1169)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.add_partition(HiveMetaStoreClient.java:220)
at
org.apache.hadoop.hive.ql.metadata.Hive.createPartition(Hive.java:878)
... 14 more
2010-10-25 19:00:05,031 ERROR ql.Driver (SessionState.java:printError(277))
- FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask
Could anybody tell me why hive server process is killed?
Thnaks
LiuLei
Re: hive server process is killed
Posted by Edward Capriolo <ed...@gmail.com>.
On Mon, Oct 25, 2010 at 7:29 AM, lei liu <li...@gmail.com> wrote:
> I use the "nohup ./hive --service hiveserver 10000&" command to start hive
> server.
>
> But after some time, I find the hive server process is killed. I error
> message like below :
>
> 2010-10-25 19:00:05,030 ERROR exec.DDLTask
> (SessionState.java:printError(277)) - FAILED: Error in metadata:
> java.lang.IllegalStateException: Shutdown in progress
> org.apache.hadoop.hive.ql.metadata.HiveException:
> java.lang.IllegalStateException: Shutdown in progress
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createPartition(Hive.java:881)
> at
> org.apache.hadoop.hive.ql.exec.DDLTask.addPartition(DDLTask.java:291)
> at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:191)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:107)
> at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:633)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:506)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:384)
> at
> org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:115)
> at
> org.apache.hadoop.hive.service.ThriftHive$Processor$execute.process(ThriftHive.java:378)
> at
> org.apache.hadoop.hive.service.ThriftHive$Processor.process(ThriftHive.java:366)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:252)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: java.lang.IllegalStateException: Shutdown in progress
> at
> java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:39)
> at java.lang.Runtime.addShutdownHook(Runtime.java:192)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1381)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:215)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
> at
> org.apache.hadoop.hive.metastore.Warehouse.getFs(Warehouse.java:72)
> at
> org.apache.hadoop.hive.metastore.Warehouse.getDnsPath(Warehouse.java:104)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.add_partition_core(HiveMetaStore.java:1128)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.access$1000(HiveMetaStore.java:79)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler$18.run(HiveMetaStore.java:1172)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler$18.run(HiveMetaStore.java:1169)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.executeWithRetry(HiveMetaStore.java:234)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.add_partition(HiveMetaStore.java:1169)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.add_partition(HiveMetaStoreClient.java:220)
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createPartition(Hive.java:878)
> ... 14 more
>
> 2010-10-25 19:00:05,031 ERROR ql.Driver (SessionState.java:printError(277))
> - FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask
>
>
> Could anybody tell me why hive server process is killed?
>
>
> Thnaks
>
>
> LiuLei
>
This is likely an exception that is not trapped correctly. It looks
like it relates to stale HDFS FileSystem objects. You should probably
open a jira issues.apache.org/jira for this issue.