You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Arpit Gupta (JIRA)" <ji...@apache.org> on 2014/01/24 19:21:38 UTC
[jira] [Commented] (FALCON-276) falcon/prism services should fail
to start if exceptions are encountered during bootup
[ https://issues.apache.org/jira/browse/FALCON-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881242#comment-13881242 ]
Arpit Gupta commented on FALCON-276:
------------------------------------
Here are some examples of exceptions seen
{code}
2014-01-22 20:14:00,134 WARN - [main:] ~ The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. (BlockReaderLocal:69)
2014-01-22 20:14:00,193 INFO - [main:] ~ Initializing service : org.apache.falcon.entity.store.ConfigurationStore (ServiceInitializer:44)
2014-01-22 20:14:00,273 FATAL - [main:] ~ Failed to initialize service org.apache.falcon.entity.store.ConfigurationStore (ServiceInitializer:48)
java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto cannot be cast to com.google.protobuf.Message
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:203)
at $Proxy22.getListing(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
at $Proxy22.getListing(Unknown Source)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getListing(ClientNamenodeProtocolTranslatorPB.java:484)
at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1713)
at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1696)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:640)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:92)
at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:702)
at org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:698)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:698)
at org.apache.hadoop.fs.Globber.listStatus(Globber.java:69)
at org.apache.hadoop.fs.Globber.glob(Globber.java:207)
at org.apache.hadoop.fs.FileSystem.globStatus(FileSystem.java:1624)
at org.apache.falcon.entity.store.ConfigurationStore.init(ConfigurationStore.java:110)
at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:46)
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:55)
at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
at org.apache.falcon.Main.main(Main.java:90)
2014-01-22 20:14:00,274 ERROR - [main:] ~ Failed startup of context org.mortbay.jetty.webapp.WebAppContext@10f1f34a{/,/usr/lib/falcon-distributed/server/webapp/falcon.war} (log:87)
java.lang.RuntimeException: org.apache.falcon.FalconException: java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto cannot be cast to com.google.protobuf.Message
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:58)
at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
at org.apache.falcon.Main.main(Main.java:90)
Caused by: org.apache.falcon.FalconException: java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto cannot be cast to com.google.protobuf.Message
at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:49)
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:55)
... 11 more
Caused by: java.lang.ClassCastException: org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetListingRequestProto cannot be cast to com.google.protobuf.Message
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:203)
at $Proxy22.getListing(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
{code}
{code}
2014-01-24 17:08:02,596 WARN - [main:] ~ Unable to load native-hadoop library for your platform... using builtin-java classes where applicable (NativeCodeLoader:62)
2014-01-24 17:08:03,394 WARN - [main:] ~ failed org.mortbay.jetty.webapp.WebAppContext@3ebc312f{/,/usr/lib/falcon-distributed/server/webapp/falcon.war}: java.lang.NoClassDefFoundError: org/apache/hadoop/
fs/BatchedRemoteIterator$BatchedEntries (log:76)
2014-01-24 17:08:03,395 ERROR - [main:] ~ Error starting handlers (log:87)
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/BatchedRemoteIterator$BatchedEntries
at org.apache.hadoop.hdfs.NameNodeProxies.createNNProxyWithClientProtocol(NameNodeProxies.java:364)
at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:235)
at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:139)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:563)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:506)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:142)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2316)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:90)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2350)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2332)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:369)
at org.apache.falcon.entity.store.ConfigurationStore.<init>(ConfigurationStore.java:88)
at org.apache.falcon.entity.store.ConfigurationStore.<clinit>(ConfigurationStore.java:57)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.falcon.util.ReflectionUtils.getInstanceByClassName(ReflectionUtils.java:49)
at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:42)
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:55)
at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:549)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
: at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:45)
at org.apache.falcon.Main.main(Main.java:90)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.BatchedRemoteIterator$BatchedEntries
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at org.mortbay.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:401)
at org.mortbay.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:363)
... 31 more
{code}
> falcon/prism services should fail to start if exceptions are encountered during bootup
> --------------------------------------------------------------------------------------
>
> Key: FALCON-276
> URL: https://issues.apache.org/jira/browse/FALCON-276
> Project: Falcon
> Issue Type: Bug
> Affects Versions: 0.4
> Reporter: Arpit Gupta
>
> I noticed that when starting falcon and prism the services started up but i could not run the falcon admin -version command. Upon looking at the application logs i saw exception.
> It would be a much better if the service fails to start when exceptions are encountered and throws an error so the service start commands fail.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)