You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@aurora.apache.org by "Stephan Erb (JIRA)" <ji...@apache.org> on 2015/07/09 13:02:04 UTC

[jira] [Updated] (AURORA-1385) Traceback rendering cron jobs without an upcoming next run

     [ https://issues.apache.org/jira/browse/AURORA-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephan Erb updated AURORA-1385:
--------------------------------
    Summary: Traceback rendering cron jobs without an upcoming next run   (was: Traceback rendering cron jobs with out an upcoming next run )

> Traceback rendering cron jobs without an upcoming next run 
> -----------------------------------------------------------
>
>                 Key: AURORA-1385
>                 URL: https://issues.apache.org/jira/browse/AURORA-1385
>             Project: Aurora
>          Issue Type: Bug
>            Reporter: Stephan Erb
>            Priority: Critical
>
> We are having issues with rendering the scheduler page on one of our clusters:
> Listing all roles is working as intended. However, the job summary page states that for a particular role there are a total  6 Jobs but of which 7 should be cron jobs.
> When accessing the corresponding URL to perform the drill down into the role, the scheduler dumps the following exception:
> {code}
> I0708 17:51:07.842 THREAD2968 org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke: getJobSummary(nobody)
> I0708 17:51:07.844 THREAD2967 org.apache.aurora.scheduler.http.RequestLogger$1.log: devcluster 10.128.4.212 [08/Jul/2015:17:51:07 +0000] "POST /api HTTP/1.1" 200 0 "http://devcluster:8081/scheduler/nobody" "Mozilla/5.0 (X11; L
> inux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/37.0.2062.120 Chrome/37.0.2062.120 Safari/537.36" 0
> I0708 17:51:07.844 THREAD2967 org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke: getQuota(nobody)
> W0708 17:51:07.851 THREAD2968 org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke: Uncaught exception while handling getJobSummary(nobody)
> java.lang.NullPointerException
>         at org.apache.aurora.scheduler.thrift.ReadOnlySchedulerImpl$4.apply(ReadOnlySchedulerImpl.java:265)
>         at org.apache.aurora.scheduler.thrift.ReadOnlySchedulerImpl$4.apply(ReadOnlySchedulerImpl.java:257)
>         at com.google.common.collect.Iterators$8.transform(Iterators.java:794)
>         at com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48)
>         at com.google.common.collect.ImmutableSet.copyOf(ImmutableSet.java:317)
>         at com.google.common.collect.ImmutableSet.copyOf(ImmutableSet.java:300)
>         at com.google.common.collect.FluentIterable.toSet(FluentIterable.java:358)
>         at org.apache.aurora.scheduler.thrift.ReadOnlySchedulerImpl.getJobSummary(ReadOnlySchedulerImpl.java:272)
>         at org.apache.aurora.scheduler.thrift.SchedulerThriftInterface.getJobSummary(SchedulerThriftInterface.java:461)
>         at org.apache.aurora.scheduler.thrift.aop.ThriftStatsExporterInterceptor.invoke(ThriftStatsExporterInterceptor.java:47)
>         at org.apache.aurora.scheduler.thrift.aop.FeatureToggleInterceptor.invoke(FeatureToggleInterceptor.java:38)
>         at org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke(LoggingInterceptor.java:102)
>         at org.apache.aurora.scheduler.thrift.aop.ServerInfoInterceptor.invoke(ServerInfoInterceptor.java:30)
>         at org.apache.aurora.gen.ReadOnlyScheduler$Processor$getJobSummary.getResult(ReadOnlyScheduler.java:906)
>         at org.apache.aurora.gen.ReadOnlyScheduler$Processor$getJobSummary.getResult(ReadOnlyScheduler.java:891)
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>         at org.apache.thrift.server.TServlet.doPost(TServlet.java:83)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
>         at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
>         at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>        at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at org.apache.aurora.scheduler.http.HttpStatsFilter.doFilter(HttpStatsFilter.java:69)
>         at org.apache.aurora.scheduler.http.AbstractFilter.doFilter(AbstractFilter.java:44)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:82)
>         at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:294)
>         at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
>         at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>         at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
>         at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
>         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1288)
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:443)
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1044)
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>         at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>         at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:317)
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>         at org.eclipse.jetty.server.Server.handle(Server.java:369)
>         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
>         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:944)
> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1005)
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865)
>         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:667)
>         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>         at java.lang.Thread.run(Thread.java:745)
> {code}
> Background information:
> * We are running the latest release (0.8.0)
> * Performing a fail over to the next scheduler does not resolve the issue. 
> * All of the jobs of this particular role are cron jobs.
> * The json at http://devcluster:8081/cron shows only 6 cron jobs 
> * We have encountered network issues earlier today and temporarily lost one master and one slave.
> Any ideas how I can find out more about the offending cron job and resolve the situation?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)