You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Furkan KAMACI (JIRA)" <ji...@apache.org> on 2017/01/09 17:14:58 UTC
[jira] [Commented] (NUTCH-1915) Error in Nutch 2.X WebApp stalls
progress bar
[ https://issues.apache.org/jira/browse/NUTCH-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812283#comment-15812283 ]
Furkan KAMACI commented on NUTCH-1915:
--------------------------------------
[~lewismc] Could you increase *DEFAULT_TIMEOUT_SEC* which has default value of *60* at _RemoteCommandExecutor.java_ and try it again?
> Error in Nutch 2.X WebApp stalls progress bar
> ---------------------------------------------
>
> Key: NUTCH-1915
> URL: https://issues.apache.org/jira/browse/NUTCH-1915
> Project: Nutch
> Issue Type: Bug
> Components: web gui
> Affects Versions: 2.3
> Environment: Nutch 2.3-SNAPSHOT HEAD
> HBase 0.94.14
> Gora 0.5
> Reporter: Lewis John McGibbney
> Fix For: 2.5
>
>
> When I define a crawl within the Nutch 2.X webapp on the above stack I sometimes get the following stack trace
> {code}
> 2015-01-12 14:48:25,943 INFO fetcher.FetcherJob - fetching http://www.darpa.mil/Our_Work/I2O/Personnel/Mr__Steve_Jameson.aspx (queue crawl delay=5000ms)
> 2015-01-12 14:48:26,563 ERROR impl.RemoteCommandExecutor - Remote command failed
> java.util.concurrent.TimeoutException
> at java.util.concurrent.FutureTask.get(FutureTask.java:201)
> at org.apache.nutch.webui.client.impl.RemoteCommandExecutor.executeRemoteJob(RemoteCommandExecutor.java:61)
> at org.apache.nutch.webui.client.impl.CrawlingCycle.executeCrawlCycle(CrawlingCycle.java:58)
> at org.apache.nutch.webui.service.impl.CrawlServiceImpl.startCrawl(CrawlServiceImpl.java:69)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
> at org.springframework.aop.interceptor.AsyncExecutionInterceptor$1.call(AsyncExecutionInterceptor.java:97)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2015-01-12 14:48:26,563 INFO impl.CrawlingCycle - Executed remote command data: FETCH status: FAILED
> 2015-01-12 14:48:27,088 INFO fetcher.FetcherJob - 10/10 spinwaiting/active, 71 pages, 1 errors, 1.4 1 pages/s, 275 146 kb/s, 193 URLs in 4 queues
> {code}
> Right now I don't know what this relates to but I know that it stalls the task execution progress bar within the [CrawlsPage|https://github.com/apache/nutch/blob/2.x/src/java/org/apache/nutch/webui/pages/crawls/CrawlsPage.html]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)