You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "Ing. Eyeris Rodriguez Rueda" <er...@uci.cu> on 2012/05/30 20:46:20 UTC
Cannot run program "chmod"
Hi all.
When i'm crawling, nutch throw this error.
Cannot run program "chmod": java.io.IOException: error=12, Cannot allocate memory
but if i try to crawl again so the error es with another site, any body can suggest me how to solve this problem.
This is a part of my log file.
*****************************************************************************************
2012-05-30 14:15:47,468 INFO crawl.Crawl - crawl started in: crawl
2012-05-30 14:15:47,480 INFO crawl.Crawl - rootUrlDir = urls
2012-05-30 14:15:47,480 INFO crawl.Crawl - threads = 10
2012-05-30 14:15:47,480 INFO crawl.Crawl - depth = 5
2012-05-30 14:15:47,480 INFO crawl.Crawl - solrUrl=http://localhost:8080/solr
2012-05-30 14:15:47,480 INFO crawl.Crawl - topN = 300
*
*
*
*
*
2012-05-30 14:17:26,147 INFO parse.ParseSegment - Parsing: http://www.uci.cu/
2012-05-30 14:17:26,262 WARN mapred.LocalJobRunner - job_local_0011
java.io.IOException: Cannot run program "chmod": java.io.IOException: error=12, Cannot allocate memory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:149)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286)
*****************************************************************************************
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
RE: Cannot run program "chmod"
Posted by "Ing. Eyeris Rodriguez Rueda" <er...@uci.cu>.
Problem solved, thanks Sebastian , the problem was with swap memory, I had to change the fstab file and run swapon command in centos.
_____________________________________________________________________
Ing. Eyeris Rodriguez Rueda
Teléfono:837-3370
Universidad de las Ciencias Informáticas
_____________________________________________________________________
-----Mensaje original-----
De: Sebastian Nagel [mailto:wastl.nagel@googlemail.com]
Enviado el: miércoles, 30 de mayo de 2012 2:35 PM
Para: user@nutch.apache.org
CC: Ing. Eyeris Rodriguez Rueda
Asunto: Re: Cannot run program "chmod"
This is not really a problem of Nutch. The fork to run the command "chmod" failed because your machine does not have enough memory (RAM + swap).
For more information you should google for error=12, Cannot allocate memory hadoop error=12
Possible solutions (assuming you are using Linux):
look for how to "overcommit memory"
increase the swap space
Sebastian
-------- Original Message --------
Subject: Cannot run program "chmod"
Date: Wed, 30 May 2012 14:46:20 -0400 (CDT)
From: Ing. Eyeris Rodriguez Rueda <er...@uci.cu>
Reply-To: user@nutch.apache.org
To: user@nutch.apache.org
Hi all.
When i'm crawling, nutch throw this error.
Cannot run program "chmod": java.io.IOException: error=12, Cannot allocate memory
but if i try to crawl again so the error es with another site, any body can suggest me how to solve this problem.
This is a part of my log file.
*****************************************************************************************
2012-05-30 14:15:47,468 INFO crawl.Crawl - crawl started in: crawl
2012-05-30 14:15:47,480 INFO crawl.Crawl - rootUrlDir = urls
2012-05-30 14:15:47,480 INFO crawl.Crawl - threads = 10
2012-05-30 14:15:47,480 INFO crawl.Crawl - depth = 5
2012-05-30 14:15:47,480 INFO crawl.Crawl - solrUrl=http://localhost:8080/solr
2012-05-30 14:15:47,480 INFO crawl.Crawl - topN = 300
*
*
*
*
*
2012-05-30 14:17:26,147 INFO parse.ParseSegment - Parsing: http://www.uci.cu/
2012-05-30 14:17:26,262 WARN mapred.LocalJobRunner - job_local_0011
java.io.IOException: Cannot run program "chmod": java.io.IOException: error=12, Cannot allocate memory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:149)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286)
****************************************************************************************
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: Cannot run program "chmod"
Posted by Sebastian Nagel <wa...@googlemail.com>.
This is not really a problem of Nutch. The fork to run the command "chmod" failed
because your machine does not have enough memory (RAM + swap).
For more information you should google for
error=12, Cannot allocate memory
hadoop error=12
Possible solutions (assuming you are using Linux):
look for how to "overcommit memory"
increase the swap space
Sebastian
-------- Original Message --------
Subject: Cannot run program "chmod"
Date: Wed, 30 May 2012 14:46:20 -0400 (CDT)
From: Ing. Eyeris Rodriguez Rueda <er...@uci.cu>
Reply-To: user@nutch.apache.org
To: user@nutch.apache.org
Hi all.
When i'm crawling, nutch throw this error.
Cannot run program "chmod": java.io.IOException: error=12, Cannot allocate memory
but if i try to crawl again so the error es with another site, any body can suggest me how to solve
this problem.
This is a part of my log file.
*****************************************************************************************
2012-05-30 14:15:47,468 INFO crawl.Crawl - crawl started in: crawl
2012-05-30 14:15:47,480 INFO crawl.Crawl - rootUrlDir = urls
2012-05-30 14:15:47,480 INFO crawl.Crawl - threads = 10
2012-05-30 14:15:47,480 INFO crawl.Crawl - depth = 5
2012-05-30 14:15:47,480 INFO crawl.Crawl - solrUrl=http://localhost:8080/solr
2012-05-30 14:15:47,480 INFO crawl.Crawl - topN = 300
*
*
*
*
*
2012-05-30 14:17:26,147 INFO parse.ParseSegment - Parsing: http://www.uci.cu/
2012-05-30 14:17:26,262 WARN mapred.LocalJobRunner - job_local_0011
java.io.IOException: Cannot run program "chmod": java.io.IOException: error=12, Cannot allocate memory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:475)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:149)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:286)
*****************************************************************************************
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci