You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Sathyam Y <sa...@yahoo.com> on 2007/10/09 18:52:58 UTC
Nutch/Hadoop on EC2
Has anyone had any experience running nutch/hadoop on EC2. I am running into an error while trying to access dfs during my initial setup:
I just tried a simple configuration with a single machine acting as master&slave.
"bin/hadoop -dfs put urls urls"
ipc.Server - IPC Server handler 4 on 9000 call error: java.io.IOException: failed to create file /user/nutch/urls/.urllist.txt.crc on client because target-length is 0, below MIN_REPLICATION (1)
Has anyone seen a similar error?
---------------------------------
Need a vacation? Get great deals to amazing places on Yahoo! Travel.
RE: Nutch/Hardtop on EC2
Posted by Sathyam Y <sa...@yahoo.com>.
This turned out to be a simple disk space issue. My bad !!, although the error message was quite cryptic.
Thanks.
Balachanthar <ba...@gmail.com> wrote:
Hi sathyam,
I think ther is a problem in your setting if u can give me your setting give I can check it out.
bala
-----Original Message-----
From: Sathyam Y [mailto:sathyamyy@yahoo.com]
Sent: Wednesday, October 10, 2007 2:21 AM
To: nutch-user@lucene.apache.org
Subject: Re: Nutch/Hadoop on EC2
I am using Nutch0.9/Hadoop 0.12.2
Doßacan Güney wrote:
On 10/9/07, Sathyam Y wrote:
> Has anyone had any experience running nutch/hadoop on EC2. I am running into an error while trying to access dfs during my initial setup:
>
> I just tried a simple configuration with a single machine acting as master&slave.
>
> "bin/hadoop -dfs put urls urls"
>
> ipc.Server - IPC Server handler 4 on 9000 call error: java.io.IOException: failed to create file /user/nutch/urls/.urllist.txt.crc on client because target-length is 0, below MIN_REPLICATION (1)
>
> Has anyone seen a similar error?
Which version of nutch/hadoop are you using?
>
>
>
>
>
> ---------------------------------
> Need a vacation? Get great deals to amazing places on Yahoo! Travel.
--
Doßacan Güney
---------------------------------
Need a vacation? Get great deals to amazing places on Yahoo! Travel.
---------------------------------
Need a vacation? Get great deals to amazing places on Yahoo! Travel.
RE: Nutch/Hardtop on EC2
Posted by Balachanthar <ba...@gmail.com>.
Hi sathyam,
I think ther is a problem in your setting if u can give me your setting give I can check it out.
bala
-----Original Message-----
From: Sathyam Y [mailto:sathyamyy@yahoo.com]
Sent: Wednesday, October 10, 2007 2:21 AM
To: nutch-user@lucene.apache.org
Subject: Re: Nutch/Hadoop on EC2
I am using Nutch0.9/Hadoop 0.12.2
Doğacan Güney <do...@gmail.com> wrote:
On 10/9/07, Sathyam Y wrote:
> Has anyone had any experience running nutch/hadoop on EC2. I am running into an error while trying to access dfs during my initial setup:
>
> I just tried a simple configuration with a single machine acting as master&slave.
>
> "bin/hadoop -dfs put urls urls"
>
> ipc.Server - IPC Server handler 4 on 9000 call error: java.io.IOException: failed to create file /user/nutch/urls/.urllist.txt.crc on client because target-length is 0, below MIN_REPLICATION (1)
>
> Has anyone seen a similar error?
Which version of nutch/hadoop are you using?
>
>
>
>
>
> ---------------------------------
> Need a vacation? Get great deals to amazing places on Yahoo! Travel.
--
Doğacan Güney
---------------------------------
Need a vacation? Get great deals to amazing places on Yahoo! Travel.
Re: Nutch/Hadoop on EC2
Posted by Sathyam Y <sa...@yahoo.com>.
I am using Nutch0.9/Hadoop 0.12.2
DoÄacan Güney <do...@gmail.com> wrote:
On 10/9/07, Sathyam Y wrote:
> Has anyone had any experience running nutch/hadoop on EC2. I am running into an error while trying to access dfs during my initial setup:
>
> I just tried a simple configuration with a single machine acting as master&slave.
>
> "bin/hadoop -dfs put urls urls"
>
> ipc.Server - IPC Server handler 4 on 9000 call error: java.io.IOException: failed to create file /user/nutch/urls/.urllist.txt.crc on client because target-length is 0, below MIN_REPLICATION (1)
>
> Has anyone seen a similar error?
Which version of nutch/hadoop are you using?
>
>
>
>
>
> ---------------------------------
> Need a vacation? Get great deals to amazing places on Yahoo! Travel.
--
DoÄacan Güney
---------------------------------
Need a vacation? Get great deals to amazing places on Yahoo! Travel.
Re: Nutch/Hadoop on EC2
Posted by Doğacan Güney <do...@gmail.com>.
On 10/9/07, Sathyam Y <sa...@yahoo.com> wrote:
> Has anyone had any experience running nutch/hadoop on EC2. I am running into an error while trying to access dfs during my initial setup:
>
> I just tried a simple configuration with a single machine acting as master&slave.
>
> "bin/hadoop -dfs put urls urls"
>
> ipc.Server - IPC Server handler 4 on 9000 call error: java.io.IOException: failed to create file /user/nutch/urls/.urllist.txt.crc on client because target-length is 0, below MIN_REPLICATION (1)
>
> Has anyone seen a similar error?
Which version of nutch/hadoop are you using?
>
>
>
>
>
> ---------------------------------
> Need a vacation? Get great deals to amazing places on Yahoo! Travel.
--
Doğacan Güney