You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by kiranprasad <ki...@imimobile.com> on 2011/09/14 13:32:49 UTC
Starting Hadoop File System process getting Stuck
Hi
I am trying to start the PIG in hadoop mode, but it is getting stuck. Pls help.
Below is where the process is getting stuck.
[kiranprasad.g@pig4 pig-0.8.1]$ bin/pig
2011-09-14 21:48:25,589 [main] INFO org.apache.pig.Main - Logging error messages to: /home/kiranprasad.g/pig-0.8.1/pig_1316017105587.log
2011-09-14 21:48:25,784 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://10.0.0.61:8020
Regards
Kiran.G
Re: Starting Hadoop File System process getting Stuck
Posted by 唐亮 <le...@gmail.com>.
I used to encounter this problem, and I believe I will encounter it again.
Maybe the network connection is not ok.
2011/9/15, kiranprasad <ki...@imimobile.com>:
> Let me know where am I doing wrong.
> can I create a hadoop cluster on windows machine using Cygwin.
>
> -----Original Message-----
> From: kiranprasad
> Sent: Thursday, September 15, 2011 10:21 AM
> To: user@pig.apache.org
> Subject: Re: Starting Hadoop File System process getting Stuck
>
> Hi
>
> I ve tried with hadoop fs -ls but still facing the same problem.
>
> [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/start-all.sh
> starting namenode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-namenode-pig4.out
> 10.0.0.62: starting datanode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig3.out
> 10.0.0.63: starting datanode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig2.out
> 10.0.0.61: starting secondarynamenode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-secondarynamenode-pig4.out
> starting jobtracker, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-jobtracker-pig4.out
> 10.0.0.63: starting tasktracker, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig2.out
> 10.0.0.62: starting tasktracker, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig3.out
> [kiranprasad.g@pig4 hadoop-0.20.2]$
> [kiranprasad.g@pig4 hadoop-0.20.2]$
> [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls
>
> After this it stopped running, it got stucked.
>
>
> Kiran
>
> -----Original Message-----
> From: Alan Gates
> Sent: Thursday, September 15, 2011 2:26 AM
> To: user@pig.apache.org
> Subject: Re: Starting Hadoop File System process getting Stuck
>
> If you run hadoop directly (doing something like: bin/hadoop fs -ls) can you
> connect?
>
> Alan.
>
> On Sep 14, 2011, at 4:32 AM, kiranprasad wrote:
>
>> Hi
>>
>> I am trying to start the PIG in hadoop mode, but it is getting stuck. Pls
>> help.
>> Below is where the process is getting stuck.
>>
>> [kiranprasad.g@pig4 pig-0.8.1]$ bin/pig
>> 2011-09-14 21:48:25,589 [main] INFO org.apache.pig.Main - Logging error
>> messages to: /home/kiranprasad.g/pig-0.8.1/pig_1316017105587.log
>> 2011-09-14 21:48:25,784 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
>> Connecting to hadoop file system at: hdfs://10.0.0.61:8020
>>
>> Regards
>> Kiran.G
>
>
>
>
Re: Starting Hadoop File System process getting Stuck
Posted by Alan Gates <ga...@hortonworks.com>.
You are not able to connect to hdfs from your client. I don't know why. Officially Hadoop supports using windows as a client. I haven't tried it so I don't know how well that works. You might ask on the list hdfs-user@hadoop.apache.org
Alan.
On Sep 14, 2011, at 11:46 PM, kiranprasad wrote:
> Let me know where am I doing wrong.
> can I create a hadoop cluster on windows machine using Cygwin.
>
> -----Original Message----- From: kiranprasad
> Sent: Thursday, September 15, 2011 10:21 AM
> To: user@pig.apache.org
> Subject: Re: Starting Hadoop File System process getting Stuck
>
> Hi
>
> I ve tried with hadoop fs -ls but still facing the same problem.
>
> [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/start-all.sh
> starting namenode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-namenode-pig4.out
> 10.0.0.62: starting datanode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig3.out
> 10.0.0.63: starting datanode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig2.out
> 10.0.0.61: starting secondarynamenode, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-secondarynamenode-pig4.out
> starting jobtracker, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-jobtracker-pig4.out
> 10.0.0.63: starting tasktracker, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig2.out
> 10.0.0.62: starting tasktracker, logging to
> /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig3.out
> [kiranprasad.g@pig4 hadoop-0.20.2]$
> [kiranprasad.g@pig4 hadoop-0.20.2]$
> [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls
>
> After this it stopped running, it got stucked.
>
>
> Kiran
>
> -----Original Message----- From: Alan Gates
> Sent: Thursday, September 15, 2011 2:26 AM
> To: user@pig.apache.org
> Subject: Re: Starting Hadoop File System process getting Stuck
>
> If you run hadoop directly (doing something like: bin/hadoop fs -ls) can you
> connect?
>
> Alan.
>
> On Sep 14, 2011, at 4:32 AM, kiranprasad wrote:
>
>> Hi
>>
>> I am trying to start the PIG in hadoop mode, but it is getting stuck. Pls help.
>> Below is where the process is getting stuck.
>>
>> [kiranprasad.g@pig4 pig-0.8.1]$ bin/pig
>> 2011-09-14 21:48:25,589 [main] INFO org.apache.pig.Main - Logging error messages to: /home/kiranprasad.g/pig-0.8.1/pig_1316017105587.log
>> 2011-09-14 21:48:25,784 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://10.0.0.61:8020
>>
>> Regards
>> Kiran.G
>
>
>
Re: Starting Hadoop File System process getting Stuck
Posted by kiranprasad <ki...@imimobile.com>.
Let me know where am I doing wrong.
can I create a hadoop cluster on windows machine using Cygwin.
-----Original Message-----
From: kiranprasad
Sent: Thursday, September 15, 2011 10:21 AM
To: user@pig.apache.org
Subject: Re: Starting Hadoop File System process getting Stuck
Hi
I ve tried with hadoop fs -ls but still facing the same problem.
[kiranprasad.g@pig4 hadoop-0.20.2]$ bin/start-all.sh
starting namenode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-namenode-pig4.out
10.0.0.62: starting datanode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig3.out
10.0.0.63: starting datanode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig2.out
10.0.0.61: starting secondarynamenode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-secondarynamenode-pig4.out
starting jobtracker, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-jobtracker-pig4.out
10.0.0.63: starting tasktracker, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig2.out
10.0.0.62: starting tasktracker, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig3.out
[kiranprasad.g@pig4 hadoop-0.20.2]$
[kiranprasad.g@pig4 hadoop-0.20.2]$
[kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls
After this it stopped running, it got stucked.
Kiran
-----Original Message-----
From: Alan Gates
Sent: Thursday, September 15, 2011 2:26 AM
To: user@pig.apache.org
Subject: Re: Starting Hadoop File System process getting Stuck
If you run hadoop directly (doing something like: bin/hadoop fs -ls) can you
connect?
Alan.
On Sep 14, 2011, at 4:32 AM, kiranprasad wrote:
> Hi
>
> I am trying to start the PIG in hadoop mode, but it is getting stuck. Pls
> help.
> Below is where the process is getting stuck.
>
> [kiranprasad.g@pig4 pig-0.8.1]$ bin/pig
> 2011-09-14 21:48:25,589 [main] INFO org.apache.pig.Main - Logging error
> messages to: /home/kiranprasad.g/pig-0.8.1/pig_1316017105587.log
> 2011-09-14 21:48:25,784 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting to hadoop file system at: hdfs://10.0.0.61:8020
>
> Regards
> Kiran.G
Re: Starting Hadoop File System process getting Stuck
Posted by kiranprasad <ki...@imimobile.com>.
Hi
I ve tried with hadoop fs -ls but still facing the same problem.
[kiranprasad.g@pig4 hadoop-0.20.2]$ bin/start-all.sh
starting namenode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-namenode-pig4.out
10.0.0.62: starting datanode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig3.out
10.0.0.63: starting datanode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datanode-pig2.out
10.0.0.61: starting secondarynamenode, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-secondarynamenode-pig4.out
starting jobtracker, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-jobtracker-pig4.out
10.0.0.63: starting tasktracker, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig2.out
10.0.0.62: starting tasktracker, logging to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktracker-pig3.out
[kiranprasad.g@pig4 hadoop-0.20.2]$
[kiranprasad.g@pig4 hadoop-0.20.2]$
[kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls
After this it stopped running, it got stucked.
Kiran
-----Original Message-----
From: Alan Gates
Sent: Thursday, September 15, 2011 2:26 AM
To: user@pig.apache.org
Subject: Re: Starting Hadoop File System process getting Stuck
If you run hadoop directly (doing something like: bin/hadoop fs -ls) can you
connect?
Alan.
On Sep 14, 2011, at 4:32 AM, kiranprasad wrote:
> Hi
>
> I am trying to start the PIG in hadoop mode, but it is getting stuck. Pls
> help.
> Below is where the process is getting stuck.
>
> [kiranprasad.g@pig4 pig-0.8.1]$ bin/pig
> 2011-09-14 21:48:25,589 [main] INFO org.apache.pig.Main - Logging error
> messages to: /home/kiranprasad.g/pig-0.8.1/pig_1316017105587.log
> 2011-09-14 21:48:25,784 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting to hadoop file system at: hdfs://10.0.0.61:8020
>
> Regards
> Kiran.G
Re: Starting Hadoop File System process getting Stuck
Posted by Alan Gates <ga...@hortonworks.com>.
If you run hadoop directly (doing something like: bin/hadoop fs -ls) can you connect?
Alan.
On Sep 14, 2011, at 4:32 AM, kiranprasad wrote:
> Hi
>
> I am trying to start the PIG in hadoop mode, but it is getting stuck. Pls help.
> Below is where the process is getting stuck.
>
> [kiranprasad.g@pig4 pig-0.8.1]$ bin/pig
> 2011-09-14 21:48:25,589 [main] INFO org.apache.pig.Main - Logging error messages to: /home/kiranprasad.g/pig-0.8.1/pig_1316017105587.log
> 2011-09-14 21:48:25,784 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://10.0.0.61:8020
>
> Regards
> Kiran.G