You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Joo Cat <jo...@hotmail.com> on 2016/02/26 04:24:39 UTC
Setting up a Hadoop Multi Node Cluster in Windows
After much trial and error, I managed to set up a single node for Windows. So, now I want to try setting up a Hadoop cluster between 2 Windows PC. However, I could not find much information regarding it. The very few search results used Cygwin but I thought that Cygwin is no longer supported anymore.
Can someone point me to the right direction? What other methods of connection that can be used besides Cygwin? Thank you.
Re: Setting up a Hadoop Multi Node Cluster in Windows
Posted by karthi keyan <ka...@gmail.com>.
Hi,
For windows you can look into
https://wiki.apache.org/hadoop/Hadoop2OnWindows , By building it via maven
you can able to handle the batch/executables (.cmd) to work with windows.
Hope you tired like this approach to set up a pseudo node cluster.
Then follow steps
http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/ClusterSetup.html
for
cluster, executable are generated according to the .sh files. Ensure proper
DNS resolution between the nodes and kick start the Cluster.
Best,
Karthik
On Fri, Feb 26, 2016 at 8:54 AM, Joo Cat <jo...@hotmail.com> wrote:
> After much trial and error, I managed to set up a single node for Windows.
> So, now I want to try setting up a Hadoop cluster between 2 Windows PC.
> However, I could not find much information regarding it. The very few
> search results used Cygwin but I thought that Cygwin is no longer supported
> anymore.
>
>
> Can someone point me to the right direction? What other methods of
> connection that can be used besides Cygwin? Thank you.
>
Re: Setting up a Hadoop Multi Node Cluster in Windows
Posted by karthi keyan <ka...@gmail.com>.
Hi,
For windows you can look into
https://wiki.apache.org/hadoop/Hadoop2OnWindows , By building it via maven
you can able to handle the batch/executables (.cmd) to work with windows.
Hope you tired like this approach to set up a pseudo node cluster.
Then follow steps
http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/ClusterSetup.html
for
cluster, executable are generated according to the .sh files. Ensure proper
DNS resolution between the nodes and kick start the Cluster.
Best,
Karthik
On Fri, Feb 26, 2016 at 8:54 AM, Joo Cat <jo...@hotmail.com> wrote:
> After much trial and error, I managed to set up a single node for Windows.
> So, now I want to try setting up a Hadoop cluster between 2 Windows PC.
> However, I could not find much information regarding it. The very few
> search results used Cygwin but I thought that Cygwin is no longer supported
> anymore.
>
>
> Can someone point me to the right direction? What other methods of
> connection that can be used besides Cygwin? Thank you.
>
Re: Setting up a Hadoop Multi Node Cluster in Windows
Posted by karthi keyan <ka...@gmail.com>.
Hi,
For windows you can look into
https://wiki.apache.org/hadoop/Hadoop2OnWindows , By building it via maven
you can able to handle the batch/executables (.cmd) to work with windows.
Hope you tired like this approach to set up a pseudo node cluster.
Then follow steps
http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/ClusterSetup.html
for
cluster, executable are generated according to the .sh files. Ensure proper
DNS resolution between the nodes and kick start the Cluster.
Best,
Karthik
On Fri, Feb 26, 2016 at 8:54 AM, Joo Cat <jo...@hotmail.com> wrote:
> After much trial and error, I managed to set up a single node for Windows.
> So, now I want to try setting up a Hadoop cluster between 2 Windows PC.
> However, I could not find much information regarding it. The very few
> search results used Cygwin but I thought that Cygwin is no longer supported
> anymore.
>
>
> Can someone point me to the right direction? What other methods of
> connection that can be used besides Cygwin? Thank you.
>
Re: Setting up a Hadoop Multi Node Cluster in Windows
Posted by karthi keyan <ka...@gmail.com>.
Hi,
For windows you can look into
https://wiki.apache.org/hadoop/Hadoop2OnWindows , By building it via maven
you can able to handle the batch/executables (.cmd) to work with windows.
Hope you tired like this approach to set up a pseudo node cluster.
Then follow steps
http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/ClusterSetup.html
for
cluster, executable are generated according to the .sh files. Ensure proper
DNS resolution between the nodes and kick start the Cluster.
Best,
Karthik
On Fri, Feb 26, 2016 at 8:54 AM, Joo Cat <jo...@hotmail.com> wrote:
> After much trial and error, I managed to set up a single node for Windows.
> So, now I want to try setting up a Hadoop cluster between 2 Windows PC.
> However, I could not find much information regarding it. The very few
> search results used Cygwin but I thought that Cygwin is no longer supported
> anymore.
>
>
> Can someone point me to the right direction? What other methods of
> connection that can be used besides Cygwin? Thank you.
>