You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Anil Jagtap <an...@gmail.com> on 2015/01/03 07:32:16 UTC
Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on
how to configure multi node. I tried couple of them and i really don't
understand why Am i not able to configure it.. I have a feeling that these
experts in their blogs omit out something thinking that its not necessary
to publish since its a small thing and the person who is configuring is
good enough to understand but the fact is there are people like me who are
completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and
every step on how to configure single node, then add another node and
finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of
time in searching and trying it out.. Attached one i found and this helped
me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to
configure my own so i can fit 2 nodes in the same memory what Cloudier
uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG,
HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible
earliest.
Kind Regards,
Anil
Re: Multinode setup..
Posted by Shekhar Sharma <sh...@gmail.com>.
Have you done the following:
(1) Edit masters and slaves file
(2) Edit mapred and core site.xml
(3) delete the hadoop-temp folder (folder as specified by either
dfs.data.dir and dfs.name.dir)
(4) format the namenode (hadoop namenode -format)
(5) start the cluster
Regards,
Som Shekhar Sharma
+91-8197243810
On Sat, Jan 3, 2015 at 12:35 PM, Anil Jagtap <an...@gmail.com> wrote:
> I have a single node already set as per the pdf instructions.
> I cloned this node and want to set as a slave.
> How do I do this ?
>
>
> Rgds, Anil
>
> Sent from my iPhone
>
>
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step
> were you stuck at?
>
> ------------------------------
> bit1129@163.com
>
>
> *From:* Anil Jagtap <an...@gmail.com>
> *Date:* 2015-01-03 14:32
> *To:* user <us...@hadoop.apache.org>
> *Subject:* Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles
> on how to configure multi node. I tried couple of them and i really don't
> understand why Am i not able to configure it.. I have a feeling that these
> experts in their blogs omit out something thinking that its not necessary
> to publish since its a small thing and the person who is configuring is
> good enough to understand but the fact is there are people like me who are
> completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and
> every step on how to configure single node, then add another node and
> finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of
> time in searching and trying it out.. Attached one i found and this helped
> me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to
> configure my own so i can fit 2 nodes in the same memory what Cloudier
> uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop,
> PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible
> earliest.
>
> Kind Regards,
>
> Anil
> [image: 提示图标] 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 *1* 个附件
> hadoop.pdf(358K) 极速下载
> <http://preview.mail.163.com/xdownload?filename=hadoop.pdf&mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
> 在线预览
> <http://preview.mail.163.com/preview?mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
>
>
Re: Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
1. There is a slaves file in the conf dir. Add the slave's IP in it.
2. Configure SSH for each node to logon the other without password
3. Format the the already running node, with hdfs namenode -format
4. starup the Master
Then, at this point, if you encounter problem, the problem will be specific, which you can google for answers.
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 15:05
To: user@hadoop.apache.org
Subject: Re: Multinode setup..
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
1. There is a slaves file in the conf dir. Add the slave's IP in it.
2. Configure SSH for each node to logon the other without password
3. Format the the already running node, with hdfs namenode -format
4. starup the Master
Then, at this point, if you encounter problem, the problem will be specific, which you can google for answers.
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 15:05
To: user@hadoop.apache.org
Subject: Re: Multinode setup..
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Multinode setup..
Posted by Shekhar Sharma <sh...@gmail.com>.
Have you done the following:
(1) Edit masters and slaves file
(2) Edit mapred and core site.xml
(3) delete the hadoop-temp folder (folder as specified by either
dfs.data.dir and dfs.name.dir)
(4) format the namenode (hadoop namenode -format)
(5) start the cluster
Regards,
Som Shekhar Sharma
+91-8197243810
On Sat, Jan 3, 2015 at 12:35 PM, Anil Jagtap <an...@gmail.com> wrote:
> I have a single node already set as per the pdf instructions.
> I cloned this node and want to set as a slave.
> How do I do this ?
>
>
> Rgds, Anil
>
> Sent from my iPhone
>
>
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step
> were you stuck at?
>
> ------------------------------
> bit1129@163.com
>
>
> *From:* Anil Jagtap <an...@gmail.com>
> *Date:* 2015-01-03 14:32
> *To:* user <us...@hadoop.apache.org>
> *Subject:* Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles
> on how to configure multi node. I tried couple of them and i really don't
> understand why Am i not able to configure it.. I have a feeling that these
> experts in their blogs omit out something thinking that its not necessary
> to publish since its a small thing and the person who is configuring is
> good enough to understand but the fact is there are people like me who are
> completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and
> every step on how to configure single node, then add another node and
> finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of
> time in searching and trying it out.. Attached one i found and this helped
> me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to
> configure my own so i can fit 2 nodes in the same memory what Cloudier
> uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop,
> PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible
> earliest.
>
> Kind Regards,
>
> Anil
> [image: 提示图标] 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 *1* 个附件
> hadoop.pdf(358K) 极速下载
> <http://preview.mail.163.com/xdownload?filename=hadoop.pdf&mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
> 在线预览
> <http://preview.mail.163.com/preview?mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
>
>
Re: Multinode setup..
Posted by Shekhar Sharma <sh...@gmail.com>.
Have you done the following:
(1) Edit masters and slaves file
(2) Edit mapred and core site.xml
(3) delete the hadoop-temp folder (folder as specified by either
dfs.data.dir and dfs.name.dir)
(4) format the namenode (hadoop namenode -format)
(5) start the cluster
Regards,
Som Shekhar Sharma
+91-8197243810
On Sat, Jan 3, 2015 at 12:35 PM, Anil Jagtap <an...@gmail.com> wrote:
> I have a single node already set as per the pdf instructions.
> I cloned this node and want to set as a slave.
> How do I do this ?
>
>
> Rgds, Anil
>
> Sent from my iPhone
>
>
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step
> were you stuck at?
>
> ------------------------------
> bit1129@163.com
>
>
> *From:* Anil Jagtap <an...@gmail.com>
> *Date:* 2015-01-03 14:32
> *To:* user <us...@hadoop.apache.org>
> *Subject:* Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles
> on how to configure multi node. I tried couple of them and i really don't
> understand why Am i not able to configure it.. I have a feeling that these
> experts in their blogs omit out something thinking that its not necessary
> to publish since its a small thing and the person who is configuring is
> good enough to understand but the fact is there are people like me who are
> completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and
> every step on how to configure single node, then add another node and
> finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of
> time in searching and trying it out.. Attached one i found and this helped
> me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to
> configure my own so i can fit 2 nodes in the same memory what Cloudier
> uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop,
> PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible
> earliest.
>
> Kind Regards,
>
> Anil
> [image: 提示图标] 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 *1* 个附件
> hadoop.pdf(358K) 极速下载
> <http://preview.mail.163.com/xdownload?filename=hadoop.pdf&mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
> 在线预览
> <http://preview.mail.163.com/preview?mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
>
>
Re: Multinode setup..
Posted by Shekhar Sharma <sh...@gmail.com>.
Have you done the following:
(1) Edit masters and slaves file
(2) Edit mapred and core site.xml
(3) delete the hadoop-temp folder (folder as specified by either
dfs.data.dir and dfs.name.dir)
(4) format the namenode (hadoop namenode -format)
(5) start the cluster
Regards,
Som Shekhar Sharma
+91-8197243810
On Sat, Jan 3, 2015 at 12:35 PM, Anil Jagtap <an...@gmail.com> wrote:
> I have a single node already set as per the pdf instructions.
> I cloned this node and want to set as a slave.
> How do I do this ?
>
>
> Rgds, Anil
>
> Sent from my iPhone
>
>
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step
> were you stuck at?
>
> ------------------------------
> bit1129@163.com
>
>
> *From:* Anil Jagtap <an...@gmail.com>
> *Date:* 2015-01-03 14:32
> *To:* user <us...@hadoop.apache.org>
> *Subject:* Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles
> on how to configure multi node. I tried couple of them and i really don't
> understand why Am i not able to configure it.. I have a feeling that these
> experts in their blogs omit out something thinking that its not necessary
> to publish since its a small thing and the person who is configuring is
> good enough to understand but the fact is there are people like me who are
> completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and
> every step on how to configure single node, then add another node and
> finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of
> time in searching and trying it out.. Attached one i found and this helped
> me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to
> configure my own so i can fit 2 nodes in the same memory what Cloudier
> uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop,
> PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible
> earliest.
>
> Kind Regards,
>
> Anil
> [image: 提示图标] 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 *1* 个附件
> hadoop.pdf(358K) 极速下载
> <http://preview.mail.163.com/xdownload?filename=hadoop.pdf&mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
> 在线预览
> <http://preview.mail.163.com/preview?mid=1tbiwBZ2gVD%2BZNNS5QAAsP&part=3&sign=7fd640a0408de2892526962cd4e91166&time=1420268160&uid=bit1129%40163.com>
>
>
Re: Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
1. There is a slaves file in the conf dir. Add the slave's IP in it.
2. Configure SSH for each node to logon the other without password
3. Format the the already running node, with hdfs namenode -format
4. starup the Master
Then, at this point, if you encounter problem, the problem will be specific, which you can google for answers.
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 15:05
To: user@hadoop.apache.org
Subject: Re: Multinode setup..
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
1. There is a slaves file in the conf dir. Add the slave's IP in it.
2. Configure SSH for each node to logon the other without password
3. Format the the already running node, with hdfs namenode -format
4. starup the Master
Then, at this point, if you encounter problem, the problem will be specific, which you can google for answers.
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 15:05
To: user@hadoop.apache.org
Subject: Re: Multinode setup..
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Multinode setup..
Posted by Anil Jagtap <an...@gmail.com>.
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
>
> bit1129@163.com
>
> From: Anil Jagtap
> Date: 2015-01-03 14:32
> To: user
> Subject: Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible earliest.
>
> Kind Regards,
>
> Anil
> 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 1 个附件
> hadoop.pdf(358K)
> 极速下载 在线预览
Re: Multinode setup..
Posted by Anil Jagtap <an...@gmail.com>.
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
>
> bit1129@163.com
>
> From: Anil Jagtap
> Date: 2015-01-03 14:32
> To: user
> Subject: Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible earliest.
>
> Kind Regards,
>
> Anil
> 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 1 个附件
> hadoop.pdf(358K)
> 极速下载 在线预览
Re: Multinode setup..
Posted by Anil Jagtap <an...@gmail.com>.
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
>
> bit1129@163.com
>
> From: Anil Jagtap
> Date: 2015-01-03 14:32
> To: user
> Subject: Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible earliest.
>
> Kind Regards,
>
> Anil
> 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 1 个附件
> hadoop.pdf(358K)
> 极速下载 在线预览
Re: Multinode setup..
Posted by Anil Jagtap <an...@gmail.com>.
I have a single node already set as per the pdf instructions.
I cloned this node and want to set as a slave.
How do I do this ?
Rgds, Anil
Sent from my iPhone
> On 3 Jan 2015, at 18:00, "bit1129@163.com" <bi...@163.com> wrote:
>
> Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
>
> bit1129@163.com
>
> From: Anil Jagtap
> Date: 2015-01-03 14:32
> To: user
> Subject: Multinode setup..
> Dear All,
>
> Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
>
> So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
>
> Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
>
> I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
>
> Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
>
> If anyone can share their multi node VM's would be really great.
>
> Thanks to all in advance and expecting good feedback at the possible earliest.
>
> Kind Regards,
>
> Anil
> 邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
> 共有 1 个附件
> hadoop.pdf(358K)
> 极速下载 在线预览
Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览
Re: Multinode setup..
Posted by "bit1129@163.com" <bi...@163.com>.
Setting Haddop in real distributed cluster isn't that complex, Which step were you stuck at?
bit1129@163.com
From: Anil Jagtap
Date: 2015-01-03 14:32
To: user
Subject: Multinode setup..
Dear All,
Im trying to setup a multi node cluster and I found millions of articles on how to configure multi node. I tried couple of them and i really don't understand why Am i not able to configure it.. I have a feeling that these experts in their blogs omit out something thinking that its not necessary to publish since its a small thing and the person who is configuring is good enough to understand but the fact is there are people like me who are completely new to Hadoop, Linux & Java as well.
So does any one has some kind of material who literally tells me each and every step on how to configure single node, then add another node and finally link it..
Sorry to ask this granular detail but trust me i had wasted good amount of time in searching and trying it out.. Attached one i found and this helped me in setting up single node successfully.
I can use Cloudra but it consumes lot of memory and hence i want to configure my own so i can fit 2 nodes in the same memory what Cloudier uses. Any VM changes to Cloudera stops working.
Finally, for now do I really need all of the components or just Sqoop, PIG, HBASE & Hive should be sufficient to practise..
If anyone can share their multi node VM's would be really great.
Thanks to all in advance and expecting good feedback at the possible earliest.
Kind Regards,
Anil
邮件带有附件预览链接，若您转发或回复此邮件时不希望对方预览附件，建议您手动删除链接。
共有 1 个附件
hadoop.pdf(358K) 极速下载 在线预览