You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Ia...@barclayscapital.com on 2012/02/07 18:23:59 UTC
Hadoop 1.0 Install Guide
Hi All,
Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
Thanks,
Ian
_______________________________________________
This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
_______________________________________________
RE: Hadoop 1.0 Install Guide
Posted by "Mulcahy, Stephen" <st...@deri.org>.
Hi,
I downloaded and installed hadoop 1.0.0 from tarball just a few days ago and can confirm that the conf directory did exist when I extracted it.
-stephen
--
Stephen Mulcahy, DI2, Digital Enterprise Research Institute,
NUI Galway, IDA Business Park, Lower Dangan, Galway, Ireland
http://di2.deri.ie http://webstar.deri.ie http://sindice.com
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Tue 07-Feb-12 17:43
To: common-user@hadoop.apache.org
Subject: Re: Hadoop 1.0 Install Guide
Your download is correct, but the tarball format seems to have been
completely changed between 0.20.xxx and 1.x, without docs being
changed to adapt to that. Please file a JIRA for this against the
HADOOP project.
Configs, meanwhile, should lie under etc/, given that list.
Patches to documentation would also be welcome!
On Tue, Feb 7, 2012 at 11:03 PM, <Ia...@barclayscapital.com> wrote:
> Are the 1.0 docs definitely correct at http://hadoop.apache.org/common/docs/r1.0.0? The reason that I ask is that it references setup steps that seem valid for the .2* releases, but not for 1.0. For instance the conf directory doesn't exist on my 1.0 install.
>
> Documentation:
>
> Configuration Files
> Hadoop configuration is driven by two types of important configuration files:
>
> 1.Read-only default configuration - src/core/core-default.xml, src/hdfs/hdfs-default.xml and src/mapred/mapred-default.xml.
> 2.Site-specific configuration - conf/core-site.xml, conf/hdfs-site.xml and conf/mapred-site.xml.
>
> Installed Software:
>
>>> DEV $ pwd
> /apps/hadoop/hadoop-1.0.0
>>> DEV $ ls
> bin etc include lib libexec sbin share
>
> Any ideas - perhaps I have a bad version of 1.0?
>
> Ian
>
> -----Original Message-----
> From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
> Sent: Tuesday, February 07, 2012 5:27 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Hadoop 1.0 Install Guide
>
> There's the usual stuff on the website:
> http://hadoop.apache.org/common/docs/r1.0.0/
>
> It has the good old Getting Started and whatnot.
>
> J-D
>
> On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
>> Hi All,
>>
>> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>>
>> Thanks,
>>
>> Ian
>>
>>
>> _______________________________________________
>>
>> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
>> _______________________________________________
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
RE: Hadoop 1.0 Install Guide
Posted by Sh...@cognizant.com.
Hi
I need to do a comparison of Cassandra and Hadoop in terms of
performance optimization.
Can someone help me?
Thanks and Regards,
Shreya Pal
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.
Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful.
RE: Hadoop 1.0 Install Guide
Posted by Ia...@barclayscapital.com.
Thanks to all who responded - I've just downloaded the 1.0 tarball and extracted it, and now have the expected directories. Dunno how that happened!
Regards,
Ian
-----Original Message-----
From: Tim Broberg [mailto:Tim.Broberg@exar.com]
Sent: Tuesday, February 07, 2012 6:49 PM
To: common-user@hadoop.apache.org
Subject: RE: Hadoop 1.0 Install Guide
I'm confused. My 1.0.0 directory structure does have the conf and src directories in the root.
Are we looking at the same thing?
- Tim.
________________________________________
From: Harsh J [harsh@cloudera.com]
Sent: Tuesday, February 07, 2012 9:43 AM
To: common-user@hadoop.apache.org
Subject: Re: Hadoop 1.0 Install Guide
Your download is correct, but the tarball format seems to have been
completely changed between 0.20.xxx and 1.x, without docs being
changed to adapt to that. Please file a JIRA for this against the
HADOOP project.
Configs, meanwhile, should lie under etc/, given that list.
Patches to documentation would also be welcome!
On Tue, Feb 7, 2012 at 11:03 PM, <Ia...@barclayscapital.com> wrote:
> Are the 1.0 docs definitely correct at http://hadoop.apache.org/common/docs/r1.0.0? The reason that I ask is that it references setup steps that seem valid for the .2* releases, but not for 1.0. For instance the conf directory doesn't exist on my 1.0 install.
>
> Documentation:
>
> Configuration Files
> Hadoop configuration is driven by two types of important configuration files:
>
> 1.Read-only default configuration - src/core/core-default.xml, src/hdfs/hdfs-default.xml and src/mapred/mapred-default.xml.
> 2.Site-specific configuration - conf/core-site.xml, conf/hdfs-site.xml and conf/mapred-site.xml.
>
> Installed Software:
>
>>> DEV $ pwd
> /apps/hadoop/hadoop-1.0.0
>>> DEV $ ls
> bin etc include lib libexec sbin share
>
> Any ideas - perhaps I have a bad version of 1.0?
>
> Ian
>
> -----Original Message-----
> From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
> Sent: Tuesday, February 07, 2012 5:27 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Hadoop 1.0 Install Guide
>
> There's the usual stuff on the website:
> http://hadoop.apache.org/common/docs/r1.0.0/
>
> It has the good old Getting Started and whatnot.
>
> J-D
>
> On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
>> Hi All,
>>
>> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>>
>> Thanks,
>>
>> Ian
>>
>>
>> _______________________________________________
>>
>> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
>> _______________________________________________
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
RE: Hadoop 1.0 Install Guide
Posted by Tim Broberg <Ti...@exar.com>.
I'm confused. My 1.0.0 directory structure does have the conf and src directories in the root.
Are we looking at the same thing?
- Tim.
________________________________________
From: Harsh J [harsh@cloudera.com]
Sent: Tuesday, February 07, 2012 9:43 AM
To: common-user@hadoop.apache.org
Subject: Re: Hadoop 1.0 Install Guide
Your download is correct, but the tarball format seems to have been
completely changed between 0.20.xxx and 1.x, without docs being
changed to adapt to that. Please file a JIRA for this against the
HADOOP project.
Configs, meanwhile, should lie under etc/, given that list.
Patches to documentation would also be welcome!
On Tue, Feb 7, 2012 at 11:03 PM, <Ia...@barclayscapital.com> wrote:
> Are the 1.0 docs definitely correct at http://hadoop.apache.org/common/docs/r1.0.0? The reason that I ask is that it references setup steps that seem valid for the .2* releases, but not for 1.0. For instance the conf directory doesn't exist on my 1.0 install.
>
> Documentation:
>
> Configuration Files
> Hadoop configuration is driven by two types of important configuration files:
>
> 1.Read-only default configuration - src/core/core-default.xml, src/hdfs/hdfs-default.xml and src/mapred/mapred-default.xml.
> 2.Site-specific configuration - conf/core-site.xml, conf/hdfs-site.xml and conf/mapred-site.xml.
>
> Installed Software:
>
>>> DEV $ pwd
> /apps/hadoop/hadoop-1.0.0
>>> DEV $ ls
> bin etc include lib libexec sbin share
>
> Any ideas - perhaps I have a bad version of 1.0?
>
> Ian
>
> -----Original Message-----
> From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
> Sent: Tuesday, February 07, 2012 5:27 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Hadoop 1.0 Install Guide
>
> There's the usual stuff on the website:
> http://hadoop.apache.org/common/docs/r1.0.0/
>
> It has the good old Getting Started and whatnot.
>
> J-D
>
> On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
>> Hi All,
>>
>> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>>
>> Thanks,
>>
>> Ian
>>
>>
>> _______________________________________________
>>
>> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
>> _______________________________________________
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
Re: Hadoop 1.0 Install Guide
Posted by Harsh J <ha...@cloudera.com>.
Your download is correct, but the tarball format seems to have been
completely changed between 0.20.xxx and 1.x, without docs being
changed to adapt to that. Please file a JIRA for this against the
HADOOP project.
Configs, meanwhile, should lie under etc/, given that list.
Patches to documentation would also be welcome!
On Tue, Feb 7, 2012 at 11:03 PM, <Ia...@barclayscapital.com> wrote:
> Are the 1.0 docs definitely correct at http://hadoop.apache.org/common/docs/r1.0.0? The reason that I ask is that it references setup steps that seem valid for the .2* releases, but not for 1.0. For instance the conf directory doesn't exist on my 1.0 install.
>
> Documentation:
>
> Configuration Files
> Hadoop configuration is driven by two types of important configuration files:
>
> 1.Read-only default configuration - src/core/core-default.xml, src/hdfs/hdfs-default.xml and src/mapred/mapred-default.xml.
> 2.Site-specific configuration - conf/core-site.xml, conf/hdfs-site.xml and conf/mapred-site.xml.
>
> Installed Software:
>
>>> DEV $ pwd
> /apps/hadoop/hadoop-1.0.0
>>> DEV $ ls
> bin etc include lib libexec sbin share
>
> Any ideas - perhaps I have a bad version of 1.0?
>
> Ian
>
> -----Original Message-----
> From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
> Sent: Tuesday, February 07, 2012 5:27 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Hadoop 1.0 Install Guide
>
> There's the usual stuff on the website:
> http://hadoop.apache.org/common/docs/r1.0.0/
>
> It has the good old Getting Started and whatnot.
>
> J-D
>
> On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
>> Hi All,
>>
>> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>>
>> Thanks,
>>
>> Ian
>>
>>
>> _______________________________________________
>>
>> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
>> _______________________________________________
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
RE: Hadoop 1.0 Install Guide
Posted by Tim Broberg <Ti...@exar.com>.
Bad install? I see conf and src directories:
[tbroberg@san-mothra hadoop]$ tar xzf hadoop-1.0.0.tar.gz
[tbroberg@san-mothra hadoop]$ ls hadoop-1.0.0
bin conf hadoop-core-1.0.0.jar ivy LICENSE.txt share
build.xml contrib hadoop-examples-1.0.0.jar ivy.xml NOTICE.txt src
c++ docs hadoop-test-1.0.0.jar lib README.txt webapps
CHANGES.txt hadoop-ant-1.0.0.jar hadoop-tools-1.0.0.jar libexec sbin
________________________________________
From: Ian.Meyers@barclayscapital.com [Ian.Meyers@barclayscapital.com]
Sent: Tuesday, February 07, 2012 9:33 AM
To: common-user@hadoop.apache.org
Subject: RE: Hadoop 1.0 Install Guide
Are the 1.0 docs definitely correct at http://hadoop.apache.org/common/docs/r1.0.0? The reason that I ask is that it references setup steps that seem valid for the .2* releases, but not for 1.0. For instance the conf directory doesn't exist on my 1.0 install.
Documentation:
Configuration Files
Hadoop configuration is driven by two types of important configuration files:
1.Read-only default configuration - src/core/core-default.xml, src/hdfs/hdfs-default.xml and src/mapred/mapred-default.xml.
2.Site-specific configuration - conf/core-site.xml, conf/hdfs-site.xml and conf/mapred-site.xml.
Installed Software:
>> DEV $ pwd
/apps/hadoop/hadoop-1.0.0
>> DEV $ ls
bin etc include lib libexec sbin share
Any ideas - perhaps I have a bad version of 1.0?
Ian
-----Original Message-----
From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
Sent: Tuesday, February 07, 2012 5:27 PM
To: common-dev@hadoop.apache.org
Subject: Re: Hadoop 1.0 Install Guide
There's the usual stuff on the website:
http://hadoop.apache.org/common/docs/r1.0.0/
It has the good old Getting Started and whatnot.
J-D
On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
> Hi All,
>
> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>
> Thanks,
>
> Ian
>
>
> _______________________________________________
>
> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
> _______________________________________________
The information and any attached documents contained in this message
may be confidential and/or legally privileged. The message is
intended solely for the addressee(s). If you are not the intended
recipient, you are hereby notified that any use, dissemination, or
reproduction is strictly prohibited and may be unlawful. If you are
not the intended recipient, please contact the sender immediately by
return e-mail and destroy all copies of the original message.
RE: Hadoop 1.0 Install Guide
Posted by Ia...@barclayscapital.com.
Are the 1.0 docs definitely correct at http://hadoop.apache.org/common/docs/r1.0.0? The reason that I ask is that it references setup steps that seem valid for the .2* releases, but not for 1.0. For instance the conf directory doesn't exist on my 1.0 install.
Documentation:
Configuration Files
Hadoop configuration is driven by two types of important configuration files:
1.Read-only default configuration - src/core/core-default.xml, src/hdfs/hdfs-default.xml and src/mapred/mapred-default.xml.
2.Site-specific configuration - conf/core-site.xml, conf/hdfs-site.xml and conf/mapred-site.xml.
Installed Software:
>> DEV $ pwd
/apps/hadoop/hadoop-1.0.0
>> DEV $ ls
bin etc include lib libexec sbin share
Any ideas - perhaps I have a bad version of 1.0?
Ian
-----Original Message-----
From: jdcryans@gmail.com [mailto:jdcryans@gmail.com] On Behalf Of Jean-Daniel Cryans
Sent: Tuesday, February 07, 2012 5:27 PM
To: common-dev@hadoop.apache.org
Subject: Re: Hadoop 1.0 Install Guide
There's the usual stuff on the website:
http://hadoop.apache.org/common/docs/r1.0.0/
It has the good old Getting Started and whatnot.
J-D
On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
> Hi All,
>
> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>
> Thanks,
>
> Ian
>
>
> _______________________________________________
>
> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
> _______________________________________________
Re: Hadoop 1.0 Install Guide
Posted by Jean-Daniel Cryans <jd...@apache.org>.
There's the usual stuff on the website:
http://hadoop.apache.org/common/docs/r1.0.0/
It has the good old Getting Started and whatnot.
J-D
On Tue, Feb 7, 2012 at 9:23 AM, <Ia...@barclayscapital.com> wrote:
> Hi All,
>
> Am tearing my hair out trying to find documentation for 1.0. Has it been created yet? If not, does anyone have an idea of when this may be published?
>
> Thanks,
>
> Ian
>
>
> _______________________________________________
>
> This e-mail may contain information that is confidential, privileged or otherwise protected from disclosure. If you are not an intended recipient of this e-mail, do not duplicate or redistribute it by any means. Please delete it and any attachments and notify the sender that you have received it in error. Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays. Any views or opinions presented are solely those of the author and do not necessarily represent those of Barclays. This e-mail is subject to terms available at the following link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent to the foregoing. Barclays Capital is the investment banking division of Barclays Bank PLC, a company registered in England (number 1026167) with its registered office at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent from other members of the Barclays Group.
> _______________________________________________