You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Martin Wunderlich <ma...@wunderlich.com> on 2014/10/12 17:14:37 UTC

Hadoop 2.5.1 - distro not compatible with "quick start"?

Hi all, 

I am just getting started with my first attempts to set up a Hadoop system locally and I have been following this here quick start guide: http://hadoop.apache.org/docs/r0.19.0/quickstart.html

However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following: 
1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1. 
3. The file conf/hadoop-site.xml doesn't seem to exist. 

I am wondering, if I have downloaded the wrong distribution or if I am looking at the wrong quick start guide. 
Any ideas? 
Thanks a lot. 

Cheers, 

Martin
 

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by mark charts <mc...@yahoo.com>.
Martin 
I too am new w/ Hadoop. I noticed that instructions have not been keeping up with the code. hadoop-site.xml is there. You just need to search for it. Same with hadoop-*-examples.jar. It might be renamed. But it should be there. Again search for it. I am surprised there is not ~/conf dir. Double check. They might rearranged the directory hierarchy. I know this is probably of little help to you. I can't dig into this because I'm working on my car now. I'm installing an alternator in a 2003 focus. Fun. Good luck.

Mark Charts 

     On Sunday, October 12, 2014 12:03 PM, Ted Yu <yu...@gmail.com> wrote:
   

 Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?
Cheers
On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com> wrote:

Hi all,

I am just getting started with my first attempts to set up a Hadoop system locally and I have been following this here quick start guide: http://hadoop.apache.org/docs/r0.19.0/quickstart.html

However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
3. The file conf/hadoop-site.xml doesn't seem to exist.

I am wondering, if I have downloaded the wrong distribution or if I am looking at the wrong quick start guide.
Any ideas?
Thanks a lot.

Cheers,

Martin





   

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by mark charts <mc...@yahoo.com>.
Martin 
I too am new w/ Hadoop. I noticed that instructions have not been keeping up with the code. hadoop-site.xml is there. You just need to search for it. Same with hadoop-*-examples.jar. It might be renamed. But it should be there. Again search for it. I am surprised there is not ~/conf dir. Double check. They might rearranged the directory hierarchy. I know this is probably of little help to you. I can't dig into this because I'm working on my car now. I'm installing an alternator in a 2003 focus. Fun. Good luck.

Mark Charts 

     On Sunday, October 12, 2014 12:03 PM, Ted Yu <yu...@gmail.com> wrote:
   

 Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?
Cheers
On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com> wrote:

Hi all,

I am just getting started with my first attempts to set up a Hadoop system locally and I have been following this here quick start guide: http://hadoop.apache.org/docs/r0.19.0/quickstart.html

However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
3. The file conf/hadoop-site.xml doesn't seem to exist.

I am wondering, if I have downloaded the wrong distribution or if I am looking at the wrong quick start guide.
Any ideas?
Thanks a lot.

Cheers,

Martin





   

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by mark charts <mc...@yahoo.com>.
Martin 
I too am new w/ Hadoop. I noticed that instructions have not been keeping up with the code. hadoop-site.xml is there. You just need to search for it. Same with hadoop-*-examples.jar. It might be renamed. But it should be there. Again search for it. I am surprised there is not ~/conf dir. Double check. They might rearranged the directory hierarchy. I know this is probably of little help to you. I can't dig into this because I'm working on my car now. I'm installing an alternator in a 2003 focus. Fun. Good luck.

Mark Charts 

     On Sunday, October 12, 2014 12:03 PM, Ted Yu <yu...@gmail.com> wrote:
   

 Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?
Cheers
On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com> wrote:

Hi all,

I am just getting started with my first attempts to set up a Hadoop system locally and I have been following this here quick start guide: http://hadoop.apache.org/docs/r0.19.0/quickstart.html

However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
3. The file conf/hadoop-site.xml doesn't seem to exist.

I am wondering, if I have downloaded the wrong distribution or if I am looking at the wrong quick start guide.
Any ideas?
Thanks a lot.

Cheers,

Martin





   

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by mark charts <mc...@yahoo.com>.
Martin 
I too am new w/ Hadoop. I noticed that instructions have not been keeping up with the code. hadoop-site.xml is there. You just need to search for it. Same with hadoop-*-examples.jar. It might be renamed. But it should be there. Again search for it. I am surprised there is not ~/conf dir. Double check. They might rearranged the directory hierarchy. I know this is probably of little help to you. I can't dig into this because I'm working on my car now. I'm installing an alternator in a 2003 focus. Fun. Good luck.

Mark Charts 

     On Sunday, October 12, 2014 12:03 PM, Ted Yu <yu...@gmail.com> wrote:
   

 Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?
Cheers
On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com> wrote:

Hi all,

I am just getting started with my first attempts to set up a Hadoop system locally and I have been following this here quick start guide: http://hadoop.apache.org/docs/r0.19.0/quickstart.html

However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
3. The file conf/hadoop-site.xml doesn't seem to exist.

I am wondering, if I have downloaded the wrong distribution or if I am looking at the wrong quick start guide.
Any ideas?
Thanks a lot.

Cheers,

Martin





   

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Ted Yu <yu...@gmail.com>.
Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?

Cheers

On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com>
wrote:

> Hi all,
>
> I am just getting started with my first attempts to set up a Hadoop system
> locally and I have been following this here quick start guide:
> http://hadoop.apache.org/docs/r0.19.0/quickstart.html
>
> However, this guide seems to be out of synch with the 2.5.1. distribution.
> I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in
> /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk
> here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.
>
> I am wondering, if I have downloaded the wrong distribution or if I am
> looking at the wrong quick start guide.
> Any ideas?
> Thanks a lot.
>
> Cheers,
>
> Martin
>
>

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Martin Wunderlich <ma...@wunderlich.com>.
Thanks a lot, Ted, Mark and Tomas. I have found the required files and managed to get my first run of a MapReduce job completed. 
The file "hadoop-site.xml" seems to have been renamed to "hdfs-site.xml"

Cheers, 

Martin
 


Am 13.10.2014 um 04:42 schrieb Tomas Delvechio <to...@yahoo.com.ar>:

> 2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
>> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
>> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
>> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
>> 3. The file conf/hadoop-site.xml doesn't seem to exist.
> 
> In the 2.5.0 version, the config files are in
> <hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
> longer exists.
> 
> In my installation, I found the jar for the examples in
> <hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar
> 
> I hope this helps you.
> 
> -- 
> Tomas Delvechio


Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Martin Wunderlich <ma...@wunderlich.com>.
Thanks a lot, Ted, Mark and Tomas. I have found the required files and managed to get my first run of a MapReduce job completed. 
The file "hadoop-site.xml" seems to have been renamed to "hdfs-site.xml"

Cheers, 

Martin
 


Am 13.10.2014 um 04:42 schrieb Tomas Delvechio <to...@yahoo.com.ar>:

> 2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
>> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
>> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
>> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
>> 3. The file conf/hadoop-site.xml doesn't seem to exist.
> 
> In the 2.5.0 version, the config files are in
> <hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
> longer exists.
> 
> In my installation, I found the jar for the examples in
> <hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar
> 
> I hope this helps you.
> 
> -- 
> Tomas Delvechio


Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Martin Wunderlich <ma...@wunderlich.com>.
Thanks a lot, Ted, Mark and Tomas. I have found the required files and managed to get my first run of a MapReduce job completed. 
The file "hadoop-site.xml" seems to have been renamed to "hdfs-site.xml"

Cheers, 

Martin
 


Am 13.10.2014 um 04:42 schrieb Tomas Delvechio <to...@yahoo.com.ar>:

> 2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
>> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
>> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
>> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
>> 3. The file conf/hadoop-site.xml doesn't seem to exist.
> 
> In the 2.5.0 version, the config files are in
> <hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
> longer exists.
> 
> In my installation, I found the jar for the examples in
> <hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar
> 
> I hope this helps you.
> 
> -- 
> Tomas Delvechio


Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Martin Wunderlich <ma...@wunderlich.com>.
Thanks a lot, Ted, Mark and Tomas. I have found the required files and managed to get my first run of a MapReduce job completed. 
The file "hadoop-site.xml" seems to have been renamed to "hdfs-site.xml"

Cheers, 

Martin
 


Am 13.10.2014 um 04:42 schrieb Tomas Delvechio <to...@yahoo.com.ar>:

> 2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
>> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
>> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
>> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
>> 3. The file conf/hadoop-site.xml doesn't seem to exist.
> 
> In the 2.5.0 version, the config files are in
> <hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
> longer exists.
> 
> In my installation, I found the jar for the examples in
> <hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar
> 
> I hope this helps you.
> 
> -- 
> Tomas Delvechio


Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.

In the 2.5.0 version, the config files are in
<hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
longer exists.

In my installation, I found the jar for the examples in
<hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar

I hope this helps you.

-- 
Tomas Delvechio

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.

In the 2.5.0 version, the config files are in
<hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
longer exists.

In my installation, I found the jar for the examples in
<hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar

I hope this helps you.

-- 
Tomas Delvechio

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Ted Yu <yu...@gmail.com>.
Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?

Cheers

On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com>
wrote:

> Hi all,
>
> I am just getting started with my first attempts to set up a Hadoop system
> locally and I have been following this here quick start guide:
> http://hadoop.apache.org/docs/r0.19.0/quickstart.html
>
> However, this guide seems to be out of synch with the 2.5.1. distribution.
> I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in
> /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk
> here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.
>
> I am wondering, if I have downloaded the wrong distribution or if I am
> looking at the wrong quick start guide.
> Any ideas?
> Thanks a lot.
>
> Cheers,
>
> Martin
>
>

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Ted Yu <yu...@gmail.com>.
Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?

Cheers

On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com>
wrote:

> Hi all,
>
> I am just getting started with my first attempts to set up a Hadoop system
> locally and I have been following this here quick start guide:
> http://hadoop.apache.org/docs/r0.19.0/quickstart.html
>
> However, this guide seems to be out of synch with the 2.5.1. distribution.
> I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in
> /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk
> here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.
>
> I am wondering, if I have downloaded the wrong distribution or if I am
> looking at the wrong quick start guide.
> Any ideas?
> Thanks a lot.
>
> Cheers,
>
> Martin
>
>

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.

In the 2.5.0 version, the config files are in
<hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
longer exists.

In my installation, I found the jar for the examples in
<hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar

I hope this helps you.

-- 
Tomas Delvechio

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Tomas Delvechio <to...@yahoo.com.ar>.
2014-10-12 12:14 GMT-03:00 Martin Wunderlich <ma...@wunderlich.com>:
> However, this guide seems to be out of synch with the 2.5.1. distribution. I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.

In the 2.5.0 version, the config files are in
<hadoop_install_dir>/etc/hadoop (by default). The conf/ directory no
longer exists.

In my installation, I found the jar for the examples in
<hadoop_install_dir>/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar

I hope this helps you.

-- 
Tomas Delvechio

Re: Hadoop 2.5.1 - distro not compatible with "quick start"?

Posted by Ted Yu <yu...@gmail.com>.
Can you take a look at http://hadoop.apache.org/docs/r2.5.1/ ?

Cheers

On Sun, Oct 12, 2014 at 8:14 AM, Martin Wunderlich <ma...@wunderlich.com>
wrote:

> Hi all,
>
> I am just getting started with my first attempts to set up a Hadoop system
> locally and I have been following this here quick start guide:
> http://hadoop.apache.org/docs/r0.19.0/quickstart.html
>
> However, this guide seems to be out of synch with the 2.5.1. distribution.
> I have observed the following:
> 1. There is no /conf directory. The file hadoop-env.sh resides in
> /etc/hadoop.
> 2. There is no hadoop-*-examples.jar file - assuming that the asterisk
> here should be replaced with the version 2.5.1.
> 3. The file conf/hadoop-site.xml doesn't seem to exist.
>
> I am wondering, if I have downloaded the wrong distribution or if I am
> looking at the wrong quick start guide.
> Any ideas?
> Thanks a lot.
>
> Cheers,
>
> Martin
>
>