You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by "K. M. Rakibul Islam" <ra...@gmail.com> on 2013/11/10 23:44:11 UTC

Problem when trying to run hadoop c++ program on Mac OSX

I am totally new to Hadoop. I just installed Hadoop on my Mac OSX and ran
the pi example following
this<http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion>
tutorial.
Now I want to write my own simple C++ program and run that on hadoop. After
googling I could not find any good resource that gets me along the path
step by step (for Mac OSX). What I found so far is,
this<http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C++_Programs_on_Hadoop>
tutorial
which is for Unix. I understand that, I need to write a C++ program, build
that, then put the file in bin directory and then somehow run that. But I
don't know how to do these steps on Mac OSX.

Later, I am trying to follow
this<http://hadoopintouch.blogspot.ca/2012/04/write-your-first-program-in-hadoop-in-c.html>
tutorial
to accomplish my task. But in step 2, when I try to compile my
wordcount.cpp program using g++ command I get the following error:

fatal error: 'hadoop/Pipes.hh' file not found

which means I am not being able to locate the header files correctly. I
tried to find that on my Mac OSX but failed so far. I am hoping for some
help in this regard.

Basically, I need to get a way of running a simple c++ program on hadoop in
my Mac OSX.

Best Regards,

Rakib

Re: Problem when trying to run hadoop c++ program on Mac OSX

Posted by "K. M. Rakibul Islam" <ra...@gmail.com>.

Hi Kovner,

Many thanks for the reply. I have installed hadoop on my Mac OSX following
the tutorial from here:
http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion

I also ran the popular pi example to see if everything is working
correctly. But I could not find any /hadoop/c++ like directories on my
machine now. Do you know why? Should I have to install Pipes library
individually? or it comes along with the hadoop installation? If I have to
install it now then what is the best of doing that? Please suggest me
something.

Thanks and Best Regards,

Rakib


On Sun, Nov 10, 2013 at 11:48 PM, Kovner Chalumo <kc...@gmail.com> wrote:

> Pipes.hh link:
>
> https://svn.apache.org/repos/asf/hadoop/common/branches/HADOOP-3628/src/c++/pipes/api/hadoop/Pipes.hh
> On Nov 10, 2013 5:44 PM, "K. M. Rakibul Islam" <ra...@gmail.com>
> wrote:
>
>>  I am totally new to Hadoop. I just installed Hadoop on my Mac OSX and
>> ran the pi example following this<http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion> tutorial.
>> Now I want to write my own simple C++ program and run that on hadoop. After
>> googling I could not find any good resource that gets me along the path
>> step by step (for Mac OSX). What I found so far is, this<http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C++_Programs_on_Hadoop> tutorial
>> which is for Unix. I understand that, I need to write a C++ program, build
>> that, then put the file in bin directory and then somehow run that. But I
>> don't know how to do these steps on Mac OSX.
>>
>> Later, I am trying to follow this<http://hadoopintouch.blogspot.ca/2012/04/write-your-first-program-in-hadoop-in-c.html> tutorial
>> to accomplish my task. But in step 2, when I try to compile my
>> wordcount.cpp program using g++ command I get the following error:
>>
>> fatal error: 'hadoop/Pipes.hh' file not found
>>
>>  which means I am not being able to locate the header files correctly. I
>> tried to find that on my Mac OSX but failed so far. I am hoping for some
>> help in this regard.
>>
>> Basically, I need to get a way of running a simple c++ program on hadoop
>> in my Mac OSX.
>>
>> Best Regards,
>>
>> Rakib
>>
>>


-- 
K. M. Rakibul Islam
Software Engineer
Quandl Inc. <http://www.quandl.com/>
Toronto, Canada
Website: https://sites.google.com/site/hereisrakib/

Re: Problem when trying to run hadoop c++ program on Mac OSX

Posted by "K. M. Rakibul Islam" <ra...@gmail.com>.

Hi Kovner,

Many thanks for the reply. I have installed hadoop on my Mac OSX following
the tutorial from here:
http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion

I also ran the popular pi example to see if everything is working
correctly. But I could not find any /hadoop/c++ like directories on my
machine now. Do you know why? Should I have to install Pipes library
individually? or it comes along with the hadoop installation? If I have to
install it now then what is the best of doing that? Please suggest me
something.

Thanks and Best Regards,

Rakib


On Sun, Nov 10, 2013 at 11:48 PM, Kovner Chalumo <kc...@gmail.com> wrote:

> Pipes.hh link:
>
> https://svn.apache.org/repos/asf/hadoop/common/branches/HADOOP-3628/src/c++/pipes/api/hadoop/Pipes.hh
> On Nov 10, 2013 5:44 PM, "K. M. Rakibul Islam" <ra...@gmail.com>
> wrote:
>
>>  I am totally new to Hadoop. I just installed Hadoop on my Mac OSX and
>> ran the pi example following this<http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion> tutorial.
>> Now I want to write my own simple C++ program and run that on hadoop. After
>> googling I could not find any good resource that gets me along the path
>> step by step (for Mac OSX). What I found so far is, this<http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C++_Programs_on_Hadoop> tutorial
>> which is for Unix. I understand that, I need to write a C++ program, build
>> that, then put the file in bin directory and then somehow run that. But I
>> don't know how to do these steps on Mac OSX.
>>
>> Later, I am trying to follow this<http://hadoopintouch.blogspot.ca/2012/04/write-your-first-program-in-hadoop-in-c.html> tutorial
>> to accomplish my task. But in step 2, when I try to compile my
>> wordcount.cpp program using g++ command I get the following error:
>>
>> fatal error: 'hadoop/Pipes.hh' file not found
>>
>>  which means I am not being able to locate the header files correctly. I
>> tried to find that on my Mac OSX but failed so far. I am hoping for some
>> help in this regard.
>>
>> Basically, I need to get a way of running a simple c++ program on hadoop
>> in my Mac OSX.
>>
>> Best Regards,
>>
>> Rakib
>>
>>


-- 
K. M. Rakibul Islam
Software Engineer
Quandl Inc. <http://www.quandl.com/>
Toronto, Canada
Website: https://sites.google.com/site/hereisrakib/

Re: Problem when trying to run hadoop c++ program on Mac OSX

Posted by "K. M. Rakibul Islam" <ra...@gmail.com>.

Hi Kovner,

Many thanks for the reply. I have installed hadoop on my Mac OSX following
the tutorial from here:
http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion

I also ran the popular pi example to see if everything is working
correctly. But I could not find any /hadoop/c++ like directories on my
machine now. Do you know why? Should I have to install Pipes library
individually? or it comes along with the hadoop installation? If I have to
install it now then what is the best of doing that? Please suggest me
something.

Thanks and Best Regards,

Rakib


On Sun, Nov 10, 2013 at 11:48 PM, Kovner Chalumo <kc...@gmail.com> wrote:

> Pipes.hh link:
>
> https://svn.apache.org/repos/asf/hadoop/common/branches/HADOOP-3628/src/c++/pipes/api/hadoop/Pipes.hh
> On Nov 10, 2013 5:44 PM, "K. M. Rakibul Islam" <ra...@gmail.com>
> wrote:
>
>>  I am totally new to Hadoop. I just installed Hadoop on my Mac OSX and
>> ran the pi example following this<http://blog.tundramonkey.com/2013/02/24/setting-up-hadoop-on-osx-mountain-lion> tutorial.
>> Now I want to write my own simple C++ program and run that on hadoop. After
>> googling I could not find any good resource that gets me along the path
>> step by step (for Mac OSX). What I found so far is, this<http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_2.2_--_Running_C++_Programs_on_Hadoop> tutorial
>> which is for Unix. I understand that, I need to write a C++ program, build
>> that, then put the file in bin directory and then somehow run that. But I
>> don't know how to do these steps on Mac OSX.
>>
>> Later, I am trying to follow this<http://hadoopintouch.blogspot.ca/2012/04/write-your-first-program-in-hadoop-in-c.html> tutorial
>> to accomplish my task. But in step 2, when I try to compile my
>> wordcount.cpp program using g++ command I get the following error:
>>
>> fatal error: 'hadoop/Pipes.hh' file not found
>>
>>  which means I am not being able to locate the header files correctly. I
>> tried to find that on my Mac OSX but failed so far. I am hoping for some
>> help in this regard.
>>
>> Basically, I need to get a way of running a simple c++ program on hadoop
>> in my Mac OSX.
>>
>> Best Regards,
>>
>> Rakib
>>
>>


-- 
K. M. Rakibul Islam
Software Engineer
Quandl Inc. <http://www.quandl.com/>
Toronto, Canada
Website: https://sites.google.com/site/hereisrakib/