You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Lance Norskog <go...@gmail.com> on 2012/10/01 00:07:51 UTC

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Please start a new discussion.

----- Original Message -----
| From: "sudha sadhasivam" <su...@yahoo.com>
| To: common-user@hadoop.apache.org
| Sent: Saturday, September 29, 2012 2:16:38 AM
| Subject: Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)
| 
| We are doing a project in Hive.
| Given a field / value  is it possible to find the corresponding
| headers (meta data).
| 
| For example if we have a table with id, user, work_place,
| residence_place
| 
| given a value "New York" we need to display the headers where New
| York appears ( for eg work_place, residence_place etc.
| 
| Kindly intimate whether  it is possible. If so what is the command
| for the same?
| Thanking you
| Sudha
| 
| --- On Tue, 9/25/12, Chen He <ai...@gmail.com> wrote:
| 
| From: Chen He <ai...@gmail.com>
| Subject: Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)
| To: "sudha sadhasivam" <su...@yahoo.com>
| Cc: common-user@hadoop.apache.org
| Date: Tuesday, September 25, 2012, 9:01 PM
| 
| Hi Sudha
| 
| Good question.
| 
| First of all, you need to specify clearly about your Hadoop
| environment,
| (pseudo distributed or real cluster)
| 
| Secondly, you need to clearly understand how hadoop load job's jar
| file to
| all worker nodes, it only copy the jar file to worker nodes. It does
| not
| contain the jcuda.jar file. MapReduce program may not know where it
| is even
| you specify the jcuda.jar file in our worker node classpath.
| 
| I prefer you can include the Jcuda.jar into your wordcount.jar. Then
| when
| Hadoop copy the wordcount.jar file to all worker nodes' temporary
| working
| directory, you do not need to worry about this issue.
| 
| Let me know if you meet further question.
| 
| Chen
| 
| On Tue, Sep 25, 2012 at 12:38 AM, sudha sadhasivam <
| sudhasadhasivam@yahoo.com> wrote:
| 
| > Sir
| > We tried to integrate hadoop and JCUDA.
| > We tried a code from
| >
| >
| > http://code.google.com/p/mrcl/source/browse/trunk/hama-mrcl/src/mrcl/mrcl/?r=76
| >
| > We re able to compile. We are not able to execute. It does not
| > recognise
| > JCUBLAS.jar. We tried setting the classpath
| > We are herewith attaching the procedure for the same along with
| > errors
| > Kindly inform us how to proceed. It is our UG project
| > Thanking you
| > Dr G sudha Sadasivam
| >
| > --- On *Mon, 9/24/12, Chen He <ai...@gmail.com>* wrote:
| >
| >
| > From: Chen He <ai...@gmail.com>
| > Subject: Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)
| > To: common-user@hadoop.apache.org
| > Date: Monday, September 24, 2012, 9:03 PM
| >
| >
| > http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop
| >
| > On Mon, Sep 24, 2012 at 10:30 AM, Oleg Ruchovets
| > <or...@gmail.com>
| > >wrote:
| >
| > > Hi
| > >
| > > I am going to process video analytics using hadoop
| > > I am very interested about CPU+GPU architercute espessially using
| > > CUDA (
| > > http://www.nvidia.com/object/cuda_home_new.html) and JCUDA (
| > > http://jcuda.org/)
| > > Does using HADOOP and CPU+GPU architecture bring significant
| > > performance
| > > improvement and does someone succeeded to implement it in
| > > production
| > > quality?
| > >
| > > I didn't fine any projects / examples  to use such technology.
| > > If someone could give me a link to best practices and example
| > > using
| > > CUDA/JCUDA + hadoop that would be great.
| > > Thanks in advane
| > > Oleg.
| > >
| >
| >
| 

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Posted by sudha sadhasivam <su...@yahoo.com>.

--- On Mon, 10/1/12, Lance Norskog <go...@gmail.com> wrote:

From: Lance Norskog <go...@gmail.com>
Subject: Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)
To: common-user@hadoop.apache.org
Date: Monday, October 1, 2012, 3:37 AM


| > Sir
| > We tried to integrate hadoop and JCUDA.
| > We tried a code from
| 
| > http://code.google.com/p/mrcl/source/browse/trunk/hama-mrcl/src/mrcl/mrcl/?r=76
| >
| > We are able to compile. We are not able to execute. It does not
| > recognise JCUBLAS.jar. We tried setting the classpath
| > We are herewith attaching the procedure for the same along with
| > errors
| > Kindly inform us how to proceed. It is our UG project

Kindly provide us with website address for tutorials on JCUDA + hadoop with steps for execution
| > Thanking you
| > Dr G sudha Sadasivam
| >
| > --- On *Mon, 9/24/12, Chen He <ai...@gmail.com>* wrote:
| >
| >
| > From: Chen He <ai...@gmail.com>
| > Subject: Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)
| > To: common-user@hadoop.apache.org
| > Date: Monday, September 24, 2012, 9:03 PM
| >
| >
| > http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop
| >
| > On Mon, Sep 24, 2012 at 10:30 AM, Oleg Ruchovets
| > <or...@gmail.com>
| > >wrote:
| >
| > > Hi
| > >
| > > I am going to process video analytics using hadoop
| > > I am very interested about CPU+GPU architercute espessially using
| > > CUDA (
| > > http://www.nvidia.com/object/cuda_home_new.html) and JCUDA (
| > > http://jcuda.org/)
| > > Does using HADOOP and CPU+GPU architecture bring significant
| > > performance
| > > improvement and does someone succeeded to implement it in
| > > production
| > > quality?
| > >
| > > I didn't fine any projects / examples  to use such technology.
| > > If someone could give me a link to best practices and example
| > > using
| > > CUDA/JCUDA + hadoop that would be great.
| > > Thanks in advane
| > > Oleg.
| > >
| >
| >
|