You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by "AMARNATH, Balachandar" <BA...@airbus.com> on 2013/03/25 06:47:32 UTC

Any answer ? Candidate application for map reduce

Any answers from anyone of you :)

Regards
Bala

From: AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
Sent: 22 March 2013 10:25
To: user@hadoop.apache.org
Subject: Candidate application for map reduce

Hello,

I am looking for an sample application (preferably image processing, feature detection etc) that can be good candidate of map reduce paradigm. To very specific, I am looking for an open source simple application that process data and produce some results (A). When you split the data in to chunks, feed the chunks to the application, and merge the processed chunks to get A back. Is there any website where can I look into such kind of benchmark applications ? Any pointers and thoughts will be helpful here.

With thanks and regards
Balachandar

The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.

If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.

Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.

All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

Re: Any answer ? Candidate application for map reduce

Posted by Yanbo Liang <ya...@gmail.com>.

>From your description "split the data in to chunks, feed the chunks to the
application, and merge the processed chunks to get A back" is just suit for
the MapReduce paradigm. First you can feed the split chunks to Mapper and
merge the processed chunks at Reducer. Why did you not use MapReduce
paradigm?

2013/3/25 Raymond Tay <ra...@gmail.com>

> Hello Bala,
>
> I bumped into your email by chance.
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.
>
> Hope this helps
> Ray
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:
>
> Any answers from anyone of you J****
>
>
> Regards****
> Bala****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
> ** **
> Hello,****
>  ****
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>  ****
> With thanks and regards****
> Balachandar****
>  ****
>  ****
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>
>

Re: Any answer ? Candidate application for map reduce

Posted by Yanbo Liang <ya...@gmail.com>.

>From your description "split the data in to chunks, feed the chunks to the
application, and merge the processed chunks to get A back" is just suit for
the MapReduce paradigm. First you can feed the split chunks to Mapper and
merge the processed chunks at Reducer. Why did you not use MapReduce
paradigm?

2013/3/25 Raymond Tay <ra...@gmail.com>

> Hello Bala,
>
> I bumped into your email by chance.
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.
>
> Hope this helps
> Ray
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:
>
> Any answers from anyone of you J****
>
>
> Regards****
> Bala****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
> ** **
> Hello,****
>  ****
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>  ****
> With thanks and regards****
> Balachandar****
>  ****
>  ****
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>
>

Re: Any answer ? Candidate application for map reduce

Posted by Yanbo Liang <ya...@gmail.com>.

>From your description "split the data in to chunks, feed the chunks to the
application, and merge the processed chunks to get A back" is just suit for
the MapReduce paradigm. First you can feed the split chunks to Mapper and
merge the processed chunks at Reducer. Why did you not use MapReduce
paradigm?

2013/3/25 Raymond Tay <ra...@gmail.com>

> Hello Bala,
>
> I bumped into your email by chance.
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.
>
> Hope this helps
> Ray
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:
>
> Any answers from anyone of you J****
>
>
> Regards****
> Bala****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
> ** **
> Hello,****
>  ****
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>  ****
> With thanks and regards****
> Balachandar****
>  ****
>  ****
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>
>

Re: Any answer ? Candidate application for map reduce

Posted by Yanbo Liang <ya...@gmail.com>.

>From your description "split the data in to chunks, feed the chunks to the
application, and merge the processed chunks to get A back" is just suit for
the MapReduce paradigm. First you can feed the split chunks to Mapper and
merge the processed chunks at Reducer. Why did you not use MapReduce
paradigm?

2013/3/25 Raymond Tay <ra...@gmail.com>

> Hello Bala,
>
> I bumped into your email by chance.
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.
>
> Hope this helps
> Ray
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:
>
> Any answers from anyone of you J****
>
>
> Regards****
> Bala****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
> ** **
> Hello,****
>  ****
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>  ****
> With thanks and regards****
> Balachandar****
>  ****
>  ****
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>
>

Re: Any answer ? Candidate application for map reduce

Posted by Sandy Ryza <sa...@cloudera.com>.

Hi Bala,

A standard benchmark program for mapreduce is terasort, which is included
in the hadoop examples jar.  You can generate data for it using teragen,
which runs a map-only job:

hadoop jar path-to-examples-jar.jar <number of records> <directory to put
them in>

and then sort the data using terasort:

hadoop jar path-to-examples-jar.jar <input directory> <output directory>

-Sandy

On Mon, Mar 25, 2013 at 4:12 AM, AMARNATH, Balachandar <
BALACHANDAR.AMARNATH@airbus.com> wrote:

> Hello Yanbo Liang,****
>
> ** **
>
> My issue is  that I neither do not have data nor I have an application!  I
> was looking for an open source benchmark application to test this,
> preferably, if the application (or simple test code) is related to image
> processing domain****
>
> ** **
>
> Regards****
>
> Bala****
>
> ** **
>
> ** **
>
> ** **
>
> *From:* Yanbo Liang [mailto:yanbohappy@gmail.com]
> *Sent:* 25 March 2013 14:55
> *To:* user@hadoop.apache.org
> *Subject:* Re: Any answer ? Candidate application for map reduce****
>
> ** **
>
> From your description "split the data in to chunks, feed the chunks to
> the application, and merge the processed chunks to get A back" is just suit
> for the MapReduce paradigm. First you can feed the split chunks to Mapper
> and merge the processed chunks at Reducer. Why did you not use MapReduce
> paradigm? ****
>
> 2013/3/25 Raymond Tay <ra...@gmail.com>****
>
> Hello Bala,****
>
> ** **
>
> I bumped into your email by chance. ****
>
> ** **
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.****
>
> ** **
>
> Hope this helps****
>
> Ray****
>
> ** **
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:****
>
>
>
> ****
>
> Any answers from anyone of you J****
>
>  ****
>
>  ****
>
> Regards****
>
> Bala****
>
>  ****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
>
>  ****
>
> Hello,****
>
>  ****
>
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>
>  ****
>
> With thanks and regards****
>
> Balachandar****
>
>  ****
>
>  ****
>
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> ** **
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> ** **
>
> ** **
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>

Re: Any answer ? Candidate application for map reduce

Posted by Sandy Ryza <sa...@cloudera.com>.

Hi Bala,

A standard benchmark program for mapreduce is terasort, which is included
in the hadoop examples jar.  You can generate data for it using teragen,
which runs a map-only job:

hadoop jar path-to-examples-jar.jar <number of records> <directory to put
them in>

and then sort the data using terasort:

hadoop jar path-to-examples-jar.jar <input directory> <output directory>

-Sandy

On Mon, Mar 25, 2013 at 4:12 AM, AMARNATH, Balachandar <
BALACHANDAR.AMARNATH@airbus.com> wrote:

> Hello Yanbo Liang,****
>
> ** **
>
> My issue is  that I neither do not have data nor I have an application!  I
> was looking for an open source benchmark application to test this,
> preferably, if the application (or simple test code) is related to image
> processing domain****
>
> ** **
>
> Regards****
>
> Bala****
>
> ** **
>
> ** **
>
> ** **
>
> *From:* Yanbo Liang [mailto:yanbohappy@gmail.com]
> *Sent:* 25 March 2013 14:55
> *To:* user@hadoop.apache.org
> *Subject:* Re: Any answer ? Candidate application for map reduce****
>
> ** **
>
> From your description "split the data in to chunks, feed the chunks to
> the application, and merge the processed chunks to get A back" is just suit
> for the MapReduce paradigm. First you can feed the split chunks to Mapper
> and merge the processed chunks at Reducer. Why did you not use MapReduce
> paradigm? ****
>
> 2013/3/25 Raymond Tay <ra...@gmail.com>****
>
> Hello Bala,****
>
> ** **
>
> I bumped into your email by chance. ****
>
> ** **
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.****
>
> ** **
>
> Hope this helps****
>
> Ray****
>
> ** **
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:****
>
>
>
> ****
>
> Any answers from anyone of you J****
>
>  ****
>
>  ****
>
> Regards****
>
> Bala****
>
>  ****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
>
>  ****
>
> Hello,****
>
>  ****
>
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>
>  ****
>
> With thanks and regards****
>
> Balachandar****
>
>  ****
>
>  ****
>
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> ** **
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> ** **
>
> ** **
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>

Re: Any answer ? Candidate application for map reduce

Posted by Sandy Ryza <sa...@cloudera.com>.

Hi Bala,

A standard benchmark program for mapreduce is terasort, which is included
in the hadoop examples jar.  You can generate data for it using teragen,
which runs a map-only job:

hadoop jar path-to-examples-jar.jar <number of records> <directory to put
them in>

and then sort the data using terasort:

hadoop jar path-to-examples-jar.jar <input directory> <output directory>

-Sandy

On Mon, Mar 25, 2013 at 4:12 AM, AMARNATH, Balachandar <
BALACHANDAR.AMARNATH@airbus.com> wrote:

> Hello Yanbo Liang,****
>
> ** **
>
> My issue is  that I neither do not have data nor I have an application!  I
> was looking for an open source benchmark application to test this,
> preferably, if the application (or simple test code) is related to image
> processing domain****
>
> ** **
>
> Regards****
>
> Bala****
>
> ** **
>
> ** **
>
> ** **
>
> *From:* Yanbo Liang [mailto:yanbohappy@gmail.com]
> *Sent:* 25 March 2013 14:55
> *To:* user@hadoop.apache.org
> *Subject:* Re: Any answer ? Candidate application for map reduce****
>
> ** **
>
> From your description "split the data in to chunks, feed the chunks to
> the application, and merge the processed chunks to get A back" is just suit
> for the MapReduce paradigm. First you can feed the split chunks to Mapper
> and merge the processed chunks at Reducer. Why did you not use MapReduce
> paradigm? ****
>
> 2013/3/25 Raymond Tay <ra...@gmail.com>****
>
> Hello Bala,****
>
> ** **
>
> I bumped into your email by chance. ****
>
> ** **
>
> I'm not sure what you are after, really because if you wanted something
> like image processing and feature detection then hadoop's mailing list is
> probably not the place and you might want to join NVIDIA's or ATI's CUDA /
> OpenCL forums.****
>
> ** **
>
> Hope this helps****
>
> Ray****
>
> ** **
>
> On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" <
> BALACHANDAR.AMARNATH@airbus.com> wrote:****
>
>
>
> ****
>
> Any answers from anyone of you J****
>
>  ****
>
>  ****
>
> Regards****
>
> Bala****
>
>  ****
>
> *From:* AMARNATH, Balachandar [mailto:BALACHANDAR.AMARNATH@airbus.com]
> *Sent:* 22 March 2013 10:25
> *To:* user@hadoop.apache.org
> *Subject:* Candidate application for map reduce****
>
>  ****
>
> Hello,****
>
>  ****
>
> I am looking for an sample application (preferably image processing,
> feature detection etc) that can be good candidate of map reduce paradigm.
> To very specific, I am looking for an open source simple application that
> process data and produce some results (A). When you split the data in to
> chunks, feed the chunks to the application, and merge the processed chunks
> to get A back. Is there any website where can I look into such kind of
> benchmark applications ? Any pointers and thoughts will be helpful here.**
> **
>
>  ****
>
> With thanks and regards****
>
> Balachandar****
>
>  ****
>
>  ****
>
>  ****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> ** **
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.****
>
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.****
>
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.****
>
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.****
>
> ** **
>
> ** **
>
> The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
> If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
> Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
> All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
>
>