You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Maity, Debashish" <De...@softwareag.com> on 2014/10/20 17:07:18 UTC

Hadoop Distributed Caching Technology

Hi,

Is there a way to use some other cache technology instead of memcache which is out of box in Hadoop Map-Reduce jobs.

Cheers,
Deb

Re: Hadoop Distributed Caching Technology

Posted by Sandy Ryza <sa...@cloudera.com>.

Hi Debashish,

Do you mind describing in a little more detail the benefits you're
interested in with different caching technology?  The Hadoop distributed
cache, HDFS caching, memcached, and Hazelcast are all related to "caching",
but aim to solve very different problems.

-Sandy

On Mon, Oct 20, 2014 at 12:01 PM, Maity, Debashish <
Debashish.Maity@softwareag.com> wrote:

> So how I am going to change to other cache technology like Hazelcast or
> ehcache etc.
>
>
>
> -----Original Message-----
> From: Andrew Wang [mailto:andrew.wang@cloudera.com]
> Sent: Monday, October 20, 2014 8:52 PM
> To: common-dev@hadoop.apache.org
> Subject: Re: Hadoop Distributed Caching Technology
>
> Hi Deb,
>
> We added support for centralized cache management to HDFS, which is out of
> the box and works with MR jobs.
>
> See the docs here:
>
>
> http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html
>
> Best,
> Andrew
>
> On Mon, Oct 20, 2014 at 8:07 AM, Maity, Debashish <
> Debashish.Maity@softwareag.com> wrote:
>
> > Hi,
> >
> > Is there a way to use some other cache technology instead of memcache
> > which is out of box in Hadoop Map-Reduce jobs.
> >
> > Cheers,
> > Deb
> >
> >
>

RE: Hadoop Distributed Caching Technology

Posted by "Maity, Debashish" <De...@softwareag.com>.

So how I am going to change to other cache technology like Hazelcast or ehcache etc.



-----Original Message-----
From: Andrew Wang [mailto:andrew.wang@cloudera.com] 
Sent: Monday, October 20, 2014 8:52 PM
To: common-dev@hadoop.apache.org
Subject: Re: Hadoop Distributed Caching Technology

Hi Deb,

We added support for centralized cache management to HDFS, which is out of the box and works with MR jobs.

See the docs here:

http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html

Best,
Andrew

On Mon, Oct 20, 2014 at 8:07 AM, Maity, Debashish < Debashish.Maity@softwareag.com> wrote:

> Hi,
>
> Is there a way to use some other cache technology instead of memcache 
> which is out of box in Hadoop Map-Reduce jobs.
>
> Cheers,
> Deb
>
>

Re: Hadoop Distributed Caching Technology

Posted by Andrew Wang <an...@cloudera.com>.

Hi Deb,

We added support for centralized cache management to HDFS, which is out of
the box and works with MR jobs.

See the docs here:

http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html

Best,
Andrew

On Mon, Oct 20, 2014 at 8:07 AM, Maity, Debashish <
Debashish.Maity@softwareag.com> wrote:

> Hi,
>
> Is there a way to use some other cache technology instead of memcache
> which is out of box in Hadoop Map-Reduce jobs.
>
> Cheers,
> Deb
>
>