You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@accumulo.apache.org by Vincent Russell <vi...@gmail.com> on 2015/04/06 14:59:18 UTC

MockAccumulo with MiniMRCluster

Does anyone have any suggestions or maybe a solution for getting MapReduce
to work with the MiniMRCluster and MockAccumulo (Maybe some type of
client/server solution with thrift and zookeeper?).  I am already using the
MiniDFSCluster and MiniMRCluster and I just don't want to add the
MiniAccumuloCluster to the mix in terms of memory consumption for my
integration tests.


Thanks,
Vincent

Re: MockAccumulo with MiniMRCluster

Posted by Vincent Russell <vi...@gmail.com>.

Thanks Billie,

But my issue is that the mappers and reducers are running in a separate JVM
from the MockInstance because of the MiniMRCluster.

I stumbled across hadoop's LocalJobRunner.  I am going to see if that will
work in my scenario.

On Mon, Apr 6, 2015 at 10:42 AM, Billie Rinaldi <bi...@gmail.com>
wrote:

> You might be able to do this by using
> AccumuloInputFormat/AccumuloOutputFormat.setMockInstance instead of
> setZooKeeperInstance.  If you want to see some examples, look for usages of
> setMockInstance in
> core/src/test/java/org/apache/accumulo/core/client/mapreduce/.
>
> On Mon, Apr 6, 2015 at 5:59 AM, Vincent Russell <vincent.russell@gmail.com
> >
> wrote:
>
> > Does anyone have any suggestions or maybe a solution for getting
> MapReduce
> > to work with the MiniMRCluster and MockAccumulo (Maybe some type of
> > client/server solution with thrift and zookeeper?).  I am already using
> the
> > MiniDFSCluster and MiniMRCluster and I just don't want to add the
> > MiniAccumuloCluster to the mix in terms of memory consumption for my
> > integration tests.
> >
> >
> > Thanks,
> > Vincent
> >
>

Re: MockAccumulo with MiniMRCluster

Posted by Billie Rinaldi <bi...@gmail.com>.

You might be able to do this by using
AccumuloInputFormat/AccumuloOutputFormat.setMockInstance instead of
setZooKeeperInstance.  If you want to see some examples, look for usages of
setMockInstance in
core/src/test/java/org/apache/accumulo/core/client/mapreduce/.

On Mon, Apr 6, 2015 at 5:59 AM, Vincent Russell <vi...@gmail.com>
wrote:

> Does anyone have any suggestions or maybe a solution for getting MapReduce
> to work with the MiniMRCluster and MockAccumulo (Maybe some type of
> client/server solution with thrift and zookeeper?).  I am already using the
> MiniDFSCluster and MiniMRCluster and I just don't want to add the
> MiniAccumuloCluster to the mix in terms of memory consumption for my
> integration tests.
>
>
> Thanks,
> Vincent
>