You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@giraph.apache.org by Sebastian Schelter <ss...@apache.org> on 2011/12/17 10:41:37 UTC
Running tests in pseudo-distributed mode
A small hint for everyone who wants to run giraph's unit tests on a
pseudo-distributed single node hadoop cluster:
You have to adjust the configuration to allow 4 concurrent map tasks per
node (default in hadoop-0.20.203 is 2), otherwise the tests will fail!
You have to adjust mapred.tasktracker.map.tasks.maximum and
mapred.map.tasks in mapred-site.xml. Took me a while to figure out :)
--sebastian
Re: Running tests in pseudo-distributed mode
Posted by Claudio Martella <cl...@gmail.com>.
nice contribution, thanks! maybe you can write a small patch to the
giraph documentation to add the content (and a link to your post, for
your PR ;) )?
On Sat, Dec 17, 2011 at 6:48 PM, Sebastian Schelter <ss...@apache.org> wrote:
> Wrote a blogpost about it :) Maybe it can be copied to giraph's wiki?
>
> http://ssc.io/running-giraphs-unit-tests-in-pseudo-distributed-mode/
>
> --sebastian
>
>
> On 17.12.2011 18:38, Avery Ching wrote:
>> We should document this somewhere. It is not intuitive as you mention.
>>
>> Avery
>>
>> On 12/17/11 1:41 AM, Sebastian Schelter wrote:
>>> A small hint for everyone who wants to run giraph's unit tests on a
>>> pseudo-distributed single node hadoop cluster:
>>>
>>> You have to adjust the configuration to allow 4 concurrent map tasks per
>>> node (default in hadoop-0.20.203 is 2), otherwise the tests will fail!
>>>
>>> You have to adjust mapred.tasktracker.map.tasks.maximum and
>>> mapred.map.tasks in mapred-site.xml. Took me a while to figure out :)
>>>
>>> --sebastian
>>
>
--
Claudio Martella
claudio.martella@gmail.com
Re: Running tests in pseudo-distributed mode
Posted by Sebastian Schelter <ss...@apache.org>.
Wrote a blogpost about it :) Maybe it can be copied to giraph's wiki?
http://ssc.io/running-giraphs-unit-tests-in-pseudo-distributed-mode/
--sebastian
On 17.12.2011 18:38, Avery Ching wrote:
> We should document this somewhere. It is not intuitive as you mention.
>
> Avery
>
> On 12/17/11 1:41 AM, Sebastian Schelter wrote:
>> A small hint for everyone who wants to run giraph's unit tests on a
>> pseudo-distributed single node hadoop cluster:
>>
>> You have to adjust the configuration to allow 4 concurrent map tasks per
>> node (default in hadoop-0.20.203 is 2), otherwise the tests will fail!
>>
>> You have to adjust mapred.tasktracker.map.tasks.maximum and
>> mapred.map.tasks in mapred-site.xml. Took me a while to figure out :)
>>
>> --sebastian
>
Re: Running tests in pseudo-distributed mode
Posted by Avery Ching <ac...@apache.org>.
We should document this somewhere. It is not intuitive as you mention.
Avery
On 12/17/11 1:41 AM, Sebastian Schelter wrote:
> A small hint for everyone who wants to run giraph's unit tests on a
> pseudo-distributed single node hadoop cluster:
>
> You have to adjust the configuration to allow 4 concurrent map tasks per
> node (default in hadoop-0.20.203 is 2), otherwise the tests will fail!
>
> You have to adjust mapred.tasktracker.map.tasks.maximum and
> mapred.map.tasks in mapred-site.xml. Took me a while to figure out :)
>
> --sebastian