Aggregate sent message message bytes increase with the number of workers

[Liannet Reyes <li...@gmail.com>]

Hi all,

I've noticed that the aggregated message bytes counter increases with the
number of workers, even when the total amount of messages sent remains the
same!

For instance while using only 1 worker the messages bytes is 1000, no
matter how many times I run the program this number remains the same, but
using 2 workers this number slightly increase (1060), and the same thing by
adding more workers.

Could someone explain me how is this possible? It is likely to happen
because of checksums or another mechanism to handle communication but I
would really like to know the right reason.

Regards,

Liannet

Re: Aggregate sent message message bytes increase with the number of workers

[Yi Lu <lu...@gmail.com>]

could you please share your job log or Giraph code?

Best Regards,
-Yi


On Thu, Jun 12, 2014 at 3:24 AM, Liannet Reyes <li...@gmail.com> wrote:

> Actually I am using aggregators, but I didn't know this messages were
> aggregated together with the messages generated by my algorithm.
>
>
> 2014-06-11 19:05 GMT+02:00 Yi Lu <lu...@gmail.com>:
>
> hi,
>>
>> The reason is you are using combiner
>>
>>
>> On Thursday, June 12, 2014, Liannet Reyes <li...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I've noticed that the aggregated message bytes counter increases with
>>> the number of workers, even when the total amount of messages sent remains
>>> the same!
>>>
>>> For instance while using only 1 worker the messages bytes is 1000, no
>>> matter how many times I run the program this number remains the same, but
>>> using 2 workers this number slightly increase (1060), and the same thing by
>>> adding more workers.
>>>
>>> Could someone explain me how is this possible? It is likely to happen
>>> because of checksums or another mechanism to handle communication but I
>>> would really like to know the right reason.
>>>
>>>  Regards,
>>>
>>> Liannet
>>>
>>
>>
>> --
>> Best Regards,
>> -Yi
>>
>>
>

Re: Aggregate sent message message bytes increase with the number of workers

[Liannet Reyes <li...@gmail.com>]

Actually I am using aggregators, but I didn't know this messages were
aggregated together with the messages generated by my algorithm.


2014-06-11 19:05 GMT+02:00 Yi Lu <lu...@gmail.com>:

> hi,
>
> The reason is you are using combiner
>
>
> On Thursday, June 12, 2014, Liannet Reyes <li...@gmail.com> wrote:
>
>> Hi all,
>>
>> I've noticed that the aggregated message bytes counter increases with the
>> number of workers, even when the total amount of messages sent remains the
>> same!
>>
>> For instance while using only 1 worker the messages bytes is 1000, no
>> matter how many times I run the program this number remains the same, but
>> using 2 workers this number slightly increase (1060), and the same thing by
>> adding more workers.
>>
>> Could someone explain me how is this possible? It is likely to happen
>> because of checksums or another mechanism to handle communication but I
>> would really like to know the right reason.
>>
>>  Regards,
>>
>> Liannet
>>
>
>
> --
> Best Regards,
> -Yi
>
>

Re: Aggregate sent message message bytes increase with the number of workers

[Yi Lu <lu...@gmail.com>]

hi,

The reason is you are using combiner

On Thursday, June 12, 2014, Liannet Reyes <li...@gmail.com> wrote:

> Hi all,
>
> I've noticed that the aggregated message bytes counter increases with the
> number of workers, even when the total amount of messages sent remains the
> same!
>
> For instance while using only 1 worker the messages bytes is 1000, no
> matter how many times I run the program this number remains the same, but
> using 2 workers this number slightly increase (1060), and the same thing by
> adding more workers.
>
> Could someone explain me how is this possible? It is likely to happen
> because of checksums or another mechanism to handle communication but I
> would really like to know the right reason.
>
>  Regards,
>
> Liannet
>


-- 
Best Regards,
-Yi