You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Chris Miller <cm...@34s.de> on 2018/10/10 14:18:37 UTC

Partitions vs. Subpartitions

 

Hi, 

what's the difference between partitions and subpartitions? 

Thanks. 

CM

Re: Partitions vs. Subpartitions

Posted by Fabian Hueske <fh...@gmail.com>.

Hi Chris,

The terminology in the docs and code is not always consistent. It depends
on the context.
Both could also mean the same if they are used in different places.

Can you point to the place(s) that refer to partition and subpartition?

Fabian

Am Do., 11. Okt. 2018 um 04:50 Uhr schrieb Kurt Young <yk...@gmail.com>:

> Hi，
>
> Partition is the output of a JobVertex which you can simply thought
> contains an operator. And in real world, JobVertex will run in parallel,
> each
> will output some data, which is conceptually called subpartition.
>
> Best,
> Kurt
>
>
> On Thu, Oct 11, 2018 at 10:27 AM Renjie Liu <li...@gmail.com>
> wrote:
>
>> Hi, Chris:
>>
>> Where are these words from? Are they from flink source code?
>>
>> On Wed, Oct 10, 2018 at 10:18 PM Chris Miller <cm...@34s.de> wrote:
>>
>>> Hi,
>>>
>>> what's the difference between partitions and subpartitions?
>>>
>>>
>>>
>>> Thanks.
>>>
>>>
>>>
>>> CM
>>>
>>>
>>
>>
>> --
>> Renjie Liu
>> Software Engineer, MVAD
>>
>

Re: Partitions vs. Subpartitions

Posted by Kurt Young <yk...@gmail.com>.

Hi，

Partition is the output of a JobVertex which you can simply thought
contains an operator. And in real world, JobVertex will run in parallel,
each
will output some data, which is conceptually called subpartition.

Best,
Kurt

On Thu, Oct 11, 2018 at 10:27 AM Renjie Liu <li...@gmail.com> wrote:

> Hi, Chris:
>
> Where are these words from? Are they from flink source code?
>
> On Wed, Oct 10, 2018 at 10:18 PM Chris Miller <cm...@34s.de> wrote:
>
>> Hi,
>>
>> what's the difference between partitions and subpartitions?
>>
>>
>>
>> Thanks.
>>
>>
>>
>> CM
>>
>>
>
>
> --
> Renjie Liu
> Software Engineer, MVAD
>

Re: Partitions vs. Subpartitions

Posted by Renjie Liu <li...@gmail.com>.

Hi, Chris:

Where are these words from? Are they from flink source code?

On Wed, Oct 10, 2018 at 10:18 PM Chris Miller <cm...@34s.de> wrote:

> Hi,
>
> what's the difference between partitions and subpartitions?
>
>
>
> Thanks.
>
>
>
> CM
>
>


-- 
Renjie Liu
Software Engineer, MVAD