You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@beam.apache.org by amit kumar <ak...@gmail.com> on 2020/05/08 21:19:51 UTC

Runner dependent sharding for dynamic destinations in FileIO

Hi Everyone,

We use FileIO's writeDynamic to write dynamically to separate groups based
on an attribute's value in the input PCollection.
I wanted to check if there is a way to make sharding as runner dependent?


Many thanks,
Amit

Re: Runner dependent sharding for dynamic destinations in FileIO

Posted by Luke Cwik <lc...@google.com>.

How/why are you trying to make it runner dependent?

On Fri, May 8, 2020 at 2:20 PM amit kumar <ak...@gmail.com> wrote:

> Hi Everyone,
>
> We use FileIO's writeDynamic to write dynamically to separate groups
> based on an attribute's value in the input PCollection.
> I wanted to check if there is a way to make sharding as runner dependent?
>
>
> Many thanks,
> Amit
>
>
>
>
>