Specific sink behaviour based on tuple key

[Alexis Gendronneau <a....@gmail.com>]

Hi all,

I am looking to customize a sink behaviour based on tuple key.

My goal is to have each sink partition to write to a specific output.

My job will be something like :

input -> keyBy() -> outputSink

This output should be something like './base/path/keyValue/....'.

But I was not able to find where key value is stored, could you help me to
go the right way :)

-- 
Alexis Gendronneau

alexis.gendronneau@corp.ovh.com
a.gendronneau@gmail.com

Re: Specific sink behaviour based on tuple key

[Aljoscha Krettek <al...@apache.org>]

Hi,

The Key is not available directly to a user function? You would have to use within that function the same code that you use for your KeySelector.

Best,
Aljoscha

> On 26. Aug 2017, at 10:01, Alexis Gendronneau <a....@gmail.com> wrote:
> 
> Hi all,
> 
> I am looking to customize a sink behaviour based on tuple key. 
> 
> My goal is to have each sink partition to write to a specific output. 
> 
> My job will be something like : 
> 
> input -> keyBy() -> outputSink
> 
> This output should be something like './base/path/keyValue/....'.
> 
> But I was not able to find where key value is stored, could you help me to go the right way :) 
> 
> -- 
> Alexis Gendronneau
> 
> alexis.gendronneau@corp.ovh.com <ma...@corp.ovh.com>
> a.gendronneau@gmail.com <ma...@gmail.com>