You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Vishwas Siravara <bu...@gmail.com> on 2020/02/10 16:19:54 UTC
Exactly once semantics for hdfs sink
Hi all,
I want to use the StreamingFile sink for writing data to hdfs. Can I
achieve exactly once semantics with this sink ?
Best,
HW.
Re: Exactly once semantics for hdfs sink
Posted by Khachatryan Roman <kh...@gmail.com>.
Hi Vishwas,
Please let me know if you have any specific questions about the
StreamingFile sink.
Regards,
Roman
On Wed, Feb 12, 2020 at 4:45 AM Zhijiang <wa...@aliyun.com> wrote:
> Hi Vishwas,
>
> I guess this link [1] can help understand how it works and how to use in
> practice for StreamingFileSink.
>
> [1]
> https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/connectors/streamfile_sink.html
>
> Best,
> Zhijiang
>
> ------------------------------------------------------------------
> From:Vishwas Siravara <bu...@gmail.com>
> Send Time:2020 Feb. 12 (Wed.) 05:19
> To:Khachatryan Roman <kh...@gmail.com>
> Cc:user <us...@flink.apache.org>
> Subject:Re: Exactly once semantics for hdfs sink
>
> Hi Khachatryan,
> Thanks for your reply. Can you help me understand how it works with hdfs
> specifically , even a link to a document will help.
>
>
> Best,
> Vishwas
>
> On Mon, Feb 10, 2020 at 10:32 AM Khachatryan Roman <
> khachatryan.roman@gmail.com> wrote:
> Hi Vishwas,
>
> Yes, Streaming File Sink does support exactly-once semantics and can be
> used with HDFS.
>
> Regards,
> Roman
>
>
> On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara <bu...@gmail.com>
> wrote:
> Hi all,
> I want to use the StreamingFile sink for writing data to hdfs. Can I
> achieve exactly once semantics with this sink ?
>
>
> Best,
> HW.
>
>
>
Re: Exactly once semantics for hdfs sink
Posted by Zhijiang <wa...@aliyun.com>.
Hi Vishwas,
I guess this link [1] can help understand how it works and how to use in practice for StreamingFileSink.
[1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/connectors/streamfile_sink.html
Best,
Zhijiang
------------------------------------------------------------------
From:Vishwas Siravara <bu...@gmail.com>
Send Time:2020 Feb. 12 (Wed.) 05:19
To:Khachatryan Roman <kh...@gmail.com>
Cc:user <us...@flink.apache.org>
Subject:Re: Exactly once semantics for hdfs sink
Hi Khachatryan,
Thanks for your reply. Can you help me understand how it works with hdfs specifically , even a link to a document will help.
Best,
Vishwas
On Mon, Feb 10, 2020 at 10:32 AM Khachatryan Roman <kh...@gmail.com> wrote:
Hi Vishwas,
Yes, Streaming File Sink does support exactly-once semantics and can be used with HDFS.
Regards,
Roman
On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara <bu...@gmail.com> wrote:
Hi all,
I want to use the StreamingFile sink for writing data to hdfs. Can I achieve exactly once semantics with this sink ?
Best,
HW.
Re: Exactly once semantics for hdfs sink
Posted by Vishwas Siravara <bu...@gmail.com>.
Hi Khachatryan,
Thanks for your reply. Can you help me understand how it works with hdfs
specifically , even a link to a document will help.
Best,
Vishwas
On Mon, Feb 10, 2020 at 10:32 AM Khachatryan Roman <
khachatryan.roman@gmail.com> wrote:
> Hi Vishwas,
>
> Yes, Streaming File Sink does support exactly-once semantics and can be
> used with HDFS.
>
> Regards,
> Roman
>
>
> On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara <bu...@gmail.com>
> wrote:
>
>> Hi all,
>> I want to use the StreamingFile sink for writing data to hdfs. Can I
>> achieve exactly once semantics with this sink ?
>>
>>
>> Best,
>> HW.
>>
>
Re: Exactly once semantics for hdfs sink
Posted by Khachatryan Roman <kh...@gmail.com>.
Hi Vishwas,
Yes, Streaming File Sink does support exactly-once semantics and can be
used with HDFS.
Regards,
Roman
On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara <bu...@gmail.com> wrote:
> Hi all,
> I want to use the StreamingFile sink for writing data to hdfs. Can I
> achieve exactly once semantics with this sink ?
>
>
> Best,
> HW.
>