You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/11/09 12:23:00 UTC

[jira] [Closed] (FLINK-32737) Add support for Snowflake sink connector

     [ https://issues.apache.org/jira/browse/FLINK-32737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn Visser closed FLINK-32737.
----------------------------------
    Resolution: Invalid

> Add support for Snowflake sink connector
> ----------------------------------------
>
>                 Key: FLINK-32737
>                 URL: https://issues.apache.org/jira/browse/FLINK-32737
>             Project: Flink
>          Issue Type: New Feature
>            Reporter: Mohsen Rezaei
>            Priority: Major
>
> Implement a sink connector to allow for loading pre-processed data into Snowflake. In the streaming world, this can make use of the [Snowpipe Streaming API|https://javadoc.io/doc/net.snowflake/snowflake-ingest-sdk/2.0.2/net/snowflake/ingest/streaming/package-summary.html] and potentially in a future version support the exactly-once semantics.
> This sink would use the latest unified sink interfaces to implement at-least-once as a first step, providing {{DeliveryGuarantee.NONE}} and {{DeliveryGuarantee.AT_LEAST_ONCE}} semantics. A user would be able to provide a custom serializer for going from {{InputT}} incoming type to {{Map<String, Object>}} as documented by Snowflake, and configure the sink using a builder pattern.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)