You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/11/09 12:23:00 UTC
[jira] [Closed] (FLINK-32737) Add support for Snowflake sink connector
[ https://issues.apache.org/jira/browse/FLINK-32737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Martijn Visser closed FLINK-32737.
----------------------------------
Resolution: Invalid
> Add support for Snowflake sink connector
> ----------------------------------------
>
> Key: FLINK-32737
> URL: https://issues.apache.org/jira/browse/FLINK-32737
> Project: Flink
> Issue Type: New Feature
> Reporter: Mohsen Rezaei
> Priority: Major
>
> Implement a sink connector to allow for loading pre-processed data into Snowflake. In the streaming world, this can make use of the [Snowpipe Streaming API|https://javadoc.io/doc/net.snowflake/snowflake-ingest-sdk/2.0.2/net/snowflake/ingest/streaming/package-summary.html] and potentially in a future version support the exactly-once semantics.
> This sink would use the latest unified sink interfaces to implement at-least-once as a first step, providing {{DeliveryGuarantee.NONE}} and {{DeliveryGuarantee.AT_LEAST_ONCE}} semantics. A user would be able to provide a custom serializer for going from {{InputT}} incoming type to {{Map<String, Object>}} as documented by Snowflake, and configure the sink using a builder pattern.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)