You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (Jira)" <ji...@apache.org> on 2020/01/15 13:51:00 UTC

[jira] [Updated] (FLINK-11395) Support for Avro StreamingFileSink

     [ https://issues.apache.org/jira/browse/FLINK-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephan Ewen updated FLINK-11395:
---------------------------------
    Labels: usability  (was: )

> Support for Avro StreamingFileSink
> ----------------------------------
>
>                 Key: FLINK-11395
>                 URL: https://issues.apache.org/jira/browse/FLINK-11395
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / FileSystem
>            Reporter: Elango Ganesan
>            Priority: Major
>              Labels: usability
>
> Current implementation for StreamingFileSink supports Rowformat for text and json files . BulkWriter has support for Parquet files . Out of the box RowFormat does not seem to be right fit for writing Avro files as avro files need to persist metadata when opening new file.  We are thinking of implementing Avro writers similar to how Parquet is implemented . I am happy to submit a PR if this approach sounds good . 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)