You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2018/07/04 20:19:00 UTC

[jira] [Commented] (FLINK-9411) Support parquet rolling sink writer

    [ https://issues.apache.org/jira/browse/FLINK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533039#comment-16533039 ] 

Stephan Ewen commented on FLINK-9411:
-------------------------------------

We have started an effort to completely redesign the BucketingSink. The initial work-in-progress looks quite promising.
It is tracked under FLINK-9749

Please take a look at FLINK-9749 and the subtask FLINK-9753
The description outlines why I believe the simple approach suggested here may not be enough (will frequently result in badly compressed ORC/Parquet).

Please let us know what you think in FLINK-9753

> Support parquet rolling sink writer
> -----------------------------------
>
>                 Key: FLINK-9411
>                 URL: https://issues.apache.org/jira/browse/FLINK-9411
>             Project: Flink
>          Issue Type: New Feature
>          Components: filesystem-connector
>            Reporter: zhangminglei
>            Assignee: Triones Deng
>            Priority: Major
>
> Like support orc rolling sink writer in FLINK-9407 , we should also support parquet rolling sink writer.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)