You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2018/07/04 20:19:00 UTC
[jira] [Commented] (FLINK-9407) Support orc rolling sink writer
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533040#comment-16533040 ]
Stephan Ewen commented on FLINK-9407:
-------------------------------------
We have started an effort to completely redesign the BucketingSink. The initial work-in-progress looks quite promising.
It is tracked under FLINK-9749
Please take a look at FLINK-9749 and the subtask FLINK-9753
The description outlines why I believe the simple approach suggested here may not be enough (will frequently result in badly compressed ORC/Parquet).
Please let us know what you think in FLINK-9753
> Support orc rolling sink writer
> -------------------------------
>
> Key: FLINK-9407
> URL: https://issues.apache.org/jira/browse/FLINK-9407
> Project: Flink
> Issue Type: New Feature
> Components: filesystem-connector
> Reporter: zhangminglei
> Assignee: zhangminglei
> Priority: Major
> Labels: patch-available
>
> Currently, we only support {{StringWriter}}, {{SequenceFileWriter}} and {{AvroKeyValueSinkWriter}}. I would suggest add an orc writer for rolling sink.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)