You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/05/25 05:05:00 UTC
[jira] [Commented] (FLINK-9407) Support orc rolling sink writer
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490241#comment-16490241 ]
ASF GitHub Bot commented on FLINK-9407:
---------------------------------------
GitHub user zhangminglei opened a pull request:
https://github.com/apache/flink/pull/6075
[FLINK-9407] [hdfs connector] Support orc rolling sink writer
## What is the purpose of the change
In production environment, we often write file in orc format. So, this PR support a writer that for bucketingsink. And currently only basic data types are supported in this PR.
## Brief change log
Add ```OrcFileWriter``` and the test file.
## Verifying this change
Tests it with ```OrcFileWriterTest```
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (yes
- The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (don't know)
- Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: ( no )
- The S3 file system connector: (no)
## Documentation
- Does this pull request introduce a new feature? (yes)
- If yes, how is the feature documented? (not documented now)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhangminglei/flink flink-9407-orc
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/6075.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6075
----
commit d653d39f6cb74075874eb890cab36012d85dbecf
Author: zhangminglei <zm...@...>
Date: 2018-05-25T04:58:01Z
[FLINK-9407] [hdfs connector] Support orc rolling sink writer
----
> Support orc rolling sink writer
> -------------------------------
>
> Key: FLINK-9407
> URL: https://issues.apache.org/jira/browse/FLINK-9407
> Project: Flink
> Issue Type: New Feature
> Components: filesystem-connector
> Reporter: mingleizhang
> Assignee: mingleizhang
> Priority: Major
>
> Currently, we only support {{StringWriter}}, {{SequenceFileWriter}} and {{AvroKeyValueSinkWriter}}. I would suggest add an orc writer for rolling sink.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)