You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/09/01 17:33:45 UTC
[jira] [Commented] (FLINK-2583) Add Stream Sink For Rolling HDFS
Files
[ https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14725568#comment-14725568 ]
ASF GitHub Bot commented on FLINK-2583:
---------------------------------------
GitHub user aljoscha opened a pull request:
https://github.com/apache/flink/pull/1084
[FLINK-2583] Add Stream Sink For Rolling HDFS Files
Note: The rolling sink is not yet integrated with checkpointing/fault-tolerance.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aljoscha/flink hdfs-sink
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1084.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1084
----
commit 8c852c2abf3a1e597dd1d139197d3420861a516c
Author: Robert Metzger <rm...@apache.org>
Date: 2015-08-27T16:13:08Z
[FLINK-2584] Check for unshaded classes in fat jar and shade curator
This closes #1076
commit f4a48c23a30c170a5a2c08c27e1f01f7827eefd2
Author: chengxiang li <ch...@intel.com>
Date: 2015-08-31T06:02:27Z
[FLINK-2596] Remove non-transitive comparator in random sampler test.
This closes #1080
commit ab14f90142fd69426bb695cbdb641f0a5a0c46f7
Author: Martin Junghanns <ma...@gmx.net>
Date: 2015-08-29T20:51:19Z
[FLINK-2590] fixing DataSetUtils.zipWithUniqueId() and DataSetUtils.zipWithIndex()
* modified algorithm as explained in the issue
* updated method documentation
[FLINK-2590] reducing required bit shift size
* maximum bit size is changed to getNumberOfParallelSubTasks() - 1
This closes #1075.
commit 6a58aadec15657a7da60c58ef6d5dbbf7e5ca14b
Author: Till Rohrmann <tr...@apache.org>
Date: 2015-09-01T10:04:23Z
[FLINK-2590] Fixes Scala's DataSetUtilsITCase
commit 81276ff88bb7185d93bbf92392b82b25ece7aff1
Author: Aljoscha Krettek <al...@gmail.com>
Date: 2015-08-31T08:01:38Z
[FLINK-2583] Add Stream Sink For Rolling HDFS Files
The rolling sink is not yet integrated with
checkpointing/fault-tolerance.
----
> Add Stream Sink For Rolling HDFS Files
> --------------------------------------
>
> Key: FLINK-2583
> URL: https://issues.apache.org/jira/browse/FLINK-2583
> Project: Flink
> Issue Type: New Feature
> Components: Streaming
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Fix For: 0.10
>
>
> In addition to having configurable file-rolling behavior the Sink should also integrate with checkpointing to make it possible to have exactly-once semantics throughout the topology.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)