You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "zhijiang (Jira)" <ji...@apache.org> on 2019/12/10 10:11:00 UTC
[jira] [Assigned] (FLINK-15166) Shuffle data compression wrongly
decrease the buffer reference count.
[ https://issues.apache.org/jira/browse/FLINK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhijiang reassigned FLINK-15166:
--------------------------------
Assignee: Yingjie Cao
> Shuffle data compression wrongly decrease the buffer reference count.
> ---------------------------------------------------------------------
>
> Key: FLINK-15166
> URL: https://issues.apache.org/jira/browse/FLINK-15166
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Affects Versions: 1.10.0
> Reporter: Yingjie Cao
> Assignee: Yingjie Cao
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> FLINK-15140 report two relevant problems which are both triggered by broadcast partitioner, to make it more clear, I create this Jira to addresses the problems separately.
>
> For blocking shuffle compression, we recycle the compressed intermediate buffer each time after we write data out, however when the data is not compressed, the return buffer is the original buffer and should not be recycled, but we wrongly recycled it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)