You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/08/25 13:05:01 UTC

[jira] [Commented] (FLINK-7517) let NettyBufferPool extend PooledByteBufAllocator

    [ https://issues.apache.org/jira/browse/FLINK-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141584#comment-16141584 ] 

ASF GitHub Bot commented on FLINK-7517:
---------------------------------------

GitHub user NicoK opened a pull request:

    https://github.com/apache/flink/pull/4594

    [FLINK-7517][network] let NettyBufferPool extend PooledByteBufAllocator

    ## What is the purpose of the change
    
    `NettyBufferPool` wraps `PooledByteBufAllocator` but due to this, any allocated buffer's `alloc()` method is returning the wrapped `PooledByteBufAllocator` which allows heap buffers again. By extending the `PooledByteBufAllocator` instead, we prevent this loop hole and also fix Netty's invariant that a copy of a buffer should have the same allocator.
    
    ## Brief change log
    
    - change `NettyBufferPool` from wrapping `PooledByteBufAllocator` into extending it
    
    ## Verifying this change
    
    This change is already covered by existing tests, such as `NettyBufferPoolTest` since the behaviour does not change.
    
    ## Does this pull request potentially affect one of the following parts:
    
      - Dependencies (does it add or upgrade a dependency): (no)
      - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
      - The serializers: (no)
      - The runtime per-record code paths (performance sensitive): (yes)
      - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (no)
    
    ## Documentation
    
      - Does this pull request introduce a new feature? (no)
      - If yes, how is the feature documented? (JavaDocs)


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/NicoK/flink flink-7517

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/4594.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4594
    
----
commit ec0db2bedffbe67b9a5e08c577a1b74f74c061ac
Author: Nico Kruber <ni...@data-artisans.com>
Date:   2017-08-23T10:04:28Z

    [FLINK-7517][network] let NettyBufferPool extend PooledByteBufAllocator
    
    Previously, NettyBufferPool only wrapped PooledByteBufAllocator but then, any
    allocated buffer's alloc() method was returning the wrapped
    PooledByteBufAllocator which allowed heap buffers again. By extending the
    PooledByteBufAllocator, we prevent this loop hole.
    
    This also fixes the invariant that a copy of a buffer should have the same
    allocator.

----


> let NettyBufferPool extend PooledByteBufAllocator
> -------------------------------------------------
>
>                 Key: FLINK-7517
>                 URL: https://issues.apache.org/jira/browse/FLINK-7517
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Network
>    Affects Versions: 1.4.0
>            Reporter: Nico Kruber
>            Assignee: Nico Kruber
>
> {{NettyBufferPool}} wraps {{PooledByteBufAllocator}} but due to this, any allocated buffer's {{alloc()}} method is returning the wrapped {{PooledByteBufAllocator}} which allowed heap buffers again. By extending the {{PooledByteBufAllocator}}, we prevent this loop hole and also fix the invariant that a copy of a buffer should have the same allocator.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)