You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "FangYongs (via GitHub)" <gi...@apache.org> on 2023/03/31 08:18:18 UTC

[GitHub] [incubator-paimon] FangYongs opened a new issue, #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory

FangYongs opened a new issue, #796:
URL: https://github.com/apache/incubator-paimon/issues/796

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   Currently MemoryFileStoreWrite allocate memory pool from heap for sink writer. It should allocate segments from MemoryManager for flink sink.
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] FangYongs commented on issue #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory

Posted by "FangYongs (via GitHub)" <gi...@apache.org>.
FangYongs commented on issue #796:
URL: https://github.com/apache/incubator-paimon/issues/796#issuecomment-1491651750

   Thanks @zoucao. I considered this issue overall and thought it was a big feature. We should review the memory usage in merge tree and will give a design in PIP. I will create subtasks after that and please feel free to take them


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] zhuangchong commented on issue #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong commented on issue #796:
URL: https://github.com/apache/incubator-paimon/issues/796#issuecomment-1669418000

   The related PR has been merged and I will close this issue.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] zoucao commented on issue #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory

Posted by "zoucao (via GitHub)" <gi...@apache.org>.
zoucao commented on issue #796:
URL: https://github.com/apache/incubator-paimon/issues/796#issuecomment-1491606200

   I am willing to try this ticket, counld you assign it to me 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] zoucao commented on issue #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory

Posted by "zoucao (via GitHub)" <gi...@apache.org>.
zoucao commented on issue #796:
URL: https://github.com/apache/incubator-paimon/issues/796#issuecomment-1491770786

   > Thanks @zoucao. I considered this issue overall and thought it was a big feature. We should review the memory usage in merge tree and will give a design in PIP. I will create subtasks after that and please feel free to take them
   
   Hi @FangYongs, Thanks for your kind advice, and I am looking forward to your design.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-paimon] zhuangchong closed issue #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory

Posted by "zhuangchong (via GitHub)" <gi...@apache.org>.
zhuangchong closed issue #796: [Feature] MemoryFileStoreWrite in flink sink allocate segment from flink managed memory
URL: https://github.com/apache/incubator-paimon/issues/796


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org