You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by "jerqi (via GitHub)" <gi...@apache.org> on 2023/02/13 12:51:18 UTC

[GitHub] [incubator-uniffle] jerqi opened a new issue, #596: [Subtask] [Netty] Use off heap memory to read HDFS data

jerqi opened a new issue, #596:
URL: https://github.com/apache/incubator-uniffle/issues/596

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues) and found no similar issues.
   
   
   ### Describe the subtask
   
   We need to use off heap memory to read HDFS data to reduce GC.
   
   ### Parent issue
   
   # 133
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-uniffle] jerqi closed issue #596: [Subtask] [Netty] Use off heap memory to read HDFS data

Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi closed issue #596: [Subtask] [Netty] Use off heap memory to read HDFS data
URL: https://github.com/apache/incubator-uniffle/issues/596


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-uniffle] jerqi commented on issue #596: [Subtask] [Netty] Use off heap memory to read HDFS data

Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi commented on issue #596:
URL: https://github.com/apache/incubator-uniffle/issues/596#issuecomment-1499283080

   Method `read` can use ByteBuffer to read data. https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FSDataInputStream.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org