[I] Avoid extra row buffer in writer [hudi]

["the-other-tim-brown (via GitHub)" <gi...@apache.org>]

the-other-tim-brown opened a new issue, #17808:
URL: https://github.com/apache/hudi/issues/17808

   ### Task Description
   
   **What needs to be done:**
   The writer maintains a list of rows in memory. This requires us to copy the row for safety. Instead we should try to write to the lance file writer on each write to extract the data from this row immediately and avoid the need to copy the row.
   
   **Why this task is needed:**
   Improves writer performance
   
   ### Task Type
   
   Code improvement/refactoring
   
   ### Related Issues
   
   **Parent feature issue:** (if applicable )
   **Related issues:**
   NOTE: Use `Relationships` button to add parent/blocking issues after issue is created.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Avoid extra row buffer in writer [hudi]

["the-other-tim-brown (via GitHub)" <gi...@apache.org>]

the-other-tim-brown commented on issue #17808:
URL: https://github.com/apache/hudi/issues/17808#issuecomment-3784345010

   Fixed by https://github.com/apache/hudi/pull/17916


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Avoid extra row buffer in writer [hudi]

["the-other-tim-brown (via GitHub)" <gi...@apache.org>]

the-other-tim-brown closed issue #17808: Avoid extra row buffer in writer
URL: https://github.com/apache/hudi/issues/17808


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org