You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2026/01/24 21:57:46 UTC

[I] [EPIC] Implement native columnar to row operator [datafusion-comet]

andygrove opened a new issue, #3268:
URL: https://github.com/apache/datafusion-comet/issues/3268

   ### What is the problem the feature request solves?
   
   Implementing a native columnar-to-row operator would reduce GC pressure by avoiding JVM allocations.
   
   ### Existing PRs
   
   - https://github.com/apache/datafusion-comet/pull/3221
   - https://github.com/apache/datafusion-comet/pull/3266
   
   ### Remaining Work
   
   - [ ] Address review comment https://github.com/apache/datafusion-comet/pull/3221#discussion_r2719315607 (Do we need to consider exportedNumRows > batchSize)
   - [ ] Address review comment https://github.com/apache/datafusion-comet/pull/3221#discussion_r2719336356 (Does the columnBatch need to be closed after converting?)
   - [ ] Fix Spark SQL test failures
   - [ ] Enable feature by default
   
   ### Describe the potential solution
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] [EPIC] Implement native columnar to row operator [datafusion-comet]

Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #3268: [EPIC] Implement native columnar to row operator
URL: https://github.com/apache/datafusion-comet/issues/3268


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org