[GitHub] [arrow-datafusion] Jimexist edited a comment on issue #1248: Optimized `RecordBatch` for constant columns

[GitBox <gi...@apache.org>]

Jimexist edited a comment on issue #1248:
URL: https://github.com/apache/arrow-datafusion/issues/1248#issuecomment-962463921


   > Perhaps we could build something like DFRecordBatch akin to DFSchema (aka wrap the arrow RecordBatch with methods that allow the columns to be ColumnarValue)
   
   I'm for this approach.
   
   In fact we can allow several other types that are memory efficient:
   1. sequence with increase or decrease direction and step size
   2. repeated array that's n copies of underlying data
   3. zoomed out sample of underlying data
   4. etc. 
   
   basically `DFRecordBatch` with lazy evaluated operations that owns the underlying data (can be a much shorter one)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org