[I] `RowConverter` on list should only encode the sliced list values and not the entire data [arrow-rs]

["rluvaton (via GitHub)" <gi...@apache.org>]

rluvaton opened a new issue, #7993:
URL: https://github.com/apache/arrow-rs/issues/7993

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   Yes, In my case I have sorted array and I want to know if the first and last value are the same, if they are I want to keep the array as is, otherwise convert it and do some computation.
   
   So I'm currently slicing the array twice to get the first and last row and only convert them to row based, if they are equal I can skip converting the entire array.
   
   when calling on list the list values is converted entirely even when not needed (we have a problem with converting values masked by nulls but this is a different issue) making it much slower than it should  
   
   **Describe the solution you'd like**
   The convertor should only convert the list sliced values and instead of working with `offsets()`, it should work with `offsets().lengths()` as the offsets can now pointing to the wrong place
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] `RowConverter` on list should only encode the sliced list values and not the entire data [arrow-rs]

["alamb (via GitHub)" <gi...@apache.org>]

alamb closed issue #7993: `RowConverter` on list should only encode the sliced list values and not the entire data
URL: https://github.com/apache/arrow-rs/issues/7993


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] `RowConverter` on list should only encode the sliced list values and not the entire data [arrow-rs]

["alamb (via GitHub)" <gi...@apache.org>]

alamb commented on issue #7993:
URL: https://github.com/apache/arrow-rs/issues/7993#issuecomment-3130014776

   `label_issue.py` automatically added labels {'arrow'} from #7996


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org