You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "izveigor (via GitHub)" <gi...@apache.org> on 2023/06/08 18:18:07 UTC
[GitHub] [arrow-datafusion] izveigor opened a new issue, #6119: New functions and operations for working with arrays
izveigor opened a new issue, #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119
### Is your feature request related to a problem or challenge?
Arrow-DataFusion can support creating an array of a certain data type (`make_array`), but there are no functions to work with them.
In my opinion, the documentation of the database PostgreSQL can serve as a reference for working on arrays.
The following features are considered for implementation:
Operators:
- [ ] Any
Array operators:
- [ ] concatenation
- [ ] overlap
- [ ] concatenate
Array functions:
- [ ] array_append
- [ ] array_cat
- [ ] array_ndims
- [ ] array_dims
- [ ] array_fill
- [ ] array_length
- [ ] array_lower
- [ ] array_position
- [ ] array_positions
- [ ] array_prepend
- [ ] array_remove
- [ ] array_replace
- [ ] array_to_string
- [ ] array_upper
- [ ] cardinality
- [ ] string_to_array
- [ ] unnest
### Describe the solution you'd like
Series of PR, active discussion of features.
### Describe alternatives you've considered
The significance of some features can be disproven as a result of conversations.
### Additional context
Sources:
The array documentation: [PostgreSQL](https://postgrespro.ru/docs/postgrespro/15/functions-array?lang=en)
#6073
#6075
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #6119: New functions and operations for working with arrays
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119#issuecomment-1583127828
I agree -- thanks @BubbaJoe . @izveigor FYI I reopened this one. Perhaps it would be good to file a follow on ticket with what is not yet implemented and then we can close this ticket
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] izveigor closed issue #6119: New functions for working with arrays
Posted by "izveigor (via GitHub)" <gi...@apache.org>.
izveigor closed issue #6119: New functions for working with arrays
URL: https://github.com/apache/arrow-datafusion/issues/6119
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] mustafaakin commented on issue #6119: New functions and operations for working with arrays
Posted by "mustafaakin (via GitHub)" <gi...@apache.org>.
mustafaakin commented on issue #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119#issuecomment-1543412410
We have a lot of nested data at [Resmo](www.resmo.com) and currently using [PartiQL](www.partiql.org) but we were exploring to switch to data-fusion. We make use a lot of *unnest*.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #6119: New functions and operations for working with arrays
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119#issuecomment-1571834584
Thank you @izveigor -- I have added this ticket to the tracking epic for working with lists in DataFusion: https://github.com/apache/arrow-datafusion/issues/2326
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] BubbaJoe commented on issue #6119: New functions and operations for working with arrays
Posted by "BubbaJoe (via GitHub)" <gi...@apache.org>.
BubbaJoe commented on issue #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119#issuecomment-1579784411
@alamb Isn't there still some functions/operators that need to be finished?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] izveigor commented on issue #6119: New functions for working with arrays
Posted by "izveigor (via GitHub)" <gi...@apache.org>.
izveigor commented on issue #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119#issuecomment-1583205791
@alamb @BubbaJoe Yes, I created two additional tickets for the remaining cases.
So, I think I can close this ticket now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed issue #6119: New functions and operations for working with arrays
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #6119: New functions and operations for working with arrays
URL: https://github.com/apache/arrow-datafusion/issues/6119
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] izveigor commented on issue #6119: New functions and operations for working with arrays
Posted by "izveigor (via GitHub)" <gi...@apache.org>.
izveigor commented on issue #6119:
URL: https://github.com/apache/arrow-datafusion/issues/6119#issuecomment-1544555809
Hello, @mustafaakin!
I think I can create PR with the implementation _unnest_ soon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org