You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "izveigor (via GitHub)" <gi...@apache.org> on 2023/07/30 18:39:29 UTC
[GitHub] [arrow-datafusion] izveigor opened a new issue, #7147: Regression: list `index` does not support with columns
izveigor opened a new issue, #7147:
URL: https://github.com/apache/arrow-datafusion/issues/7147
### Is your feature request related to a problem or challenge?
Follow on to https://github.com/apache/arrow-datafusion/pull/6936
When we apply some kind of index to a list presented as a column, then one element is returned to us instead of the proper number.
Example:
```
❯ select column1, column2, column3 from slices;
+------------------------------------------+---------+---------+
| column1 | column2 | column3 |
+------------------------------------------+---------+---------+
| [, 2, 3, 4, 5, 6, 7, 8, 9, 10] | 1 | 1 |
| [11, 12, 13, 14, 15, 16, 17, 18, , 20] | 2 | -4 |
| [21, 22, 23, , 25, 26, 27, 28, 29, 30] | 0 | 0 |
| [31, 32, 33, 34, 35, , 37, 38, 39, 40] | -4 | -7 |
| | 4 | 5 |
| [41, 42, 43, 44, 45, 46, 47, 48, 49, 50] | | 6 |
| [51, 52, , 54, 55, 56, 57, 58, 59, 60] | 5 | |
+------------------------------------------+---------+---------+
```
```
❯ select column1[2] from slices;
+--------------------------+
| slices.column1[Int64(2)] |
+--------------------------+
| 2 |
+--------------------------+
```
Should be:
```
❯ select column1[2] from slices;
+-------------------+
| slices.column1[2] |
+-------------------+
| 2 |
| 12 |
| 22 |
| 32 |
| 42 |
| 52 |
+-------------------+
```
P.S. `Struct` still supports columns.
### Describe the solution you'd like
_No response_
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed issue #7147: Regression: list `index` does not support with columns
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #7147: Regression: list `index` does not support with columns
URL: https://github.com/apache/arrow-datafusion/issues/7147
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #7147: Regression: list `index` does not support with columns
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #7147:
URL: https://github.com/apache/arrow-datafusion/issues/7147#issuecomment-1658105389
Is this actually a regression (in the sense that something that used to work no longer does?) I was under the impression DataFusion never supported array element access
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] izveigor commented on issue #7147: Regression: list `index` does not support with columns
Posted by "izveigor (via GitHub)" <gi...@apache.org>.
izveigor commented on issue #7147:
URL: https://github.com/apache/arrow-datafusion/issues/7147#issuecomment-1658230922
> Is this actually a regression (in the sense that something that used to work no longer does?) I was under the impression DataFusion never supported array element access before, and this is just tracking a missing piece of functionality
@alamb I think I can call it regression. Some tests after merging https://github.com/apache/arrow-datafusion/pull/6936 will not work (for example, `query_nested_get_indexed_field_on_struct`)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org