You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/01/21 06:26:38 UTC
[GitHub] [arrow] jorgecarleitao opened a new pull request #9281: ARROW-11333: [Rust] Generalized creation of empty arrays.
jorgecarleitao opened a new pull request #9281:
URL: https://github.com/apache/arrow/pull/9281
# Rational
Creating an empty array was scattered around parquet, arrow and datafusion crates, mostly derived from need. Recently, #9156 harmonized some of that for list arrays.
However, this creation still does not support arbitrary nested types because it uses builders (which are typed), and the arbitrary empty array problem is not addressed yet.
# This PR
Exposes a new function, `new_empty_array`, that creates a new `ArrayRef` (i.e. dynamically typed) that supports arbitrarily nested types. It also exposes `RecordBatch::new_empty` that creates an empty `RecordBatch`, thereby migrating code from `DataFusion`.
Since we were using a similar code in `DataFusion` and `array/transform/mod.rs`, this PR ends up removing some code.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #9281: ARROW-11333: [Rust] Generalized creation of empty arrays.
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #9281:
URL: https://github.com/apache/arrow/pull/9281#issuecomment-764412043
https://issues.apache.org/jira/browse/ARROW-11333
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9281: ARROW-11333: [Rust] Generalized creation of empty arrays.
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9281:
URL: https://github.com/apache/arrow/pull/9281#issuecomment-764422417
@ovr, this is what I was trying to express in your PR: we can use `ArrayData` directly and thereby support arbitrary nested types.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorgecarleitao commented on pull request #9281: ARROW-11333: [Rust] Generalized creation of empty arrays.
Posted by GitBox <gi...@apache.org>.
jorgecarleitao commented on pull request #9281:
URL: https://github.com/apache/arrow/pull/9281#issuecomment-764422417
@ovr, this is what I was trying to express in your PR: we can use `ArrayData` directly and thereby support arbitrary nested types.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] nevi-me closed pull request #9281: ARROW-11333: [Rust] Generalized creation of empty arrays.
Posted by GitBox <gi...@apache.org>.
nevi-me closed pull request #9281:
URL: https://github.com/apache/arrow/pull/9281
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #9281: ARROW-11333: [Rust] Generalized creation of empty arrays.
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #9281:
URL: https://github.com/apache/arrow/pull/9281#issuecomment-764412043
https://issues.apache.org/jira/browse/ARROW-11333
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org