You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "eitsupi (via GitHub)" <gi...@apache.org> on 2025/02/19 13:56:02 UTC
[I] [R] Cannot correctly handle arrow metadata derived from the R arrow package [arrow-nanoarrow]
eitsupi opened a new issue, #713:
URL: https://github.com/apache/arrow-nanoarrow/issues/713
It seems to be unable to correctly handle the Arrow data headers generated from extension type such as from `package_version`?
``` r
arrow::as_arrow_array(
package_version(c(
"1.2-4", "1.2-3", "2.1"
))
) |>
nanoarrow::as_nanoarrow_array() |>
as.vector()
#> Error: lexical error: invalid char in json text.
#> A 3 263170 197888 5 UTF-8 787 0
#> (right here) ------^
```
<sup>Created on 2025-02-19 with [reprex v2.1.1](https://reprex.tidyverse.org)</sup>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Cannot correctly handle arrow metadata derived from the R arrow package [arrow-nanoarrow]
Posted by "eitsupi (via GitHub)" <gi...@apache.org>.
eitsupi commented on issue #713:
URL: https://github.com/apache/arrow-nanoarrow/issues/713#issuecomment-2704231050
Thank you for your comment!
It seems the error message is not clear here, so I am wondering if it is possible to display a hint that ignores the extension type and converts the value to R. (Is such a thing possible?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Cannot correctly handle arrow metadata derived from the R arrow package [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot commented on issue #713:
URL: https://github.com/apache/arrow-nanoarrow/issues/713#issuecomment-2704253282
Agreed. The easiest way to work around this is to just change the extension name, since they are both valid extensions but they are different. I should have done this when I fixed the security issue in nanoarrow.
https://github.com/apache/arrow-nanoarrow/blob/e77a656728c6be5ba13e58f3a7ac9c4e13182fc5/r/R/extension-vctrs.R#L47
(+ a few more references to `arrow.r.vctrs` would have to be renamed)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Cannot correctly handle arrow metadata derived from the R arrow package [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot closed issue #713: [R] Cannot correctly handle arrow metadata derived from the R arrow package
URL: https://github.com/apache/arrow-nanoarrow/issues/713
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Cannot correctly handle arrow metadata derived from the R arrow package [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot closed issue #713: [R] Cannot correctly handle arrow metadata derived from the R arrow package
URL: https://github.com/apache/arrow-nanoarrow/issues/713
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] Cannot correctly handle arrow metadata derived from the R arrow package [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot commented on issue #713:
URL: https://github.com/apache/arrow-nanoarrow/issues/713#issuecomment-2704222050
Yes, I think the vctrs_extension_type uses a different serialization which was changed here for security reasons. I think the fastest solution is to just use a different extension name in nanoarrow (so that the storage from arrow gets implicitly converted and vice versa).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org