You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "hadley (via GitHub)" <gi...@apache.org> on 2024/09/20 20:47:13 UTC
[I] Provide some way to suppress warning about unknown extension? [arrow-nanoarrow]
hadley opened a new issue, #631:
URL: https://github.com/apache/arrow-nanoarrow/issues/631
e.g.
```
geography: Converting unknown extension google:sqlType:geography{string} as storage type
Backtrace:
▆
1. ├─bigrquery::bq_table_download(tb, api = "arrow", quiet = TRUE) at test-bq-download.R:103:3
2. │ └─bigrquerystorage::bqs_table_download(...) at bigrquery/R/bq-download.R:122:7
3. │ ├─base::as.data.frame(nanoarrow::read_nanoarrow(raws)) at bigrquerystorage/R/bqs_download.R:111:3
4. │ └─nanoarrow:::as.data.frame.nanoarrow_array_stream(nanoarrow::read_nanoarrow(raws))
5. │ └─nanoarrow::infer_nanoarrow_ptype(x$get_schema())
6. └─nanoarrow:::infer_ptype_other(`<nnrrw_sc>`)
7. ├─nanoarrow::infer_nanoarrow_ptype_extension(spec, schema)
8. └─nanoarrow:::infer_nanoarrow_ptype_extension.default(spec, schema)
9. └─nanoarrow:::warn_unregistered_extension_type(x)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Provide some way to suppress warning about unknown extension? [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot commented on issue #631:
URL: https://github.com/apache/arrow-nanoarrow/issues/631#issuecomment-2364930589
Thank you for the reproducer!
After #632 this should be:
``` r
# Using pak::pak("apache/arrow-nanoarrow/r#632")
ipc_raw <- readr::read_rds("https://github.com/user-attachments/files/17082385/raws.zip")
options(nanoarrow.warn_unregistered_extension = FALSE)
ipc_raw |>
nanoarrow::read_nanoarrow() |>
tibble::as_tibble()
#> # A tibble: 1 × 15
#> unicode datetime logicaltrue logicalfalse bytes date
#> <chr> <dttm> <lgl> <lgl> <blob> <date>
#> 1 😃 2000-01-02 03:04:05 TRUE FALSE <raw 2 B> 2000-01-02
#> # ℹ 9 more variables: time <time>, timestamp <dttm>, geography <chr>,
#> # s <df[,2]>, a <list<dbl>>, aos <list<df[,2]>>, soa <df[,2]>, bb <df[,2]>,
#> # gg <df[,1]>
```
<sup>Created on 2024-09-20 with [reprex v2.1.1](https://reprex.tidyverse.org)</sup>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Provide some way to suppress warning about unknown extension? [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot commented on issue #631:
URL: https://github.com/apache/arrow-nanoarrow/issues/631#issuecomment-2364724707
Great point!
Maybe not worth doing immediately since extension types are not that well tested in the wild; however, the built-in extension system should be able to handle converting geography columns to `wk::wkt(geodesic = TRUE, crs=wk::wk_crs_longlat())`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Provide some way to suppress warning about unknown extension? [arrow-nanoarrow]
Posted by "paleolimbot (via GitHub)" <gi...@apache.org>.
paleolimbot closed issue #631: Provide some way to suppress warning about unknown extension?
URL: https://github.com/apache/arrow-nanoarrow/issues/631
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Provide some way to suppress warning about unknown extension? [arrow-nanoarrow]
Posted by "meztez (via GitHub)" <gi...@apache.org>.
meztez commented on issue #631:
URL: https://github.com/apache/arrow-nanoarrow/issues/631#issuecomment-2364802631
Trying to figure out why the internal is not able to pick it up.
Here is a raws vector to test out.
[raws.zip](https://github.com/user-attachments/files/17082385/raws.zip)
```r
a <- readRDS("raws.zip")
b <- as.data.frame(a)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Provide some way to suppress warning about unknown extension? [arrow-nanoarrow]
Posted by "hadley (via GitHub)" <gi...@apache.org>.
hadley commented on issue #631:
URL: https://github.com/apache/arrow-nanoarrow/issues/631#issuecomment-2367079155
I also see warnings for `google:sqlType:datetime{timestamp('us', '')}`
``
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org