You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Arethusag (via GitHub)" <gi...@apache.org> on 2024/04/11 20:06:02 UTC
[I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Arethusag opened a new issue, #41158:
URL: https://github.com/apache/arrow/issues/41158
### Describe the bug, including details regarding any error messages, version, and platform.
OS: FreeBSD 14.0
Libarrow version: 15.0.2
R arrow version: 15.0.1
R version: 4.3
To reproduce, compile libarrow from src using latest port on FreeBSD
https://www.freshports.org/databases/arrow with parquet feature enabled.
Run install.package("arrow") with LIB_ARROW_MINIMAL=FALSE
output of arrow_info() cmd:
> arrow_info()
Arrow package version: 15.0.1
Capabilities:
acero TRUE
dataset FALSE
substrait FALSE
parquet FALSE
json TRUE
s3 FALSE
gcs FALSE
utf8proc TRUE
re2 TRUE
snappy FALSE
gzip TRUE
brotli FALSE
zstd FALSE
lz4 FALSE
lz4_frame FALSE
lzo FALSE
bz2 FALSE
jemalloc FALSE
mimalloc FALSE
Happy to provide any other info. Thanks for your time.
### Component(s)
C++, R
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "assignUser (via GitHub)" <gi...@apache.org>.
assignUser commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2050719249
Hey thanks for your report! Could you run the install with `ARROW_R_DEV=true` and `LIBARROW_MINIMAL=FALSE` (without the underscore between lib and arrow) and post the log? (as a gist/pastebin would be nice)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "Arethusag (via GitHub)" <gi...@apache.org>.
Arethusag commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2051023133
Still working on being able to read a parquet file; I am getting an error with `arrow::read_parquet()` that I did not build arrow with snappy, so I will run the build again with the required compression libs and report back.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "Arethusag (via GitHub)" <gi...@apache.org>.
Arethusag commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2051012264
Still working on being able to read a parquet file, I did not build arrow with snappy, so I will run the build again with the additional compression libs and report back.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2052691231
For the ultimate issue here, I emailed the maintainer of [the port](https://www.freshports.org/databases/arrow) to ask if they have any ideas. I'll update here with what I find.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2052172893
Great, thanks for confirming @Arethusag.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-4229514487
Looks like this was resolved upstream so closing this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2051005052
Great, thanks for testing. Were you also able to test that it works correctly (can read or write a parquet file)?
I'll look at how the the arrow port gets managed/built tomorrow unless someone else beats me to it. We could relax the configure script if it's not easy to get changes to the port accepted.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "Arethusag (via GitHub)" <gi...@apache.org>.
Arethusag commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2050963729
[](https://pastebin.com/A8afTkSA) and its in /usr/local/lib/cmake/Arrow/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "Arethusag (via GitHub)" <gi...@apache.org>.
Arethusag commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2050915092
Hello, thanks for the quick repsonse. here is the pastebin [(https://pastebin.com/12XKaYJR)]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2052927551
The maintainer [patched the port](https://cgit.freebsd.org/ports/commit/?id=b845623d2f252dbc44068191bdfaf70f8123da26) so the R package should build correctly now. I'm still trying to figure out if the "true" values are part of some FreeBSD convention and I think once I understand that I'll know what to do next here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2050926051
Thanks. Could you pastebin the contents of `/usr/local/include/arrow/lib/cmake/Arrow/ArrowOptions.cmake` (I think I have that path right)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "Arethusag (via GitHub)" <gi...@apache.org>.
Arethusag commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2050998135
thanks for explaining how functionlity is detected... when i manually change the line to
'''
set(ARROW_PARQUET "ON")
'''
then the R package installs with parquet enabled.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "amoeba (via GitHub)" <gi...@apache.org>.
amoeba commented on issue #41158:
URL: https://github.com/apache/arrow/issues/41158#issuecomment-2050977750
Hrm, that's interesting. @assignUser is a lot more familiar than me with this part of the package, but in the configure script, we seem to detect and enable functionality based on ArrowOptions.cmake using [a command](https://github.com/apache/arrow/blob/main/r/configure#L389) like `grep -i 'set('"$1"' "ON")' $ARROW_OPTS_CMAKE >/dev/null 2>&1` and in your version I see:
```
set(ARROW_PARQUET "true")
```
whereas on my Mac, I see:
```
set(ARROW_PARQUET "ON")
```
So I wonder if something is up with how arrow gets packed on FreeBSD.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14. [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic closed issue #41158: [R] R package installs without parquet features enabled even when LIB_ARROW_MINIMAL=FALSE and libarrow compiled with parquet feature enabled on FreeBSD 14.
URL: https://github.com/apache/arrow/issues/41158
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org