You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Omar Yassin (Jira)" <ji...@apache.org> on 2020/02/09 23:29:00 UTC
[jira] [Updated] (ARROW-7807) [R] Installation on RHEL 7 Cannot
call io___MemoryMappedFile__Open()
[ https://issues.apache.org/jira/browse/ARROW-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omar Yassin updated ARROW-7807:
-------------------------------
Description:
Hey Team,
I've been using Arrow successfully in python through conda and have been able to write and read parquet files successfully. Now I'm trying to have R users consume some of the parquet files I've produced. They run a shared R build in a custom location, so can't use conda with their setup. We tried installing the C++ libraries system-wide and then the R library in a user's directory, but kept getting {color:#de350b}Cannot call io{color}{color:#de350b}{{__MemoryMappedFile_}}{color}{color:#de350b}Open() {color}errors on{color:#de350b} read_parquet(){color}. I'm not sure if we've missed a step, or where to continue debugging. Does the R package have any known issues on RHEL 7? Below are some details:
Environment:
* RHEL 7.6
* Custom local R environment in a non-default location
Steps taken:
# Installed the C++ libraries first (now live in /usr/lib64) as described (v.0.16.0) in [https://arrow.apache.org/install/]
# Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive R session
# It couldn't find the C++ libraries and said {{{color:#de350b}No C++ binaries found for rhel-7{color}}}
# Couldn't find [https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip] when it tried to pull the binaries
# Source download didn't work due to internal github firewall rules
# Installed without errors, but threw {{{color:#de350b}Cannot call io{color}}}{color:#de350b}{{__MemoryMappedFile_}}{color}{{{color:#de350b}Open(){color}}} error on {{{color:#de350b}read_parquet(){color}}}
# Removed the rlib/arrow directory and tried a different route
# Set {{{color:#de350b}LIBARROW_BINARY_DISTRO='centos-7'{color}}}
# Set {{{color:#de350b}PKG_CONFIG=/usr/lib64{color}}}
# Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive R session
# Binaries and package seemed to install correctly without complaints
# Still threw {{{color:#de350b}Cannot call {color}}}{color:#de350b}{{io__MemoryMappedFile_Open{{{color:#de350b}(){color} on {color:#de350b}read_parquet{color}}}}}{color}
was:
Hey Team,
I've been using Arrow successfully in python through conda and have been able to write and read parquet files successfully. Now I'm trying to have R users consume some of the parquet files I've produced. They run a shared R build in a custom location, so can't use conda with their setup. We tried installing the C++ libraries system-wide and then the R library in a user's directory, but kept getting {color:#de350b}{{Cannot call io___MemoryMappedFile__Open() }}{color}errors on{color:#de350b}{{ read_parquet()}}{color}. I'm not sure if we've missed a step, or where to continue debugging. Does the R package have any known issues on RHEL 7? Below are some details:
Environment:
* RHEL 7.6
* Custom local R environment in a non-default location
Steps taken:
# Installed the C++ libraries first (now live in /usr/lib64) as described (v.0.16.0) in [https://arrow.apache.org/install/]
# Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive R session
# It couldn't find the C++ libraries and said {{{color:#de350b}No C++ binaries found for rhel-7{color}}}
# Couldn't find [https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip] when it tried to pull the binaries
# Source download didn't work due to internal github firewall rules
# Installed without errors, but threw {{{color:#de350b}Cannot call io___MemoryMappedFile__Open(){color}}} error on {{{color:#de350b}read_parquet(){color}}}
# Removed the rlib/arrow directory and tried a different route
# Set {{{color:#de350b}LIBARROW_BINARY_DISTRO='centos-7'{color}}}
# Set {{{color:#de350b}PKG_CONFIG=/usr/lib64{color}}}
# Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive R session
# Binaries and package seemed to install correctly without complaints
# Still threw {{{color:#de350b}Cannot call io___MemoryMappedFile__Open(){color} }}on{{ {color:#de350b}read_parquet{color}}}
> [R] Installation on RHEL 7 Cannot call io___MemoryMappedFile__Open()
> --------------------------------------------------------------------
>
> Key: ARROW-7807
> URL: https://issues.apache.org/jira/browse/ARROW-7807
> Project: Apache Arrow
> Issue Type: Bug
> Components: R
> Affects Versions: 0.16.0
> Environment: RHEL 7.6
> Custom R build in a non-default location
> Reporter: Omar Yassin
> Priority: Major
>
> Hey Team,
> I've been using Arrow successfully in python through conda and have been able to write and read parquet files successfully. Now I'm trying to have R users consume some of the parquet files I've produced. They run a shared R build in a custom location, so can't use conda with their setup. We tried installing the C++ libraries system-wide and then the R library in a user's directory, but kept getting {color:#de350b}Cannot call io{color}{color:#de350b}{{__MemoryMappedFile_}}{color}{color:#de350b}Open() {color}errors on{color:#de350b} read_parquet(){color}. I'm not sure if we've missed a step, or where to continue debugging. Does the R package have any known issues on RHEL 7? Below are some details:
>
> Environment:
> * RHEL 7.6
> * Custom local R environment in a non-default location
> Steps taken:
> # Installed the C++ libraries first (now live in /usr/lib64) as described (v.0.16.0) in [https://arrow.apache.org/install/]
> # Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive R session
> # It couldn't find the C++ libraries and said {{{color:#de350b}No C++ binaries found for rhel-7{color}}}
> # Couldn't find [https://dl.bintray.com/ursalabs/arrow-r/libarrow/bin/rhel-7/arrow-0.16.0.zip] when it tried to pull the binaries
> # Source download didn't work due to internal github firewall rules
> # Installed without errors, but threw {{{color:#de350b}Cannot call io{color}}}{color:#de350b}{{__MemoryMappedFile_}}{color}{{{color:#de350b}Open(){color}}} error on {{{color:#de350b}read_parquet(){color}}}
> # Removed the rlib/arrow directory and tried a different route
> # Set {{{color:#de350b}LIBARROW_BINARY_DISTRO='centos-7'{color}}}
> # Set {{{color:#de350b}PKG_CONFIG=/usr/lib64{color}}}
> # Ran {color:#de350b}{{install.packages('arrow')}}{color} in an interactive R session
> # Binaries and package seemed to install correctly without complaints
> # Still threw {{{color:#de350b}Cannot call {color}}}{color:#de350b}{{io__MemoryMappedFile_Open{{{color:#de350b}(){color} on {color:#de350b}read_parquet{color}}}}}{color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)