You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2020/02/03 23:24:24 UTC

[jira] [Reopened] (ARROW-6757) [Python] Creating csv.ParseOptions() causes "Windows fatal exception: access violation" with Visual Studio 2017

     [ https://issues.apache.org/jira/browse/ARROW-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney reopened ARROW-6757:
---------------------------------

I've been able to reproduce this with a fresh Miniconda using the release verification script:

{code}
C:\tmp\arrow-verify-release\conda-env\Library\bin\cmake.exe -DPYTHON_EXECUTABLE=C:\tmp\arrow-verify-release\conda-env\python.exe  -G "Visual Studio 14 2015 Win64" -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_FLIGHT=on -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=on -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=on -DPYARROW_BUNDLE_BOOST=off -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release C:\tmp\arrow-verify-release\apache-arrow-0.16.0\python
-- Selecting Windows SDK version 10.0.14393.0 to target Windows 10.0.17763.
-- The C compiler identification is MSVC 19.0.24234.1
-- The CXX compiler identification is MSVC 19.0.24234.1
{code}

It looks like it could be a conflict between the MSVC (VS 2017) used to build libarrow and the configuration {{"Visual Studio 14 2015 Win64"}} being passed by the pyarrow build. 

I'm guessing we should not be hardcoding this in setup.py

https://github.com/apache/arrow/blob/master/python/setup.py#L130

I'll see if setting the environment variable {{PYARROW_CMAKE_GENERATOR}} fixes the problem

> [Python] Creating csv.ParseOptions() causes "Windows fatal exception: access violation" with Visual Studio 2017
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-6757
>                 URL: https://issues.apache.org/jira/browse/ARROW-6757
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>            Reporter: Wes McKinney
>            Priority: Major
>
> I encountered this when trying to verify the release with MSVC 2017. It may be particular to this machine or build (though it's 100% reproducible for me). I will check the Windows wheels to see if it occurs there, too
> {code}
> (C:\tmp\arrow-verify-release\conda-env) λ python
> Python 3.7.3 | packaged by conda-forge | (default, Jul  1 2019, 22:01:29) [MSC v.1900 64 bit (AMD64)] :: Anaconda, Inc. on win32
> Type "help", "copyright", "credits" or "license" for more information.
> >>> import pyarrow.csv as pc
> >>> pc.ParseOptions()
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)