You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "abcbarryn (via GitHub)" <gi...@apache.org> on 2023/02/21 18:39:04 UTC
[GitHub] [arrow] abcbarryn commented on issue #34277: pyarrow does not disable SIMD CPU optimizations when set to do so.
abcbarryn commented on issue #34277:
URL: https://github.com/apache/arrow/issues/34277#issuecomment-1438934455
I have tried building/installing it using pip and conda. I have tried build it from source, but I get stuck here:
```
# ./setup.py build
/usr/local/lib/python3.9/site-packages/setuptools/installer.py:27: SetuptoolsDeprecationWarning: setuptools.installer is deprecated. Requirements should be satisfied by a PEP 517 installer.
warnings.warn(
running build
running build_py
copying pyarrow/_generated_version.py -> build/lib.linux-x86_64-cpython-39/pyarrow
running egg_info
writing pyarrow.egg-info/PKG-INFO
writing dependency_links to pyarrow.egg-info/dependency_links.txt
writing entry points to pyarrow.egg-info/entry_points.txt
writing requirements to pyarrow.egg-info/requires.txt
writing top-level names to pyarrow.egg-info/top_level.txt
listing git files failed - pretending there aren't any
reading manifest file 'pyarrow.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '../LICENSE.txt'
warning: no files found matching '../NOTICE.txt'
warning: no previously-included files matching '*.so' found anywhere in distribution
warning: no previously-included files matching '*.pyc' found anywhere in distribution
warning: no previously-included files matching '*~' found anywhere in distribution
warning: no previously-included files matching '#*' found anywhere in distribution
warning: no previously-included files matching '.git*' found anywhere in distribution
warning: no previously-included files matching '.DS_Store' found anywhere in distribution
no previously-included directories found matching '.asv'
writing manifest file 'pyarrow.egg-info/SOURCES.txt'
running build_ext
-- Running cmake for PyArrow
cmake -DCMAKE_INSTALL_PREFIX=/usr/src/pyarrow-11.0.0/build/lib.linux-x86_64-cpython-39/pyarrow -DPYTHON_EXECUTABLE=/usr/bin/python -DPython3_EXECUTABLE=/usr/bin/python -DPYARROW_CXXFLAGS= -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_SUBSTRAIT=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=off -DPYARROW_BUILD_PARQUET_ENCRYPTION=off -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_GCS=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_BOOST=off -DPYARROW_BUNDLE_CYTHON_CPP=off -DPYARROW_BUNDLE_PLASMA_EXECUTABLE=on -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /usr/src/pyarrow-11.0.0
-- System processor: x86_64
-- Arrow build warning level: PRODUCTION
-- Using ld linker
-- Build Type: RELEASE
-- CMAKE_C_FLAGS: -Wall -fno-semantic-interposition -msse4.2 -fdiagnostics-color=always -fno-omit-frame-pointer -Wno-unused-variable -Wno-maybe-uninitialized
-- CMAKE_CXX_FLAGS: -Wno-noexcept-type -Wall -fno-semantic-interposition -msse4.2 -fdiagnostics-color=always -fno-omit-frame-pointer -Wno-unused-variable -Wno-maybe-uninitialized
-- Generator: Unix Makefiles
-- Build output directory: /usr/src/pyarrow-11.0.0/build/temp.linux-x86_64-cpython-39/release
-- Arrow version: 12.0.0
-- Found the Arrow shared library: /usr/local/lib64/libarrow.so.1200.0.0
-- Found the Arrow import library: ARROW_IMPORT_LIB-NOTFOUND
-- Found the Arrow static library: /usr/local/lib64/libarrow.a
-- Configuring done
-- Generating done
-- Build files have been written to: /usr/src/pyarrow-11.0.0/build/temp.linux-x86_64-cpython-39
-- Finished cmake for PyArrow
-- Running cmake --build for PyArrow
cmake --build . --config release --
[ 1%] Compiling Cython CXX source for lib...
[ 1%] Built target lib_pyx
[ 3%] Built target cython_api_headers
[ 5%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/arrow_to_pandas.cc.o
In file included from /usr/local/include/arrow/scalar.h:41:0,
from /usr/local/include/arrow/datum.h:29,
from /usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:36:
/usr/local/include/arrow/visit_type_inline.h: In instantiation of ‘arrow::Status arrow::VisitTypeInline(const arrow::DataType&, VISITOR*, ARGS&& ...) [with VISITOR = arrow::py::{anonymous}::ObjectWriterVisitor; ARGS = {}]’:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1252:51: required from here
/usr/local/include/arrow/visit_type_inline.h:55:5: error: no matching function for call to ‘arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::RunEndEncodedType&)’
ARROW_GENERATE_FOR_ALL_TYPES(TYPE_VISIT_INLINE);
^
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:990:10: note: candidate: arrow::Status arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::NullType&)
Status Visit(const NullType& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:990:10: note: no known conversion for argument 1 from ‘const arrow::RunEndEncodedType’ to ‘const arrow::NullType&’
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1004:10: note: candidate: arrow::Status arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::BooleanType&)
Status Visit(const BooleanType& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1004:10: note: no known conversion for argument 1 from ‘const arrow::RunEndEncodedType’ to ‘const arrow::BooleanType&’
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1027:35: note: candidate: template<class Type> arrow::enable_if_integer<Type, arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
enable_if_integer<Type, Status> Visit(const Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1027:35: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1041:3: note: candidate: template<class Type> arrow::enable_if_t<(std::is_base_of<arrow::BaseBinaryType, T>::value || std::is_base_of<arrow::FixedSizeBinaryType, T>::value), arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
Visit(const Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1041:3: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1054:32: note: candidate: template<class Type> arrow::enable_if_date<Type, arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
enable_if_date<Type, Status> Visit(const Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1054:32: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1064:32: note: candidate: template<class Type> arrow::enable_if_time<Type, arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
enable_if_time<Type, Status> Visit(const Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1064:32: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1075:37: note: candidate: template<class Type> arrow::enable_if_timestamp<Type, arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
enable_if_timestamp<Type, Status> Visit(const Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1075:37: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1126:76: note: candidate: template<class Type> arrow::enable_if_t<std::is_same<Type, arrow::MonthDayNanoIntervalType>::value, arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
enable_if_t<std::is_same<Type, MonthDayNanoIntervalType>::value, Status> Visit(
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1126:76: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1161:10: note: candidate: arrow::Status arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::Decimal128Type&)
Status Visit(const Decimal128Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1161:10: note: no known conversion for argument 1 from ‘const arrow::RunEndEncodedType’ to ‘const arrow::Decimal128Type&’
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1186:10: note: candidate: arrow::Status arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::Decimal256Type&)
Status Visit(const Decimal256Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1186:10: note: no known conversion for argument 1 from ‘const arrow::RunEndEncodedType’ to ‘const arrow::Decimal256Type&’
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1214:3: note: candidate: template<class T> arrow::enable_if_t<(std::is_same<arrow::FixedSizeListType, T>::value || std::integral_constant<bool, (std::is_base_of<arrow::LargeListType, T>::value || std::is_base_of<arrow::ListType, T>::value)>::value), arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const T&)
Visit(const T& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1214:3: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1224:10: note: candidate: arrow::Status arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::MapType&)
Status Visit(const MapType& type) { return ConvertMap(options, data, out_values); }
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1224:10: note: no known conversion for argument 1 from ‘const arrow::RunEndEncodedType’ to ‘const arrow::MapType&’
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1226:10: note: candidate: arrow::Status arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const arrow::StructType&)
Status Visit(const StructType& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1226:10: note: no known conversion for argument 1 from ‘const arrow::RunEndEncodedType’ to ‘const arrow::StructType&’
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1239:3: note: candidate: template<class Type> arrow::enable_if_t<(((((std::is_base_of<arrow::FloatingPointType, T>::value || std::is_same<arrow::DictionaryType, Type>::value) || std::is_same<arrow::DurationType, Type>::value) || std::is_same<arrow::ExtensionType, Type>::value) || (std::is_base_of<arrow::IntervalType, T>::value && (! std::is_same<arrow::MonthDayNanoIntervalType, Type>::value))) || std::is_base_of<arrow::UnionType, T>::value), arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&)
Visit(const Type& type) {
^~~~~
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1239:3: note: template argument deduction/substitution failed:
/usr/src/pyarrow-11.0.0/pyarrow/src/arrow/python/arrow_to_pandas.cc:1239:3: warning: ‘arrow::enable_if_t<(((((std::is_base_of<arrow::FloatingPointType, T>::value || std::is_same<arrow::DictionaryType, Type>::value) || std::is_same<arrow::DurationType, Type>::value) || std::is_same<arrow::ExtensionType, Type>::value) || (std::is_base_of<arrow::IntervalType, T>::value && (! std::is_same<arrow::MonthDayNanoIntervalType, Type>::value))) || std::is_base_of<arrow::UnionType, T>::value), arrow::Status> arrow::py::{anonymous}::ObjectWriterVisitor::Visit(const Type&) [with Type = arrow::ExtensionType]’ used but never defined
gmake[2]: *** [CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/arrow_to_pandas.cc.o] Error 1
gmake[1]: *** [CMakeFiles/arrow_python.dir/all] Error 2
gmake: *** [all] Error 2
error: command '/usr/bin/cmake' failed with exit code 2
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org