You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/07/21 16:09:00 UTC

[jira] [Updated] (ARROW-13425) [Dev][Archery] Archery import pandas which imports pyarrow

     [ https://issues.apache.org/jira/browse/ARROW-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Antoine Pitrou updated ARROW-13425:
-----------------------------------
    Description: 
Just got this error when trying to run benchmarks on a PR:
{code}
Traceback (most recent call last):
  File "/home/antoine/miniconda3/envs/pyarrow/bin/archery", line 33, in <module>
    sys.exit(load_entry_point('archery', 'console_scripts', 'archery')())
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 634, in benchmark_diff
    no_counters, ren_counters)
  File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 650, in _format_comparisons_with_pandas
    import pandas as pd
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/__init__.py", line 50, in <module>
    from pandas.core.api import (
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/api.py", line 29, in <module>
    from pandas.core.arrays import Categorical
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/__init__.py", line 20, in <module>
    from pandas.core.arrays.string_arrow import ArrowStringArray
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/string_arrow.py", line 65, in <module>
    import pyarrow.compute as pc
  File "/home/antoine/arrow/dev/python/pyarrow/compute.py", line 18, in <module>
    from pyarrow._compute import (  # noqa
ImportError: cannot import name 'ProjectOptions' from 'pyarrow._compute' (/home/antoine/arrow/dev/python/pyarrow/_compute.cpython-37m-x86_64-linux-gnu.so)
{code}

Since Archery is a tool for developing Arrow, current PyArrow may be broken or incompatible with the currently available Arrow C++.

  was:
Just got this error when trying to run benchmarks on a PR:
{code}
Traceback (most recent call last):
  File "/home/antoine/miniconda3/envs/pyarrow/bin/archery", line 33, in <module>
    sys.exit(load_entry_point('archery', 'console_scripts', 'archery')())
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 634, in benchmark_diff
    no_counters, ren_counters)
  File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 650, in _format_comparisons_with_pandas
    import pandas as pd
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/__init__.py", line 50, in <module>
    from pandas.core.api import (
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/api.py", line 29, in <module>
    from pandas.core.arrays import Categorical
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/__init__.py", line 20, in <module>
    from pandas.core.arrays.string_arrow import ArrowStringArray
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/string_arrow.py", line 65, in <module>
    import pyarrow.compute as pc
  File "/home/antoine/arrow/dev/python/pyarrow/compute.py", line 18, in <module>
    from pyarrow._compute import (  # noqa
ImportError: cannot import name 'ProjectOptions' from 'pyarrow._compute' (/home/antoine/arrow/dev/python/pyarrow/_compute.cpython-37m-x86_64-linux-gnu.so)
{code}

Since Archery is a tool for developing Arrow, current PyArrow may be broken.


> [Dev][Archery] Archery import pandas which imports pyarrow
> ----------------------------------------------------------
>
>                 Key: ARROW-13425
>                 URL: https://issues.apache.org/jira/browse/ARROW-13425
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Archery, Benchmarking, Developer Tools
>            Reporter: Antoine Pitrou
>            Priority: Major
>
> Just got this error when trying to run benchmarks on a PR:
> {code}
> Traceback (most recent call last):
>   File "/home/antoine/miniconda3/envs/pyarrow/bin/archery", line 33, in <module>
>     sys.exit(load_entry_point('archery', 'console_scripts', 'archery')())
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 764, in __call__
>     return self.main(*args, **kwargs)
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 717, in main
>     rv = self.invoke(ctx)
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
>     return _process_result(sub_ctx.command.invoke(sub_ctx))
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
>     return _process_result(sub_ctx.command.invoke(sub_ctx))
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 956, in invoke
>     return ctx.invoke(self.callback, **ctx.params)
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/core.py", line 555, in invoke
>     return callback(*args, **kwargs)
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
>     return f(get_current_context(), *args, **kwargs)
>   File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 634, in benchmark_diff
>     no_counters, ren_counters)
>   File "/home/antoine/arrow/dev/dev/archery/archery/cli.py", line 650, in _format_comparisons_with_pandas
>     import pandas as pd
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/__init__.py", line 50, in <module>
>     from pandas.core.api import (
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/api.py", line 29, in <module>
>     from pandas.core.arrays import Categorical
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/__init__.py", line 20, in <module>
>     from pandas.core.arrays.string_arrow import ArrowStringArray
>   File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/site-packages/pandas/core/arrays/string_arrow.py", line 65, in <module>
>     import pyarrow.compute as pc
>   File "/home/antoine/arrow/dev/python/pyarrow/compute.py", line 18, in <module>
>     from pyarrow._compute import (  # noqa
> ImportError: cannot import name 'ProjectOptions' from 'pyarrow._compute' (/home/antoine/arrow/dev/python/pyarrow/_compute.cpython-37m-x86_64-linux-gnu.so)
> {code}
> Since Archery is a tool for developing Arrow, current PyArrow may be broken or incompatible with the currently available Arrow C++.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)