You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "David Alphus (Jira)" <ji...@apache.org> on 2019/08/20 15:23:00 UTC
[jira] [Commented] (ARROW-6301) atexit: pyarrow.lib.ArrowKeyError:
'No type extension with name arrow.py_extension_type found'
[ https://issues.apache.org/jira/browse/ARROW-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911454#comment-16911454 ]
David Alphus commented on ARROW-6301:
-------------------------------------
When recompiling I got a segfault during atexit. Not totally sure if this is a separate issue.
{code:java}
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00007fc08437576d in accept () at ../sysdeps/unix/syscall-template.S:84
84 ../sysdeps/unix/syscall-template.S: No such file or directory.
[Current thread is 1 (Thread 0x7fc07e2f6700 (LWP 28153))]
(gdb) thread apply all btThread 6 (Thread 0x7fc06249a700 (LWP 28169)):
#0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59
#2 0x00007fc08436c6ba in start_thread (arg=0x7fc06249a700) at pthread_create.c:333
#3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 5 (Thread 0x7fc061498700 (LWP 28171)):
#0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59
#2 0x00007fc08436c6ba in start_thread (arg=0x7fc061498700) at pthread_create.c:333
#3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 4 (Thread 0x7fc060c97700 (LWP 28172)):
#0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59
#2 0x00007fc08436c6ba in start_thread (arg=0x7fc060c97700) at pthread_create.c:333
#3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 3 (Thread 0x7fc08477a700 (LWP 28151)):
#0 _dl_fini () at dl-fini.c:180
#1 0x00007fc08326dff8 in __run_exit_handlers (status=1, listp=0x7fc0835f85f8 <__exit_funcs>,
run_list_atexit=run_list_atexit@entry=true) at exit.c:82
#2 0x00007fc08326e045 in __GI_exit (status=<optimized out>) at exit.c:104
#3 0x000000000041b72f in uwsgi_exit ()
#4 0x0000000000469a81 in uwsgi_segfault ()
#5 <signal handler called>
#6 0x00007fc0646a47aa in std::_Hashtable<std::string, std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> >, std::allocator<std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> > >, std::__detail::_Select1st, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >::_M_find_before_node(unsigned long, std::string const&, unsigned long) const () from /home/alpha/.virtualenvs/uwsgi/lib/libarrow.so.14
#7 0x00007fc0646a4864 in std::_Hashtable<std::string, std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> >, std::allocator<std::pair<std::string const, std::shared_ptr<arrow::ExtensionType> > >, std::__detail::_Select1st, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >::find(std::string const&) ()
from /home/alpha/.virtualenvs/uwsgi/lib/libarrow.so.14
#8 0x00007fc0646a2624 in arrow::UnregisterExtensionType(std::string const&) ()
from /home/alpha/.virtualenvs/uwsgi/lib/libarrow.so.14
#9 0x00007fc0641976fd in arrow::py::UnregisterPyExtensionType() ()
from /home/alpha/.virtualenvs/uwsgi/lib/libarrow_python.so.14
#10 0x00007fc064db8486 in __pyx_pw_7pyarrow_3lib_91_unregister_py_extension_type(_object*, _object*) ()
from /home/alpha/.virtualenvs/uwsgi/lib/python2.7/site-packages/pyarrow/lib.so
#11 0x00007fc08394630f in PyEval_EvalFrameEx () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0
#12 0x00007fc083948fe8 in PyEval_EvalCodeEx () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0
#13 0x00007fc0838bd3e9 in ?? () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0
#14 0x00007fc08388c773 in PyObject_Call () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0
#15 0x00007fc08393ee57 in PyEval_CallObjectWithKeywords () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0
#16 0x00007fc08396d764 in Py_Finalize () from /home/alpha/.virtualenvs/uwsgi/lib/libpython2.7.so.1.0
#17 0x000000000046549d in uwsgi_plugins_atexit ()
#18 0x00007fc08326dff8 in __run_exit_handlers (status=30, listp=0x7fc0835f85f8 <__exit_funcs>,
run_list_atexit=run_list_atexit@entry=true) at exit.c:82
#19 0x00007fc08326e045 in __GI_exit (status=<optimized out>) at exit.c:104
#20 0x000000000041b72f in uwsgi_exit ()
#21 0x00000000004655d5 in end_me ()
#22 <signal handler called>
#23 0x00007fc08333ba13 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#24 0x0000000000458ea2 in event_queue_wait ()
#25 0x000000000041d241 in wsgi_req_accept ()
#26 0x0000000000461c67 in simple_loop_run ()
#27 0x000000000046a3f4 in uwsgi_ignition ()
#28 0x000000000046a7a0 in uwsgi_worker_run ()
#29 0x000000000046ace5 in uwsgi_run ()
#30 0x00007fc083254830 in __libc_start_main (main=0x46acf0 <main>, argc=6, argv=0x7ffdd9a19348, init=<optimized out>,
fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffdd9a19338) at ../csu/libc-start.c:291
#31 0x000000000041a3d9 in _start ()
---Type <return> to continue, or q <return> to quit---Thread 2 (Thread 0x7fc061c99700 (LWP 28170)):
#0 pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1 0x00007fc0625134d8 in th_worker (tidptr=<optimized out>) at numexpr/module.cpp:59
#2 0x00007fc08436c6ba in start_thread (arg=0x7fc061c99700) at pthread_create.c:333
#3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109Thread 1 (Thread 0x7fc07e2f6700 (LWP 28153)):
#0 0x00007fc08437576d in accept () at ../sysdeps/unix/syscall-template.S:84
#1 0x0000000000481207 in uwsgi_python_tracebacker_thread ()
#2 0x00007fc08436c6ba in start_thread (arg=0x7fc07e2f6700) at pthread_create.c:333
#3 0x00007fc08333b41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
{code}
> atexit: pyarrow.lib.ArrowKeyError: 'No type extension with name arrow.py_extension_type found'
> ----------------------------------------------------------------------------------------------
>
> Key: ARROW-6301
> URL: https://issues.apache.org/jira/browse/ARROW-6301
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 0.14.1
> Environment: linux, virtualenv, uwsgi, cpython 2.7
> Reporter: David Alphus
> Priority: Minor
>
> On interrupt, I am frequently seeing the atexit function failing in pyarrow 0.14.1.
> {code:java}
> ^CSIGINT/SIGQUIT received...killing workers...
> killing the spooler with pid 22640
> Error in atexit._run_exitfuncs:
> Traceback (most recent call last):
> File "/home/alpha/.virtualenvs/wsgi/lib/python2.7/atexit.py", line 24, in _run_exitfuncs
> func(*targs, **kargs)
> File "pyarrow/types.pxi", line 1860, in pyarrow.lib._unregister_py_extension_type
> check_status(UnregisterPyExtensionType())
> File "pyarrow/error.pxi", line 91, in pyarrow.lib.check_status
> raise ArrowKeyError(message)
> ArrowKeyError: 'No type extension with name arrow.py_extension_type found'
> Error in sys.exitfunc:
> Traceback (most recent call last):
> File "/home/alpha/.virtualenvs/wsgi/lib/python2.7/atexit.py", line 24, in _run_exitfuncs
> func(*targs, **kargs)
> File "pyarrow/types.pxi", line 1860, in pyarrow.lib._unregister_py_extension_type
> File "pyarrow/error.pxi", line 91, in pyarrow.lib.check_status
> pyarrow.lib.ArrowKeyError: 'No type extension with name arrow.py_extension_type found'
> spooler (pid: 22640) annihilated
> worker 1 buried after 1 seconds
> goodbye to uWSGI.{code}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)