[jira] [Created] (ARROW-14520) Non-deterministic Segfault with Pyarrow

["Karthik Velayutham (Jira)" <ji...@apache.org>]

Karthik Velayutham created ARROW-14520:
------------------------------------------

             Summary: Non-deterministic Segfault with Pyarrow
                 Key: ARROW-14520
                 URL: https://issues.apache.org/jira/browse/ARROW-14520
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
         Environment: Ubuntu 18.04.5 LTS
            Reporter: Karthik Velayutham


Hi all,

I've been getting this non-deterministic seg fault when writing out parquet files via Dask. I was wondering if anyone could help me figure out what the stack trace means and I can probably triage the issue from there.
{code:java}
// code placeholder
epee:23196] *** Process received signal ***
[epee:23196] Signal: Segmentation fault (11)
[epee:23196] Signal code:  (128)
[epee:23196] Failing at address: (nil)
[epee:23196] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980)[0x7f595b277980]
[epee:23196] [ 1] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute8internal12DoStaticCastIhlEEvPKvlllPv+0x98)[0x7f594720c278]
[epee:23196] [ 2] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute8internal14CastNumberImplINS_9Int64TypeEEEvNS_4Type4typeERKNS_5DatumEPS6_+0xe72)[0x7f5947217592]
[epee:23196] [ 3] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute8internal20CastIntegerToIntegerEPNS0_13KernelContextERKNS0_9ExecBatchEPNS_5DatumE+0x74)[0x7f5947231254]
[epee:23196] [ 4] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(+0x52e87d)[0x7f594710d87d]
[epee:23196] [ 5] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZNK5arrow7compute8Function7ExecuteERKSt6vectorINS_5DatumESaIS3_EEPKNS0_15FunctionOptionsEPNS0_11ExecContextE+0xd9b)[0x7f594711455b]
[epee:23196] [ 6] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(+0x51efbd)[0x7f59470fdfbd]
[epee:23196] [ 7] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZNK5arrow7compute12MetaFunction7ExecuteERKSt6vectorINS_5DatumESaIS3_EEPKNS0_15FunctionOptionsEPNS0_11ExecContextE+0x7c)[0x7f594710f21c]
[epee:23196] [ 8] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute12CallFunctionERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKSt6vectorINS_5DatumESaISA_EEPKNS0_15FunctionOptionsEPNS0_11ExecContextE+0x94)[0x7f5947108df4]
[epee:23196] [ 9] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute4CastERKNS_5DatumERKNS0_11CastOptionsEPNS0_11ExecContextE+0xc8)[0x7f59470ff038]
[epee:23196] [10] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute4CastERKNS_5DatumESt10shared_ptrINS_8DataTypeEERKNS0_11CastOptionsEPNS0_11ExecContextE+0xed)[0x7f59471013ed]
[epee:23196] [11] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow.so.400(_ZN5arrow7compute4CastERKNS_5ArrayESt10shared_ptrINS_8DataTypeEERKNS0_11CastOptionsEPNS0_11ExecContextE+0x87)[0x7f5947101957]
[epee:23196] [12] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow_python.so.400(+0xbf123)[0x7f5946b4e123]
[epee:23196] [13] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow_python.so.400(+0xc5df6)[0x7f5946b54df6]
[epee:23196] [14] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow_python.so.400(+0xcc828)[0x7f5946b5b828]
[epee:23196] [15] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow_python.so.400(_ZN5arrow2py14NumPyConverter7ConvertEv+0x4d)[0x7f5946b5b97d]
[epee:23196] [16] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/../../../libarrow_python.so.400(_ZN5arrow2py14NdarrayToArrowEPNS_10MemoryPoolEP7_objectS4_bRKSt10shared_ptrINS_8DataTypeEERKNS_7compute11CastOptionsEPS5_INS_12ChunkedArrayEE+0x2b0)[0x7f5946b5bf60]
[epee:23196] [17] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/lib.cpython-38-x86_64-linux-gnu.so(+0x1b5493)[0x7f5947bfa493]
[epee:23196] [18] /home/vkarthik/anaconda3/envs/katana-dev/lib/python3.8/site-packages/pyarrow/lib.cpython-38-x86_64-linux-gnu.so(+0x1b85ff)[0x7f5947bfd5ff]
[epee:23196] [19] python3(PyCFunction_Call+0x54)[0x5652b403fc64]
[epee:23196] [20] python3(_PyObject_MakeTpCall+0x31e)[0x5652b404f0fe]
[epee:23196] [21] python3(_PyEval_EvalFrameDefault+0x5685)[0x5652b40e5a95]
[epee:23196] [22] python3(_PyEval_EvalCodeWithName+0x2c3)[0x5652b40c2fa3]
[epee:23196] [23] python3(_PyFunction_Vectorcall+0x378)[0x5652b40c4388]
[epee:23196] [24] python3(_PyEval_EvalFrameDefault+0x947)[0x5652b40e0d57]
[epee:23196] [25] python3(_PyEval_EvalCodeWithName+0x2c3)[0x5652b40c2fa3]
[epee:23196] [26] python3(_PyFunction_Vectorcall+0x378)[0x5652b40c4388]
[epee:23196] [27] python3(_PyEval_EvalFrameDefault+0x947)[0x5652b40e0d57]
[epee:23196] [28] python3(_PyEval_EvalCodeWithName+0x2c3)[0x5652b40c2fa3]
[epee:23196] [29] python3(_PyFunction_FastCallDict+0x1b2)[0x5652b3fe018a]
[epee:23196] *** End of error message ***
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)