[jira] [Updated] (ARROW-6682) Arrow Hangs on Large # of Columns (30+)

["Anthony Abate (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anthony Abate updated ARROW-6682:
---------------------------------
    Description: 
I get random hangs on arrow_read in R (windows) when using a very large file (10-12gb). 

I have memory dumps - All threads seem to be in wait handles.

Are there debug symbols somewhere? 

Is there a way to get the C++ code to produce diagnostic logging from R? 

 

it seems that the hangs are not related to file size, row counts, or # of record batches, but rather the number of *columns*

  was:
I get random hangs on arrow_read in R (windows) when using a very large file (10-12gb). 

I have memory dumps - All threads seem to be in wait handles.

Are there debug symbols somewhere? 

Is there a way to get the C++ code to produce diagnostic logging from R? 

       Priority: Blocker  (was: Critical)
        Summary: Arrow Hangs on Large # of Columns (30+)  (was: Arrow Hangs on Large Files (10-12gb))

> Arrow Hangs on Large # of Columns (30+)
> ---------------------------------------
>
>                 Key: ARROW-6682
>                 URL: https://issues.apache.org/jira/browse/ARROW-6682
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++, R
>    Affects Versions: 0.14.1
>            Reporter: Anthony Abate
>            Priority: Blocker
>
> I get random hangs on arrow_read in R (windows) when using a very large file (10-12gb). 
> I have memory dumps - All threads seem to be in wait handles.
> Are there debug symbols somewhere? 
> Is there a way to get the C++ code to produce diagnostic logging from R? 
>  
> it seems that the hangs are not related to file size, row counts, or # of record batches, but rather the number of *columns*



--
This message was sent by Atlassian Jira
(v8.3.4#803005)