You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Neal Richardson (Jira)" <ji...@apache.org> on 2019/09/26 23:56:00 UTC

[jira] [Updated] (ARROW-6682) [C#] Arrow R/C++ hangs reading binary file generated by C#

     [ https://issues.apache.org/jira/browse/ARROW-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Neal Richardson updated ARROW-6682:
-----------------------------------
    Component/s:     (was: R)
                     (was: C++)
                 C#

> [C#] Arrow R/C++ hangs reading binary file generated by C#
> ----------------------------------------------------------
>
>                 Key: ARROW-6682
>                 URL: https://issues.apache.org/jira/browse/ARROW-6682
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C#
>    Affects Versions: 0.14.1
>            Reporter: Anthony Abate
>            Assignee: Eric Erhardt
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: Generated_4000Batch_50Columns_100Rows_PerBatch.rar, Generated_4000Batch_50Columns_100Rows_PerBatch.zip, arrow.benchmark.r, script.runner.ps1
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> I get random hangs on arrow_read in R (windows) when using a very large file (10-12gb). (the file has 37 columns)
> I have memory dumps - All threads seem to be in wait handles.
> Are there debug symbols somewhere? 
> Is there a way to get the C++ code to produce diagnostic logging from R? 
>  
> *UPDATE:* it seems that the hangs are not related to file size, row counts, or # of record batches, but rather the number of *columns*



--
This message was sent by Atlassian Jira
(v8.3.4#803005)