[GitHub] [arrow] paleolimbot commented on issue #37513: [R][C++] DecodeRowGroups segfault calling dplyr::glimpse() or head() on a large dataset

["paleolimbot (via GitHub)" <gi...@apache.org>]

paleolimbot commented on issue #37513:
URL: https://github.com/apache/arrow/issues/37513#issuecomment-1706567978

   Thanks!
   
   For me this fails with:
   
   ```
   > library(arrow)
   Some features are not enabled in this build of Arrow. Run `arrow_info()` for more information.
   
   Attaching package: ‘arrow’
   
   The following object is masked from ‘package:utils’:
   
       timestamp
   
   > for(i in 1:100){
   +   open_dataset("~/Desktop/nyc-taxi/") |>
   +     head()
   + }
   
    *** caught bus error ***
   address 0x910043fda9017bfd, cause 'invalid alignment'
   
    *** caught bus error ***
   address 0x910043fda9017bfd, cause 'invalid alignment'
   
   Traceback:
    1: dataset___Scanner__head(x, floor(class = n))
    2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
    5: pairlist(srcfile = <environment>, class = "srcref")
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
   
   Traceback:
    1: dataset___Scanner__head(x, floor(class = n))
    2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
    5: 
    *** caught bus error ***
   address 0x910043fda9017bfd, cause 'invalid alignment'
   
    *** caught bus error ***
   
    *** caught bus error ***
   address 0x910043fda9017bfd, cause 'invalid alignment'
   
   Traceback:
   
    *** caught bus error ***
   address 0x910043fda9017bfd, cause 'invalid alignment'
   
   Traceback:
    1: dataset___Scanner__head(x, floor(n))
    2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
   
   Traceback:
    1: head(open_dataset("~/Desktop/nyc-taxi/"))
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
   
    *** caught bus error ***
   Selection: address 0x910043fda9017bfd, cause 'invalid alignment'
   Selection:  1: dataset___Scanner__head(x, floor(n))
    2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
    5: dataset___Scanner__head(x, floor(n))
   Traceback:
   head(open_dataset("~/Desktop/nyc-taxi/"))
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
   
   head(open_dataset("~/Desktop/nyc-taxi/"))
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
    1: address 0x910043fda9017bfd, cause 'invalid alignment'
   dataset___Scanner__head(x, floor(n))Selection: 
    2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
    5: head(open_dataset("~/Desktop/nyc-taxi/"))
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
   Selection: 
   Traceback:
    1: dataset___Scanner__head(x, floor(n))
    2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
    5: head(open_dataset("~/Desktop/nyc-taxi/"))
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
   Selection:  2: head.Scanner(Scanner$create(x), n)
    3: head(Scanner$create(x), n)
    4: head.Dataset(open_dataset("~/Desktop/nyc-taxi/"))
    5: head(open_dataset("~/Desktop/nyc-taxi/"))
   
   Possible actions:
   1: abort (with core dump, if enabled)
   2: normal R exit
   3: exit R without saving workspace
   4: exit R saving workspace
   Selection: zsh: trace trap  R
   ```
   
   I think I know what might be happening (PR shortly!)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org