You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/09/02 16:05:52 UTC
[GitHub] [arrow] mm0708 opened a new issue #8099: Specifying schema when using write_feather?
mm0708 opened a new issue #8099:
URL: https://github.com/apache/arrow/issues/8099
I have a series of files saved as .rds that I am converting to feather using arrow for R. I am loading these rds files, using write_feather, then loading them using open_dataset so that I can patrician them in a logical way.
Most of the times things have gone rather smoothly but I noted in one batch that I get an error that says: `Type error: fields had matching names but differing types.`
All of the files have the same source and all have the same data types when read into R using readRDS. So I tried to use the schema option in the open_dataset step but I am still getting the same error even though I have explicitly set the schema for all columns.
Is there a way to specify the schema during the write_feather step? I don't see it in the documentation or if there was some other workaround. This seems to be the only time where the types get mismatched for whatever reason.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kdkavanagh commented on issue #8099: Specifying schema when using write_feather?
Posted by GitBox <gi...@apache.org>.
kdkavanagh commented on issue #8099:
URL: https://github.com/apache/arrow/issues/8099#issuecomment-801240233
@mm0708 what did you conclude here? I have this same question/problem
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] mm0708 closed issue #8099: Specifying schema when using write_feather?
Posted by GitBox <gi...@apache.org>.
mm0708 closed issue #8099:
URL: https://github.com/apache/arrow/issues/8099
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] mm0708 commented on issue #8099: Specifying schema when using write_feather?
Posted by GitBox <gi...@apache.org>.
mm0708 commented on issue #8099:
URL: https://github.com/apache/arrow/issues/8099#issuecomment-801249604
I dropped the column causing issues because it wasn't essential
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org