You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "ChristosMichaliaslis (via GitHub)" <gi...@apache.org> on 2023/12/12 16:09:34 UTC
[I] [R] error with dplyr queries with big data in other environment [arrow]
ChristosMichaliaslis opened a new issue, #39203:
URL: https://github.com/apache/arrow/issues/39203
### Describe the bug, including details regarding any error messages, version, and platform.
Hello. I have a problem while making simple dplyr queries with parquet datasets using arrow to connect, but not import, them with the memory because it's too big. I don't have a problem with the select function but I do when i use one of the functions: filter, group by or mutate and others. I am coding on another environment through my laptop and I don't know if this produces the problem.
The error that I get is the following and the second picture is the backtrace R gives me if I use the last_trace to see further what the issue is.
I would really appreciate some help because I am stuck here.
### Component(s)
R
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] error with dplyr queries with big data in other environment [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #39203:
URL: https://github.com/apache/arrow/issues/39203#issuecomment-1854124898
Thanks for reporting this @ChristosMichaliaslis! Are you able to share a reproducible example, or if not, show us the code you used which generated the error?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] error with dplyr queries with big data in other environment [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic closed issue #39203: [R] error with dplyr queries with big data in other environment
URL: https://github.com/apache/arrow/issues/39203
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] error with dplyr queries with big data in other environment [arrow]
Posted by "ChristosMichaliaslis (via GitHub)" <gi...@apache.org>.
ChristosMichaliaslis commented on issue #39203:
URL: https://github.com/apache/arrow/issues/39203#issuecomment-1855383306
Another information that might help is that I tried the same code, with other data, inside and outside of the environment that I am working ( to my local pc) and in my local pc it worked but didn't work in the working environment. I hope that this helps somehow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] error with dplyr queries with big data in other environment [arrow]
Posted by "ChristosMichaliaslis (via GitHub)" <gi...@apache.org>.
ChristosMichaliaslis commented on issue #39203:
URL: https://github.com/apache/arrow/issues/39203#issuecomment-1854184380
Unfortunately I can't post the data, so I will post the code with some changes on the names and other information.
At first I had an rds file and converted it to parquet. And then opened a connection with the data to test some simple queries. It is a procedure I want to do with bigger datadsets that's why I convert a small file and test it. If I keep only the select function in the query then it will work. But if I add any other function it will give me the error I posted in the previous comment.
Thanks in advance.
<img width="674" alt="1" src="https://github.com/apache/arrow/assets/151936766/57d0cdf1-5599-467d-8926-3be7f4aec5f0">
<img width="673" alt="2" src="https://github.com/apache/arrow/assets/151936766/d462e18c-9554-4d6f-9a2e-fc5145ce5c9f">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [R] error with dplyr queries with big data in other environment [arrow]
Posted by "thisisnic (via GitHub)" <gi...@apache.org>.
thisisnic commented on issue #39203:
URL: https://github.com/apache/arrow/issues/39203#issuecomment-1861755655
Could you perhaps try it again with a dataset which isn't confidential, so you can show us all of the code and output?
Can you tell us more about the environment you're working in?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org