You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/08/02 17:00:10 UTC
[GitHub] [arrow-datafusion] yourenawo opened a new issue, #3013: I want to query some files in a directory. Is there any way?
yourenawo opened a new issue, #3013:
URL: https://github.com/apache/arrow-datafusion/issues/3013
**Describe the bug**
There are 3000 parquet files named according to the timestamp in my directory. Now I just want to query some files, which can greatly reduce the query time.Thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] andygrove commented on issue #3013: I want to query some files in a directory. Is there any way?
Posted by GitBox <gi...@apache.org>.
andygrove commented on issue #3013:
URL: https://github.com/apache/arrow-datafusion/issues/3013#issuecomment-1203384584
Assuming that these files have the same or similar schema, then yes, you can just use the path to the directory rather than the path to an individual file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb commented on issue #3013: I want to query some files in a directory. Is there any way?
Posted by GitBox <gi...@apache.org>.
alamb commented on issue #3013:
URL: https://github.com/apache/arrow-datafusion/issues/3013#issuecomment-1203952775
Something like
```sql
CREATE EXTERNAL TABLE foo STORED AS PARQUET LOCATION '/my/directory';
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] yourenawo closed issue #3013: I want to query some files in a directory. Is there any way?
Posted by GitBox <gi...@apache.org>.
yourenawo closed issue #3013: I want to query some files in a directory. Is there any way?
URL: https://github.com/apache/arrow-datafusion/issues/3013
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] yourenawo commented on issue #3013: I want to query some files in a directory. Is there any way?
Posted by GitBox <gi...@apache.org>.
yourenawo commented on issue #3013:
URL: https://github.com/apache/arrow-datafusion/issues/3013#issuecomment-1204000710
thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org