You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "comphead (via GitHub)" <gi...@apache.org> on 2023/07/11 15:14:45 UTC
[GitHub] [arrow-datafusion] comphead opened a new issue, #6919: Minor: Add aux constructor to PartitionedFile to avoid calculating size
comphead opened a new issue, #6919:
URL: https://github.com/apache/arrow-datafusion/issues/6919
### Is your feature request related to a problem or challenge?
There bunch of places where
```
impl PartitionedFile {
/// Create a simple file without metadata or partition
pub fn new(path: String, size: u64) -> Self
```
is used, it requires the exact size of file, otherwise it is a crash like
```
Error: ParquetError(General("AsyncChunkReader::get_bytes error: Generic LocalFileSystem error: Out of range of file /tmp/test/part-00000-dbdc88ee-c30e-4d2c-bef1-ee966702c2ae-c000.snappy.parquet, expected: 8, actual: 0"))
```
### Describe the solution you'd like
Create an aux constructor to avoid file size calculation for the user.
### Describe alternatives you've considered
Not doing this
### Additional context
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] alamb closed issue #6919: Minor: Add aux constructor to PartitionedFile to avoid calculating size
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #6919: Minor: Add aux constructor to PartitionedFile to avoid calculating size
URL: https://github.com/apache/arrow-datafusion/issues/6919
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org