You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "comphead (via GitHub)" <gi...@apache.org> on 2023/07/11 15:14:45 UTC

[GitHub] [arrow-datafusion] comphead opened a new issue, #6919: Minor: Add aux constructor to PartitionedFile to avoid calculating size

comphead opened a new issue, #6919:
URL: https://github.com/apache/arrow-datafusion/issues/6919

   ### Is your feature request related to a problem or challenge?
   
   There bunch of places where 
   ```
   impl PartitionedFile {
       /// Create a simple file without metadata or partition
       pub fn new(path: String, size: u64) -> Self 
   ```
   
   is used, it requires the exact size of file, otherwise it is a crash like
   ```
   Error: ParquetError(General("AsyncChunkReader::get_bytes error: Generic LocalFileSystem error: Out of range of file /tmp/test/part-00000-dbdc88ee-c30e-4d2c-bef1-ee966702c2ae-c000.snappy.parquet, expected: 8, actual: 0"))
   ```
   
   ### Describe the solution you'd like
   
   Create an aux constructor to avoid file size calculation for the user. 
   
   ### Describe alternatives you've considered
   
   Not doing this
   
   ### Additional context
   
   None


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [arrow-datafusion] alamb closed issue #6919: Minor: Add aux constructor to PartitionedFile to avoid calculating size

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #6919: Minor: Add aux constructor to PartitionedFile to avoid calculating size
URL: https://github.com/apache/arrow-datafusion/issues/6919


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org