You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Bill-Johnson-Seequent (via GitHub)" <gi...@apache.org> on 2025/01/24 02:22:25 UTC

[I] ParquetFile.iter_batches errors when row_groups is [] [arrow]

Bill-Johnson-Seequent opened a new issue, #45343:
URL: https://github.com/apache/arrow/issues/45343

   ### Describe the bug, including details regarding any error messages, version, and platform.
   
   As of version 18.0.0, ParquetFile.iter_batches throws an error when the row_groups parameter is an empty list. 
   
   The stack trace is:
   ```
   Traceback (most recent call last):
     File "/pyarrow-issue.py", line 9, in <module>
       for batch in pq_file.iter_batches(row_groups=[]):
     File "pyarrow/_parquet.pyx", line 1634, in iter_batches
     File "pyarrow/error.pxi", line 92, in pyarrow.lib.check_status
   OSError: The file only has 1 row groups, requested metadata for row group: -1
   ```
   
   Have also seen the issue in PyArrow v18.1.0 and v19.0.0, but v17.0.0 does not have the issue. We are on Python version 3.12.3.
   
   Note: The workaround was to wrap the call in a check to see that row_groups was not empty!
   
   [iter_batches.zip](https://github.com/user-attachments/files/18529365/iter_batches.zip)
   
   ### Component(s)
   
   Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] ParquetFile.iter_batches errors when row_groups is [] [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #45343:
URL: https://github.com/apache/arrow/issues/45343#issuecomment-2612286748

   Thanks for opening it @Bill-Johnson-Seequent 
   I am closing this as duplicate to have a single issue to track that.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] ParquetFile.iter_batches errors when row_groups is [] [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd closed issue #45343: ParquetFile.iter_batches errors when row_groups is []
URL: https://github.com/apache/arrow/issues/45343


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] ParquetFile.iter_batches errors when row_groups is [] [arrow]

Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #45343:
URL: https://github.com/apache/arrow/issues/45343#issuecomment-2611429543

   #45339 may be the same problem.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] ParquetFile.iter_batches errors when row_groups is [] [arrow]

Posted by "Bill-Johnson-Seequent (via GitHub)" <gi...@apache.org>.
Bill-Johnson-Seequent commented on issue #45343:
URL: https://github.com/apache/arrow/issues/45343#issuecomment-2611471106

   Agreed - looks like it's likely the same underlying cause. Happy to retest this case when 19.0.1 comes out 😄 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org