You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "summermousa-vendia (via GitHub)" <gi...@apache.org> on 2025/01/24 20:33:19 UTC
[I] KeyError raised when calling inspect.entries() [iceberg-python]
summermousa-vendia opened a new issue, #1574:
URL: https://github.com/apache/iceberg-python/issues/1574
### Apache Iceberg version
0.8.1 (latest release)
### Please describe the bug 🐞
# Description
When connecting to an iceberg glue catalog, I am unable to retrieve the list of entries for a given snapshot including the latest snapshot. This looks like it might be similar to this issue: https://github.com/apache/iceberg-python/issues/1353
# Reproduction Steps
1. Set up an iceberg glue catalog within AWS
2. Use awscli to set up aws account credentials
3. Define the glue catalog type in the .pyiceberg configuration:
```yaml
catalog:
default:
type: glue
```
4. In the interactive python console run the following commands:
```python
from pyiceberg.catalog import load_catalog
catalog = load_catalog()
NAMESPACE = "my_namespace"
TABLE = "my_table"
table = catalog.load_table(NAMESPACE + '.' + TABLE)
table.inspect.entries()
```
# Expected Results
Should return information about the data files and their file status, e.g. https://py.iceberg.apache.org/api/#entries
# Actual Results
```
Traceback (most recent call last):
File "<python-input-15>", line 1, in <module>
table.inspect.entries()
~~~~~~~~~~~~~~~~~~~~~^^
File "python3.13/site-packages/pyiceberg/table/inspect.py", line 210, in entries
return pa.Table.from_pylist(
~~~~~~~~~~~~~~~~~~~~^
entries,
^^^^^^^^
schema=entries_schema,
^^^^^^^^^^^^^^^^^^^^^^
)
^
File "pyarrow/table.pxi", line 2032, in pyarrow.lib._Tabular.from_pylist
File "pyarrow/table.pxi", line 6345, in pyarrow.lib._from_pylist
File "pyarrow/table.pxi", line 4851, in pyarrow.lib.Table.from_arrays
File "pyarrow/table.pxi", line 1608, in pyarrow.lib._sanitize_arrays
File "pyarrow/array.pxi", line 400, in pyarrow.lib.asarray
File "pyarrow/array.pxi", line 370, in pyarrow.lib.array
File "pyarrow/array.pxi", line 42, in pyarrow.lib._sequence_to_array
File "pyarrow/error.pxi", line 155, in pyarrow.lib.pyarrow_internal_check_status
File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
File "python3.13/site-packages/pyiceberg/utils/lazydict.py", line 58, in __getitem__
return source[key]
~~~~~~^^^^^
KeyError: 0
```
### Willingness to contribute
- [x] I can contribute a fix for this bug independently
- [x] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
- [ ] I cannot contribute a fix for this bug at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] KeyError raised when calling inspect.entries() [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu closed issue #1574: KeyError raised when calling inspect.entries()
URL: https://github.com/apache/iceberg-python/issues/1574
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] KeyError raised when calling inspect.entries() [iceberg-python]
Posted by "summermousa-vendia (via GitHub)" <gi...@apache.org>.
summermousa-vendia commented on issue #1574:
URL: https://github.com/apache/iceberg-python/issues/1574#issuecomment-2613349005
Based on the iceberg spec, the field attribute that is raising an error is listed as optional: https://iceberg.apache.org/spec/#manifests:~:text=in%20the%20column-,optional,from%20column%20id%20to%20number%20of%20NaN%20values%20in%20the%20column,-optional
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] KeyError raised when calling inspect.entries() [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu closed issue #1574: KeyError raised when calling inspect.entries()
URL: https://github.com/apache/iceberg-python/issues/1574
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org