You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Carl Vander (Jira)" <ji...@apache.org> on 2020/03/02 16:29:00 UTC
[jira] [Created] (AVRO-2768) Python Avro cannot be imported when
packaged as a zip-file
Carl Vander created AVRO-2768:
---------------------------------
Summary: Python Avro cannot be imported when packaged as a zip-file
Key: AVRO-2768
URL: https://issues.apache.org/jira/browse/AVRO-2768
Project: Apache Avro
Issue Type: Bug
Components: python
Affects Versions: 1.9.2
Reporter: Carl Vander
Hi,
When running a Spark job I am packaging all Python dependencies in a zip-file which is distributed to the nodes. I am using AWS Glue to execute the Spark job.
One of the dependencies included is the python package avro-python3. However, this cannot be used since VERSION.txt cannot be opened when the package is included as a zip. It errors out in __init__.py when trying to open the file. The file VERSION.txt is present, however the path given to open() looks something like "/home/user/custom-site-package.zip/avro/VERSION.txt".
On a side note, the package has zip_safe set to true, so I expect this to work :)
I have opened a PR on Github with a possible solution.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)