You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Carl Vander (Jira)" <ji...@apache.org> on 2020/03/02 16:29:00 UTC

[jira] [Created] (AVRO-2768) Python Avro cannot be imported when packaged as a zip-file

Carl Vander created AVRO-2768:
---------------------------------

             Summary: Python Avro cannot be imported when packaged as a zip-file
                 Key: AVRO-2768
                 URL: https://issues.apache.org/jira/browse/AVRO-2768
             Project: Apache Avro
          Issue Type: Bug
          Components: python
    Affects Versions: 1.9.2
            Reporter: Carl Vander


Hi,

When running a Spark job I am packaging all Python dependencies in a zip-file which is distributed to the nodes. I am using AWS Glue to execute the Spark job.

One of the dependencies included is the python package avro-python3. However, this cannot be used since VERSION.txt cannot be opened when the package is included as a zip. It errors out in __init__.py when trying to open the file. The file VERSION.txt is present, however the path given to open() looks something like "/home/user/custom-site-package.zip/avro/VERSION.txt".

On a side note, the package has zip_safe set to true, so I expect this to work :)

I have opened a PR on Github with a possible solution.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)