[jira] [Resolved] (SPARK-8821) The ec2 script doesn't run on python 3 with an utf8 env

["Shivaram Venkataraman (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shivaram Venkataraman resolved SPARK-8821.
------------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.0
                   1.4.2

Issue resolved by pull request 7215
[https://github.com/apache/spark/pull/7215]

> The ec2 script doesn't run on python 3 with an utf8 env
> -------------------------------------------------------
>
>                 Key: SPARK-8821
>                 URL: https://issues.apache.org/jira/browse/SPARK-8821
>             Project: Spark
>          Issue Type: Bug
>          Components: EC2
>    Affects Versions: 1.4.0
>         Environment: Archlinux, UTF8 LANG env
>            Reporter: Simon Hafner
>             Fix For: 1.4.2, 1.5.0
>
>
> Otherwise the script will crash with
>  - Downloading boto...
> Traceback (most recent call last):
>   File "ec2/spark_ec2.py", line 148, in <module>
>     setup_external_libs(external_libs)
>   File "ec2/spark_ec2.py", line 128, in setup_external_libs
>     if hashlib.md5(tar.read()).hexdigest() != lib["md5"]:
>   File "/usr/lib/python3.4/codecs.py", line 319, in decode
>     (result, consumed) = self._buffer_decode(data, self.errors, final)
> UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte
> In case of an utf8 env setting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org