[jira] [Comment Edited] (LIVY-579) Python 2 unicode support does not work if OS encoding is not UTF-8

["Peter Bower (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LIVY-579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501861#comment-17501861 ] 

Peter Bower edited comment on LIVY-579 at 3/6/22, 2:49 AM:
-----------------------------------------------------------

Hi there,

Livy looks really exciting.

However, I am experiencing this issue on a brand new Livy build with Apache Spark 3.2.1 , and Ubuntu 20.04 container.

After forcing Python version to be 3.7 (test cannot pass with 3.8), this issue then means the Livy tests cannot pass with the build instructions, i.e. 'mvn package'.

Have updated the default locale in bash to be UTF-8, and set the python variables accordingly.

There is not 'python2' mapped to 'python' in my environment - only python3 = python3.7

Is there a valid workaround for this issue, given it appears tests cannot pass on a clean build?

That is, other than skipping the tests?

Thanks heaps,

Peter


was (Author: JIRAUSER286195):
Hi there,

Livy looks really exciting.

However, I am experiencing this issue on a brand new Livy build with Apache Spark 3.2.1 , and Ubuntu 20.04 container.

After forcing Python version to be 3.7 (test cannot pass with 3.8), this issue then means the Livy tests cannot pass with the build instructions, i.e. 'mvn package'.

Have updated the default locale in bash to be UTF-8, and set the python variables accordingly.

There is not 'python2' mapped to 'python' in my environment - only python3 = python3.7

Is there a valid workaround for this issue, given it appears tests cannot pass on a clean build?

Thanks heaps,

Peter

> Python 2 unicode support does not work if OS encoding is not UTF-8
> ------------------------------------------------------------------
>
>                 Key: LIVY-579
>                 URL: https://issues.apache.org/jira/browse/LIVY-579
>             Project: Livy
>          Issue Type: Bug
>          Components: Interpreter
>    Affects Versions: 0.6
>            Reporter: Marcelo Masiero Vanzin
>            Priority: Minor
>
> {noformat}
> LC_ALL=en_US.ASCII mvn -Pspark-2.4 -Pthriftserver test -pl :livy-repl_2.11 -Dsuites="*.Python2InterpreterSpec unicode" 
> ...
> [INFO] --- scalatest-maven-plugin:1.0:test (test) @ livy-repl_2.11 ---
> Discovery starting.
> Discovery completed in 627 milliseconds.
> Run starting. Expected test count is: 1
> Python2InterpreterSpec:
> - should print unicode correctly *** FAILED *** (1 second, 127 milliseconds)
>   ExecuteSuccess(JObject(List((text/plain,JString(?))))) did not equal ExecuteSuccess(JObject(List((text/plain,JString(?))))) (PythonInterpreterSpec.scala:266)
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)