You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2017/03/30 09:36:41 UTC
[jira] [Commented] (SPARK-20156) Local dependent library used for
upper and lowercase conversions.
[ https://issues.apache.org/jira/browse/SPARK-20156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948753#comment-15948753 ]
Sean Owen commented on SPARK-20156:
-----------------------------------
Yeah, the problem is that people call {{toLowerCase}} or {{toUpperCase}} without a {{Locale.ENGLISH}} argument and it makes things locale-dependent that definitely should not be. Really, every single instance of these calls should have such an argument.
> Local dependent library used for upper and lowercase conversions.
> -----------------------------------------------------------------
>
> Key: SPARK-20156
> URL: https://issues.apache.org/jira/browse/SPARK-20156
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell
> Affects Versions: 2.1.0
> Environment: Ubunutu 16.04
> Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_121)
> Reporter: Serkan Taş
> Attachments: sprk_shell.txt
>
>
> If the regional setting of the operation system is Turkish, the famous java locale problem occurs (https://jira.atlassian.com/browse/CONF-5931 or https://issues.apache.org/jira/browse/AVRO-1493).
> e.g :
> "SERDEINFO" lowers to "serdeınfo"
> "uniquetable" uppers to "UNİQUETABLE"
> work around :
> add -Duser.country=US -Duser.language=en to the end of the line
> SPARK_SUBMIT_OPTS="$SPARK_SUBMIT_OPTS -Dscala.usejavacp=true"
> in spark-shell.sh
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org