You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Vladislav (Jira)" <ji...@apache.org> on 2021/10/03 18:26:00 UTC
[jira] [Updated] (SPARK-36802) Incorrect writing the string,
containing symbols like "\" to Hive
[ https://issues.apache.org/jira/browse/SPARK-36802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vladislav updated SPARK-36802:
------------------------------
Priority: Major (was: Minor)
> Incorrect writing the string, containing symbols like "\" to Hive
> ------------------------------------------------------------------
>
> Key: SPARK-36802
> URL: https://issues.apache.org/jira/browse/SPARK-36802
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.0
> Reporter: Vladislav
> Priority: Major
>
> After writing the strings, containing symbol like "\" to Hive, the result record in HiveTable doesn't contain that symbol. It happens when using the standart method of pyspark.sql.readwriter.DataFrameWriter saveAsTable as well as insertInto.
> For example, running the query
> spark.sql("select '\d\{4}' as code").write.saveAsTable('db.table')
> I've got the next result in Hive:
> spark.table('db.table').collect()[0][0]
> >>"d\{4}"
> But expected the next
> >> "\d\{4}"
> Spark version : '2.3.0.2.6.5.0-292'
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org