You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tim Armstrong (Jira)" <ji...@apache.org> on 2021/07/20 19:24:00 UTC
[jira] [Created] (SPARK-36229) conv() inconsistently handles
invalid strings with > 64 invalid characters
Tim Armstrong created SPARK-36229:
-------------------------------------
Summary: conv() inconsistently handles invalid strings with > 64 invalid characters
Key: SPARK-36229
URL: https://issues.apache.org/jira/browse/SPARK-36229
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.1.2
Environment: SPARK-33428 fixed ArrayIndexOutofBoundsException but introduced a new inconsistency in behaviour where the returned value is different above the 64 char threshold.
{noformat}
scala> spark.sql("select conv(repeat('?', 64), 10, 16)").show
+---------------------------+
|conv(repeat(?, 64), 10, 16)|
+---------------------------+
| 0|
+---------------------------+
scala> spark.sql("select conv(repeat('?', 65), 10, 16)").show
+---------------------------+
|conv(repeat(?, 65), 10, 16)|
+---------------------------+
| FFFFFFFFFFFFFFFF|
+---------------------------+
scala> spark.sql("select conv(repeat('?', 65), 10, -16)").show
+----------------------------+
|conv(repeat(?, 65), 10, -16)|
+----------------------------+
| -1|
+----------------------------+
scala> spark.sql("select conv(repeat('?', 64), 10, -16)").show
+----------------------------+
|conv(repeat(?, 64), 10, -16)|
+----------------------------+
| 0|
+----------------------------+{noformat}
Reporter: Tim Armstrong
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org