You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "YoungGyu Chun (Jira)" <ji...@apache.org> on 2019/11/18 21:57:00 UTC
[jira] [Comment Edited] (SPARK-29946) Special serialization for
certain key types of Map type in JacksonGenerator
[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976921#comment-16976921 ]
YoungGyu Chun edited comment on SPARK-29946 at 11/18/19 9:56 PM:
-----------------------------------------------------------------
Hi [~viirya]
I am trying to sort out this issue. What I found so far is that the mapType is human-readable by calling toString but the UnsafeRow doesn't. I want to make sure what I found is correct:
!image-2019-11-18-16-54-46-341.png!
was (Author: younggyuchun):
Hi [~viirya]
I am trying to sort out this issue. What I found so far is that the mapType is human-readable by calling toString but the UnsafeRow doesn't. I want to make sure what I found is correct:
!image-2019-11-18-16-54-46-341.png!
> Special serialization for certain key types of Map type in JacksonGenerator
> ---------------------------------------------------------------------------
>
> Key: SPARK-29946
> URL: https://issues.apache.org/jira/browse/SPARK-29946
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: L. C. Hsieh
> Priority: Major
> Attachments: image-2019-11-18-16-54-46-341.png
>
>
> Currently JacksonGenerator serializes MapType to JSON, the key of map is serialized by calling toString() of the key. For some types, like UnsafeRow, the toString is not human readable. So currently the map key in JSON is not very useful for some types.
> We should do special serialization for certain key types of Map.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org