You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/07/04 02:30:00 UTC

[jira] [Commented] (SPARK-35964) spark 3.1.1 version the method schema of class DataframeReader will lose the original type information of char/varchar

    [ https://issues.apache.org/jira/browse/SPARK-35964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17374154#comment-17374154 ] 

Hyukjin Kwon commented on SPARK-35964:
--------------------------------------

[~biaobiao.sun] the images look broken. Can you show some codes instead?

> spark 3.1.1  version the  method  schema  of class  DataframeReader will lose the original type information of char/varchar
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-35964
>                 URL: https://issues.apache.org/jira/browse/SPARK-35964
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.1, 3.1.2
>            Reporter: Sun BiaoBiao
>            Priority: Major
>
> in  spark 3.1.1 version,  the method schema of class DataframeReader will lose the original type information of char/varchar
>  
> !image-2021-07-01-14-54-49-922.png!
>  
>  
> !image-2021-07-01-14-55-03-117.png!
>  
>  
> It is expected that it can be placed in the metadata of the field, and the original type information can be obtained in subsequent processing
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org