You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/12/23 18:23:12 UTC

[GitHub] [spark] gatorsmile commented on a change in pull request #23150: [SPARK-26178][SQL] Use java.time API for parsing timestamps and dates from CSV

gatorsmile commented on a change in pull request #23150: [SPARK-26178][SQL] Use java.time API for parsing timestamps and dates from CSV
URL: https://github.com/apache/spark/pull/23150#discussion_r360966895
 
 

 ##########
 File path: docs/sql-migration-guide-upgrade.md
 ##########
 @@ -33,6 +33,8 @@ displayTitle: Spark SQL Upgrading Guide
 
   - Spark applications which are built with Spark version 2.4 and prior, and call methods of `UserDefinedFunction`, need to be re-compiled with Spark 3.0, as they are not binary compatible with Spark 3.0.
 
+  - Since Spark 3.0, CSV datasource uses java.time API for parsing and generating CSV content. New formatting implementation supports date/timestamp patterns conformed to ISO 8601. To switch back to the implementation used in Spark 2.4 and earlier, set `spark.sql.legacy.timeParser.enabled` to `true`.
 
 Review comment:
   We removed this conf in the follow-up PRs? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org