[GitHub] [iceberg] RussellSpitzer commented on pull request #2282: [SPARK] Spark parquet read timestamp without timezone

[GitBox <gi...@apache.org>]

RussellSpitzer commented on pull request #2282:
URL: https://github.com/apache/iceberg/pull/2282#issuecomment-857971623


   > Hi, I am working on write support together with @daniil-dubin
   > @bkahloon @RussellSpitzer in current implementation we have `spark-handle-timestamp-without-timezone` flag, which can be used as read or write(after implementation) option, like
   > 
   > ```scala
   > spark
   > .read
   > .format("iceberg")
   > .option("spark-handle-timestamp-without-timezone", "true")
   > .load("some.table.name")
   > ```
   > 
   > but we do not have ability to set this flag when using spark sql
   > 
   > ```scala
   > spark.sql("select * from some.table.name") //<- will fail in current implementation
   > ```
   > 
   > Our proposal is move this flag to spark session property, @bkahloon @RussellSpitzer what do you think about it?
   
   Sounds good to me, I have no problem with this being a session parameter. Let me know when the changes are up


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org