You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/07/05 22:45:04 UTC

[GitHub] [arrow-datafusion] velvia commented on issue #686: Specific timezone support for `to_timetamp*()`

velvia commented on issue #686:
URL: https://github.com/apache/arrow-datafusion/issues/686#issuecomment-874356725


   @alamb @westonpace .... your thoughts on this matter would be really welcome. :)   
   
   To be specific, if you do `to_timestamp(date_string)` then it can figure out the timezone from the string, sometimes.  However, current architecture of Arrow/DF requires a specific timezone output type.
   If you did `to_timestamp(int64)` then you would not have any timezone info at all, and would require the input in the second argument no matter what for completeness.
   
   There is also the possibility to simplify things and eliminate the timezone field from Arrow, but that's a really big change.  For example, Parquet does not store the timezone but simply has a isAdjustedToUTC field.  If True, that means timestamps are UTC, and if not that means local timestamp.  
   https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#timestamp
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org