[GitHub] [arrow-rs] gruuya opened a new issue, #3751: Support casting string to timestamp with microsecond resolution

["gruuya (via GitHub)" <gi...@apache.org>]

gruuya opened a new issue, #3751:
URL: https://github.com/apache/arrow-rs/issues/3751

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   I'm trying to migrate [Seafowl](https://github.com/splitgraph/seafowl)'s storage backend to use [delta-rs](https://github.com/delta-io/delta-rs), and one issue that has come up is the fact that the DELTA protocol [prescribes](https://github.com/delta-io/delta/blob/master/PROTOCOL.md#primitive-types) that timestamp resolution should be in microseconds. On the other hand, the current casting logic only supports nanoseconds resolution.
   
   **Describe the solution you'd like**
   Ideally, we'd be able to cast a `Utf8`/`LargeUtf8` type to `Timestamp(TimeUnit::Microsecond, _)`, like we already do for `Timestamp(TimeUnit::Nanosecond, _)` (even with potential precision loss).
   
   The microsecond resolution of the fractional part of the string timestamp is the default offered for most other systems, e.g. [Postgres](https://www.postgresql.org/docs/current/datatype-datetime.html), [MySQL](https://dev.mysql.com/doc/refman/8.0/en/datetime.html), [BigQuery](https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types#timestamp_type), etc.
   
   **Describe alternatives you've considered**
   Perform manual conversion of string to timestamp[us] in some places, possibly prohibiting usage of some high level datafusion/delta-rs interfaces.
   
   Alternatively, enforce users to always call `to_timestamp_micros` datafusion function when specifying timestamp strings.
   
   **Additional context**
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-rs] tustvold closed issue #3751: Support casting string to timestamp with microsecond resolution

["tustvold (via GitHub)" <gi...@apache.org>]

tustvold closed issue #3751: Support casting string to timestamp with microsecond resolution
URL: https://github.com/apache/arrow-rs/issues/3751


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org