You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/03/22 17:14:00 UTC
[jira] [Assigned] (ARROW-12031) [C++][CSV] infer CSV timestamps
columns with fractional seconds
[ https://issues.apache.org/jira/browse/ARROW-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Antoine Pitrou reassigned ARROW-12031:
--------------------------------------
Assignee: Martin Nowak
> [C++][CSV] infer CSV timestamps columns with fractional seconds
> ---------------------------------------------------------------
>
> Key: ARROW-12031
> URL: https://issues.apache.org/jira/browse/ARROW-12031
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Affects Versions: 3.0.0
> Reporter: Martin Nowak
> Assignee: Martin Nowak
> Priority: Trivial
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> After implementing fractional second parsing in and ARROW-9107 and ARROW-10337, no support for inference of subsecond timestamps was added (see [code]([https://github.com/apache/arrow/blob/master/cpp/src/arrow/csv/inference_internal.h#L115), also mentioned in ARROW-3738).
> The [InferState logic | https://github.com/apache/arrow/blob/81d6724546559fa8d6e85376a1cc339dab0506ad/cpp/src/arrow/csv/inference_internal.h#L63] could test for TimestampNS (with nanosecond resolution) after Timestamps with second resolution to not change existing inference results.
> Wouldn't expect too much interest in trying to infer timestamps with milli- and microsecond resolution. The nanosecond resolution [can already parse |https://github.com/apache/arrow/blob/81d6724546559fa8d6e85376a1cc339dab0506ad/cpp/src/arrow/util/value_parsing.h#L512-L518] the lower resolution ones.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)