[jira] [Updated] (NIFI-14928) PutBigQuery fails to send data into DATETIME columns

["Pierre Villard (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pierre Villard updated NIFI-14928:
----------------------------------
    Status: Patch Available  (was: Open)

> PutBigQuery fails to send data into DATETIME columns
> ----------------------------------------------------
>
>                 Key: NIFI-14928
>                 URL: https://issues.apache.org/jira/browse/NIFI-14928
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Pierre Villard
>            Assignee: Pierre Villard
>            Priority: Major
>
> PutBigQuery cannot send data to DATETIME columns right now.
> In the proto message, DATETIME will be mapped to INT64 but if the reader is giving us a long representation of the timestamp, we get an error such as:
> {code:java}
> Cannot return an invalid datetime value of 694224000000000 microseconds expressed as civil time, according to civil_time encoding. The range of valid datetime values is [0001-01-01 00:00:00, 9999-12-31 23:59:59.999999] on field datetime. on field birth. {code}
> The failure comes from how DATETIME values must be encoded for BigQuery Storage Write API. We are currently sending microseconds since epoch (valid for TIMESTAMP), but DATETIME requires a packed “civil” datetime micros value via CivilTimeEncoder.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)