You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/03/13 18:13:00 UTC

[jira] [Commented] (NIFI-11274) PutElasticsearchRecord should only add @timestamp field if not null

    [ https://issues.apache.org/jira/browse/NIFI-11274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699782#comment-17699782 ] 

ASF subversion and git services commented on NIFI-11274:
--------------------------------------------------------

Commit f71ba8aadb14ec920c7235680347043fa179440b in nifi's branch refs/heads/main from Chris Sampson
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=f71ba8aadb ]

NIFI-11274 only add @timestamp to PutElasticsearchRecord document if not null

This closes #7036.

Signed-off-by: Kevin Doran <kd...@apache.org>


> PutElasticsearchRecord should only add @timestamp field if not null
> -------------------------------------------------------------------
>
>                 Key: NIFI-11274
>                 URL: https://issues.apache.org/jira/browse/NIFI-11274
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.20.0
>            Reporter: Chris Sampson
>            Assignee: Chris Sampson
>            Priority: Minor
>             Fix For: 1.latest, 2.latest
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> The {{PutElasticsearchRecord}} processor optionally allows users to configure an {{@timestamp}} field using a RecordPath or specified value. When these are not set or the configuration results in a {{null}} value, the processor currently adds a {{"@timestamp": null}} field to the document being sent to Elasticsearch.
> While {{null}}/empty fields can be suppressed by the {{ElasticSearchClientServiceImpl}}, this is not always the wanted configuration. NiFi shouldn't always add the {{@timestamp}} field to the document before sending because with "null suppression" disabled in the controller service, the unwanted/unexpected field will be created and sent to Elasticsearch.
> The {{@timestamp}} field was added to support Data Streams within Elasticsearch. For such data storage, the field will be necessary but for other "normal" indices, the field is likely not wanted (even set to {{null}}).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)