You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Koji Kawamura (JIRA)" <ji...@apache.org> on 2018/01/16 07:29:02 UTC

[jira] [Resolved] (NIFI-4765) SiteToSiteProvenanceReportingTask does not sent ROUTE events.

     [ https://issues.apache.org/jira/browse/NIFI-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Kawamura resolved NIFI-4765.
---------------------------------
    Resolution: Cannot Reproduce
      Assignee: Koji Kawamura

[~alfonz] Thanks for reporting the issue. However, I couldn't reproduce the reported behavior with the template and script you provided.

The script successfully emitted a ROUTE provenance event and it is properly reported by SiteToSiteProvenanceEvent as follows:

{code}
}, {
  "eventId" : "0102fa9d-6209-4806-9e1b-46530b254f05",
  "eventOrdinal" : 97,
  "eventType" : "ROUTE",
  "timestampMillis" : 1516086656542,
  "timestamp" : "2018-01-16T07:10:56.542Z",
  "durationMillis" : -1,
  "lineageStart" : 1516086652972,
  "details" : "Records in this FlowFile were invalid for the following reasons: The following 1 fields were missing: [/partyUID]",
  "componentId" : "ba3a1fab-8788-3ee1-e4fa-bf00c8dc3ad4",
  "componentType" : "ValidateRecord",
  "componentName" : "MockOfAvroValidation",
  "processGroupId" : "fdcbdff9-0160-1000-453f-17a8c8cef66f",
  "processGroupName" : "NIFI-4765",
  "entityId" : "cf465936-7c3c-4e1e-ac4b-bdece3d03447",
  "entityType" : "org.apache.nifi.flowfile.FlowFile",
  "entitySize" : 4,
  "updatedAttributes" : {
    "path" : "./",
    "mime.type" : "application/json",
    "filename" : "23525023114493",
    "uuid" : "cf465936-7c3c-4e1e-ac4b-bdece3d03447",
    "record.count" : "1",
    "schema.name" : "schemaMock"
  },
{code}

Please feel free to reopen this if there is any reproducing condition that I missed.

> SiteToSiteProvenanceReportingTask does not sent ROUTE events.
> -------------------------------------------------------------
>
>                 Key: NIFI-4765
>                 URL: https://issues.apache.org/jira/browse/NIFI-4765
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.4.0
>            Reporter: Martin Mucha
>            Assignee: Koji Kawamura
>            Priority: Blocker
>         Attachments: SiteToSiteProvenanceReportingTaskFail.xml, generateInvalidJson
>
>
> I need to read JSON validation failures. ValidateRecord emits ROUTE events. I can see such route events in data provenance tab. I tried to access them using SiteToSiteProvenanceReportingTask. I can see receive/drop events coming in and being logged via provided flow, but no ROUTE events. There is no filtering in place defined on SiteToSiteProvenanceReportingTask.
> to reproduce: 
> 1. use provided template
> 2. use provided script to configure invokeScript processor (that one seems to be buggy, and I wasn't able to reliably set script body in it, therefore I used file)
> 3. if you invoke all processors, you should see validation failure being logged, route provenance event emitted, but you won't find it arriving into "provenance in".



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)