You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@nifi.apache.org by "Jens M. Kofoed" <jm...@gmail.com> on 2021/07/28 08:22:08 UTC

Provenance for SplitRecord has a wrong output claim file

Hi

I use a SplitRecord with a XMLReader and a JSONRecord Set writer. When
looking at provenance date for the process the output claim file is equal
to the input claim file which mean that both files are xml files. This is
wrong, the output claim file should be the json file.
If using a convertRecord process the output claim file is equal to the file
coming out of the process

Kind regards
Jens M. Kofoed

Re: Provenance for SplitRecord has a wrong output claim file

Posted by "Jens M. Kofoed" <jm...@gmail.com>.

Thanks Pierre

your are right, I didn't think of that. what should the output claim file
be if there are multiple outputs. The output claim file is off course the
original file :-) silly me

regards
Jens M. Kofoed

Den ons. 28. jul. 2021 kl. 11.10 skrev Pierre Villard <
pierre.villard.fr@gmail.com>:

> Hi,
>
> I believe this is expected. If you have one XML file split into 10 JSON
> files, what would you expect for the output claim?
> You can use the provenance event to get the child flow files, and retrieve
> the claims from there.
> Also note that one claim file can contain multiple flow files but with
> different offsets.
>
> Hope this helps,
> Pierre
>
> Le mer. 28 juil. 2021 à 10:18, Jens M. Kofoed <jm...@gmail.com> a
> écrit :
>
>> Hi
>>
>> I use a SplitRecord with a XMLReader and a JSONRecord Set writer. When
>> looking at provenance date for the process the output claim file is equal
>> to the input claim file which mean that both files are xml files. This is
>> wrong, the output claim file should be the json file.
>> If using a convertRecord process the output claim file is equal to the
>> file coming out of the process
>>
>> Kind regards
>> Jens M. Kofoed
>>
>

Re: Provenance for SplitRecord has a wrong output claim file

Posted by Pierre Villard <pi...@gmail.com>.

Hi,

I believe this is expected. If you have one XML file split into 10 JSON
files, what would you expect for the output claim?
You can use the provenance event to get the child flow files, and retrieve
the claims from there.
Also note that one claim file can contain multiple flow files but with
different offsets.

Hope this helps,
Pierre

Le mer. 28 juil. 2021 à 10:18, Jens M. Kofoed <jm...@gmail.com> a
écrit :

> Hi
>
> I use a SplitRecord with a XMLReader and a JSONRecord Set writer. When
> looking at provenance date for the process the output claim file is equal
> to the input claim file which mean that both files are xml files. This is
> wrong, the output claim file should be the json file.
> If using a convertRecord process the output claim file is equal to the
> file coming out of the process
>
> Kind regards
> Jens M. Kofoed
>