You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by sanjeet rath <ra...@gmail.com> on 2021/06/15 14:26:00 UTC
Regarding jira issue: NIFI-7856
Hi,
The symptoms mentioned in the jira issue(
*https://issues.apache.org/jira/browse/NIFI-7856
<https://issues.apache.org/jira/browse/NIFI-7856> *), i am
observing this in one of our PROD clusters.
ERROR [Compress Provenance Logs-1-thread-2]
o.a.n.p.s.EventFileCompressor Failed to compress
./provenance_repository/1693519.prov on rollover
java.io.FileNotFoundException: ./provenance_repository/1693519.prov
(No such file or directory)
i saw the code is fixed in 1.13 version with bellow file changes in
nifi-provenance-repository-bundle .
nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java
<https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hb=a73cd6a>
diff
<https://gitbox.apache.org/repos/asf?p=nifi.git;a=blobdiff;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hp=5757e59567e7d6eee9a75b792f21b56948f26e37;hb=a73cd6a;hpb=91f6b42985c20ee9b1ef177d16c70c820a5cdf0e>
| blob
<https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hb=a73cd6a>
| history
<https://gitbox.apache.org/repos/asf?p=nifi.git;a=history;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;hb=a73cd6a>
nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java
<https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java;h=1df84f6d41ef54b3cbf2785c66dd185509da8eb7;hb=a73cd6a>
So i have modified above 2 file changes on top of my 1.12.1 version of my
nifi-provenance-repository-bundle and build the nifi-provenance-repository.
nar file. then i will deploy this new Nar file to to /Lib folder of 1.12.1
version of niif
Is my above approach is correct ?
Second thing is, I am facing one issue in 1.12 version, unable to replicate
the provenance error in the lower environment (Tried with the 7856.xml
template attached in the jira by Mark)
So not able to understand whether the above change i made is worked or not.
As i can not directly deploy the Nar to prod env where the error is
constantly coming in every hour.
Could you please help me to replicate this issue in 1.12.1 version
Along with the template any other config changes i need to do replicate the
issue.
Regards,
--
Sanjeet Kumar Rath,
Re: Regarding jira issue: NIFI-7856
Posted by Joe Witt <jo...@gmail.com>.
Sanjeet
If I understand correctly you are trying to backport a fix we have
completed in the 1.13.x line to your 1.12.x line and asking for assistance
with that.
I recommend you upgrade to 1.13.x instead of trying to backport. However,
yes on quick read your stated approach does seem fine.
Thanks
On Fri, Jun 18, 2021 at 5:32 AM sanjeet rath <ra...@gmail.com> wrote:
> Hi,
>
> Any help input on my trailed mail is really appriciated .
> I am almost stuck here from past 2 weeks.
> Tried almost all the option i have.
>
> Thank u everyone in advance.
> Regards,
> Sanjeet
>
> On Tue, 15 Jun 2021, 7:56 pm sanjeet rath, <ra...@gmail.com> wrote:
>
>> Hi,
>>
>> The symptoms mentioned in the jira issue( *https://issues.apache.org/jira/browse/NIFI-7856
>> <https://issues.apache.org/jira/browse/NIFI-7856> *), i am
>> observing this in one of our PROD clusters.
>>
>> ERROR [Compress Provenance Logs-1-thread-2] o.a.n.p.s.EventFileCompressor Failed to compress ./provenance_repository/1693519.prov on rollover
>> java.io.FileNotFoundException: ./provenance_repository/1693519.prov (No such file or directory)
>>
>>
>> i saw the code is fixed in 1.13 version with bellow file changes in
>> nifi-provenance-repository-bundle .
>>
>>
>> nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java
>> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hb=a73cd6a>
>> diff
>> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blobdiff;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hp=5757e59567e7d6eee9a75b792f21b56948f26e37;hb=a73cd6a;hpb=91f6b42985c20ee9b1ef177d16c70c820a5cdf0e>
>> | blob
>> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hb=a73cd6a>
>> | history
>> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=history;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;hb=a73cd6a>
>>
>> nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java
>> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java;h=1df84f6d41ef54b3cbf2785c66dd185509da8eb7;hb=a73cd6a>
>> So i have modified above 2 file changes on top of my 1.12.1 version of my
>> nifi-provenance-repository-bundle and build the nifi-provenance-repository.
>> nar file. then i will deploy this new Nar file to to /Lib folder of 1.12.1
>> version of niif
>>
>> Is my above approach is correct ?
>>
>> Second thing is, I am facing one issue in 1.12 version, unable to
>> replicate the provenance error in the lower environment (Tried with the
>> 7856.xml template attached in the jira by Mark)
>> So not able to understand whether the above change i made is worked or
>> not.
>> As i can not directly deploy the Nar to prod env where the error is
>> constantly coming in every hour.
>>
>> Could you please help me to replicate this issue in 1.12.1 version
>> Along with the template any other config changes i need to do replicate
>> the issue.
>>
>>
>> Regards,
>> --
>> Sanjeet Kumar Rath,
>>
>>
>>
Re: Regarding jira issue: NIFI-7856
Posted by sanjeet rath <ra...@gmail.com>.
Hi,
Any help input on my trailed mail is really appriciated .
I am almost stuck here from past 2 weeks.
Tried almost all the option i have.
Thank u everyone in advance.
Regards,
Sanjeet
On Tue, 15 Jun 2021, 7:56 pm sanjeet rath, <ra...@gmail.com> wrote:
> Hi,
>
> The symptoms mentioned in the jira issue( *https://issues.apache.org/jira/browse/NIFI-7856
> <https://issues.apache.org/jira/browse/NIFI-7856> *), i am
> observing this in one of our PROD clusters.
>
> ERROR [Compress Provenance Logs-1-thread-2] o.a.n.p.s.EventFileCompressor Failed to compress ./provenance_repository/1693519.prov on rollover
> java.io.FileNotFoundException: ./provenance_repository/1693519.prov (No such file or directory)
>
>
> i saw the code is fixed in 1.13 version with bellow file changes in
> nifi-provenance-repository-bundle .
>
>
> nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java
> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hb=a73cd6a>
> diff
> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blobdiff;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hp=5757e59567e7d6eee9a75b792f21b56948f26e37;hb=a73cd6a;hpb=91f6b42985c20ee9b1ef177d16c70c820a5cdf0e>
> | blob
> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;h=a3ed241634e21b206437cb06c81842d23b5ea9f8;hb=a73cd6a>
> | history
> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=history;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/RecordWriterLease.java;hb=a73cd6a>
>
> nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java
> <https://gitbox.apache.org/repos/asf?p=nifi.git;a=blob;f=nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java;h=1df84f6d41ef54b3cbf2785c66dd185509da8eb7;hb=a73cd6a>
> So i have modified above 2 file changes on top of my 1.12.1 version of my
> nifi-provenance-repository-bundle and build the nifi-provenance-repository.
> nar file. then i will deploy this new Nar file to to /Lib folder of 1.12.1
> version of niif
>
> Is my above approach is correct ?
>
> Second thing is, I am facing one issue in 1.12 version, unable to
> replicate the provenance error in the lower environment (Tried with the
> 7856.xml template attached in the jira by Mark)
> So not able to understand whether the above change i made is worked or
> not.
> As i can not directly deploy the Nar to prod env where the error is
> constantly coming in every hour.
>
> Could you please help me to replicate this issue in 1.12.1 version
> Along with the template any other config changes i need to do replicate
> the issue.
>
>
> Regards,
> --
> Sanjeet Kumar Rath,
>
>
>