You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Adam J. Shook" <ad...@gmail.com> on 2016/08/31 20:46:18 UTC
Provenance expiration error
Hello,
I continue to receive the below error regarding deleting entries from the
provenance repository. The Googles aren't returning anything too helpful.
NiFi v0.7.0 on RHEL 6.8, JDK 1.8.0_60
Any ideas?
Thanks,
--Adam
2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3]
o.a.n.p.PersistentProvenanceRepository Failed to perform Expiration Action
org.apache.nifi.provenance.lucene.DeleteIndexAction@4aff1156 on Provenance
Event file /data01/nifi/provenance_repository/5190858.prov.gz due to
java.lang.IllegalArgumentException: Cannot skip to block -1 because the
value is negative; will not perform additional Expiration Actions on this
file at this time
2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3]
o.a.n.p.PersistentProvenanceRepository
java.lang.IllegalArgumentException: Cannot skip to block -1 because the
value is negative
at
org.apache.nifi.provenance.StandardRecordReader.skipToBlock(StandardRecordReader.java:111)
~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
at
org.apache.nifi.provenance.StandardRecordReader.getMaxEventId(StandardRecordReader.java:458)
~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
at
org.apache.nifi.provenance.lucene.DeleteIndexAction.execute(DeleteIndexAction.java:52)
~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
at
org.apache.nifi.provenance.PersistentProvenanceRepository.purgeOldEvents(PersistentProvenanceRepository.java:907)
~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
at
org.apache.nifi.provenance.PersistentProvenanceRepository$2.run(PersistentProvenanceRepository.java:261)
[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_60]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[na:1.8.0_60]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_60]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_60]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_60]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
Re: Provenance expiration error
Posted by "Adam J. Shook" <ad...@gmail.com>.
Thanks, Bryan. I'll give it a shot!
--Adam
On Sat, Sep 10, 2016 at 6:21 PM, Bryan Bende <bb...@gmail.com> wrote:
> Adam,
>
> A lot of it depends on your setup, but the overall guidance can be found
> here:
> https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance
>
> Some of the biggest changes were around clustering and security, so if you
> don't have either of those then it eliminates a lot.
>
> -Bryan
>
> On Sat, Sep 10, 2016 at 5:29 PM, Adam J. Shook <ad...@gmail.com>
> wrote:
>
>> Thank you for the reply! I take it upgrading from 0.7.0 to 1.0.0 is the
>> same upgrade process as defined on the wiki? Is there some additional
>> items due to it being a major release upgrade?
>>
>> Thanks,
>> --Adam
>>
>> On Sat, Sep 10, 2016 at 1:08 PM, Joe Percivall <jo...@yahoo.com>
>> wrote:
>>
>>> Hello Adam,
>>>
>>>
>>> Sorry no one has responded yet.
>>>
>>> Taking a look at the stack trace, I think you are running into
>>> NIFI-2087[1]. This was addressed in 1.0.0.
>>> [1] https://issues.apache.org/jira/browse/NIFI-2087
>>>
>>>
>>>
>>> Joe
>>> - - - - - -
>>> Joseph Percivall
>>> linkedin.com/in/Percivall
>>> e: joepercivall@yahoo.com
>>>
>>>
>>>
>>> On Saturday, September 10, 2016 12:42 AM, Adam J. Shook <
>>> adamjshook@gmail.com> wrote:
>>>
>>>
>>>
>>> --bump--
>>>
>>> Any ideas on the below issue?
>>>
>>> Thanks,
>>> --Adam
>>>
>>>
>>> On Wed, Aug 31, 2016 at 4:46 PM, Adam J. Shook <ad...@gmail.com>
>>> wrote:
>>>
>>> Hello,
>>> >
>>> >
>>> >I continue to receive the below error regarding deleting entries from
>>> the provenance repository. The Googles aren't returning anything too
>>> helpful.
>>> >
>>> >
>>> >NiFi v0.7.0 on RHEL 6.8, JDK 1.8.0_60
>>> >
>>> >
>>> >Any ideas?
>>> >
>>> >
>>> >Thanks,
>>> >--Adam
>>> >
>>> >
>>> >2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
>>> PersistentProvenanceRepository Failed to perform Expiration Action
>>> org.apache.nifi.provenance. lucene.DeleteIndexAction@ 4aff1156 on
>>> Provenance Event file /data01/nifi/provenance_ repository/5190858.prov.gz
>>> due to java.lang. IllegalArgumentException: Cannot skip to block -1 because
>>> the value is negative; will not perform additional Expiration Actions on
>>> this file at this time
>>> >2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
>>> PersistentProvenanceRepository
>>> >java.lang. IllegalArgumentException: Cannot skip to block -1 because
>>> the value is negative
>>> > at org.apache.nifi.provenance. StandardRecordReader.
>>> skipToBlock( StandardRecordReader.java:111) ~[nifi-persistent-provenance-
>>> repository-0.7.0.jar:0.7.0]
>>> > at org.apache.nifi.provenance. StandardRecordReader.
>>> getMaxEventId( StandardRecordReader.java:458) ~[nifi-persistent-provenance-
>>> repository-0.7.0.jar:0.7.0]
>>> > at org.apache.nifi.provenance. lucene.DeleteIndexAction.
>>> execute(DeleteIndexAction. java:52) ~[nifi-persistent-provenance-
>>> repository-0.7.0.jar:0.7.0]
>>> > at org.apache.nifi.provenance. PersistentProvenanceRepository
>>> .purgeOldEvents( PersistentProvenanceRepository .java:907)
>>> ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
>>> > at org.apache.nifi.provenance. PersistentProvenanceRepository
>>> $2.run( PersistentProvenanceRepository .java:261)
>>> [nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
>>> > at java.util.concurrent. Executors$RunnableAdapter.
>>> call(Executors.java:511) [na:1.8.0_60]
>>> > at java.util.concurrent. FutureTask.runAndReset(
>>> FutureTask.java:308) [na:1.8.0_60]
>>> > at java.util.concurrent. ScheduledThreadPoolExecutor$
>>> ScheduledFutureTask.access$ 301( ScheduledThreadPoolExecutor. java:180)
>>> [na:1.8.0_60]
>>> > at java.util.concurrent. ScheduledThreadPoolExecutor$
>>> ScheduledFutureTask.run( ScheduledThreadPoolExecutor. java:294)
>>> [na:1.8.0_60]
>>> > at java.util.concurrent. ThreadPoolExecutor.runWorker(
>>> ThreadPoolExecutor.java:1142) [na:1.8.0_60]
>>> > at java.util.concurrent. ThreadPoolExecutor$Worker.run(
>>> ThreadPoolExecutor.java:617) [na:1.8.0_60]
>>> > at java.lang.Thread.run(Thread. java:745) [na:1.8.0_60]
>>> >
>>> >
>>>
>>
>>
>
Re: Provenance expiration error
Posted by Bryan Bende <bb...@gmail.com>.
Adam,
A lot of it depends on your setup, but the overall guidance can be found
here:
https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance
Some of the biggest changes were around clustering and security, so if you
don't have either of those then it eliminates a lot.
-Bryan
On Sat, Sep 10, 2016 at 5:29 PM, Adam J. Shook <ad...@gmail.com> wrote:
> Thank you for the reply! I take it upgrading from 0.7.0 to 1.0.0 is the
> same upgrade process as defined on the wiki? Is there some additional
> items due to it being a major release upgrade?
>
> Thanks,
> --Adam
>
> On Sat, Sep 10, 2016 at 1:08 PM, Joe Percivall <jo...@yahoo.com>
> wrote:
>
>> Hello Adam,
>>
>>
>> Sorry no one has responded yet.
>>
>> Taking a look at the stack trace, I think you are running into
>> NIFI-2087[1]. This was addressed in 1.0.0.
>> [1] https://issues.apache.org/jira/browse/NIFI-2087
>>
>>
>>
>> Joe
>> - - - - - -
>> Joseph Percivall
>> linkedin.com/in/Percivall
>> e: joepercivall@yahoo.com
>>
>>
>>
>> On Saturday, September 10, 2016 12:42 AM, Adam J. Shook <
>> adamjshook@gmail.com> wrote:
>>
>>
>>
>> --bump--
>>
>> Any ideas on the below issue?
>>
>> Thanks,
>> --Adam
>>
>>
>> On Wed, Aug 31, 2016 at 4:46 PM, Adam J. Shook <ad...@gmail.com>
>> wrote:
>>
>> Hello,
>> >
>> >
>> >I continue to receive the below error regarding deleting entries from
>> the provenance repository. The Googles aren't returning anything too
>> helpful.
>> >
>> >
>> >NiFi v0.7.0 on RHEL 6.8, JDK 1.8.0_60
>> >
>> >
>> >Any ideas?
>> >
>> >
>> >Thanks,
>> >--Adam
>> >
>> >
>> >2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
>> PersistentProvenanceRepository Failed to perform Expiration Action
>> org.apache.nifi.provenance. lucene.DeleteIndexAction@ 4aff1156 on
>> Provenance Event file /data01/nifi/provenance_ repository/5190858.prov.gz
>> due to java.lang. IllegalArgumentException: Cannot skip to block -1 because
>> the value is negative; will not perform additional Expiration Actions on
>> this file at this time
>> >2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
>> PersistentProvenanceRepository
>> >java.lang. IllegalArgumentException: Cannot skip to block -1 because the
>> value is negative
>> > at org.apache.nifi.provenance. StandardRecordReader.
>> skipToBlock( StandardRecordReader.java:111) ~[nifi-persistent-provenance-
>> repository-0.7.0.jar:0.7.0]
>> > at org.apache.nifi.provenance. StandardRecordReader.
>> getMaxEventId( StandardRecordReader.java:458) ~[nifi-persistent-provenance-
>> repository-0.7.0.jar:0.7.0]
>> > at org.apache.nifi.provenance. lucene.DeleteIndexAction.
>> execute(DeleteIndexAction. java:52) ~[nifi-persistent-provenance-
>> repository-0.7.0.jar:0.7.0]
>> > at org.apache.nifi.provenance. PersistentProvenanceRepository
>> .purgeOldEvents( PersistentProvenanceRepository .java:907)
>> ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
>> > at org.apache.nifi.provenance. PersistentProvenanceRepository
>> $2.run( PersistentProvenanceRepository .java:261)
>> [nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
>> > at java.util.concurrent. Executors$RunnableAdapter.
>> call(Executors.java:511) [na:1.8.0_60]
>> > at java.util.concurrent. FutureTask.runAndReset(
>> FutureTask.java:308) [na:1.8.0_60]
>> > at java.util.concurrent. ScheduledThreadPoolExecutor$
>> ScheduledFutureTask.access$ 301( ScheduledThreadPoolExecutor. java:180)
>> [na:1.8.0_60]
>> > at java.util.concurrent. ScheduledThreadPoolExecutor$
>> ScheduledFutureTask.run( ScheduledThreadPoolExecutor. java:294)
>> [na:1.8.0_60]
>> > at java.util.concurrent. ThreadPoolExecutor.runWorker(
>> ThreadPoolExecutor.java:1142) [na:1.8.0_60]
>> > at java.util.concurrent. ThreadPoolExecutor$Worker.run(
>> ThreadPoolExecutor.java:617) [na:1.8.0_60]
>> > at java.lang.Thread.run(Thread. java:745) [na:1.8.0_60]
>> >
>> >
>>
>
>
Re: Provenance expiration error
Posted by "Adam J. Shook" <ad...@gmail.com>.
Thank you for the reply! I take it upgrading from 0.7.0 to 1.0.0 is the
same upgrade process as defined on the wiki? Is there some additional
items due to it being a major release upgrade?
Thanks,
--Adam
On Sat, Sep 10, 2016 at 1:08 PM, Joe Percivall <jo...@yahoo.com>
wrote:
> Hello Adam,
>
>
> Sorry no one has responded yet.
>
> Taking a look at the stack trace, I think you are running into
> NIFI-2087[1]. This was addressed in 1.0.0.
> [1] https://issues.apache.org/jira/browse/NIFI-2087
>
>
>
> Joe
> - - - - - -
> Joseph Percivall
> linkedin.com/in/Percivall
> e: joepercivall@yahoo.com
>
>
>
> On Saturday, September 10, 2016 12:42 AM, Adam J. Shook <
> adamjshook@gmail.com> wrote:
>
>
>
> --bump--
>
> Any ideas on the below issue?
>
> Thanks,
> --Adam
>
>
> On Wed, Aug 31, 2016 at 4:46 PM, Adam J. Shook <ad...@gmail.com>
> wrote:
>
> Hello,
> >
> >
> >I continue to receive the below error regarding deleting entries from the
> provenance repository. The Googles aren't returning anything too helpful.
> >
> >
> >NiFi v0.7.0 on RHEL 6.8, JDK 1.8.0_60
> >
> >
> >Any ideas?
> >
> >
> >Thanks,
> >--Adam
> >
> >
> >2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
> PersistentProvenanceRepository Failed to perform Expiration Action
> org.apache.nifi.provenance. lucene.DeleteIndexAction@ 4aff1156 on
> Provenance Event file /data01/nifi/provenance_ repository/5190858.prov.gz
> due to java.lang. IllegalArgumentException: Cannot skip to block -1 because
> the value is negative; will not perform additional Expiration Actions on
> this file at this time
> >2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
> PersistentProvenanceRepository
> >java.lang. IllegalArgumentException: Cannot skip to block -1 because the
> value is negative
> > at org.apache.nifi.provenance. StandardRecordReader. skipToBlock(
> StandardRecordReader.java:111) ~[nifi-persistent-provenance-
> repository-0.7.0.jar:0.7.0]
> > at org.apache.nifi.provenance. StandardRecordReader.
> getMaxEventId( StandardRecordReader.java:458) ~[nifi-persistent-provenance-
> repository-0.7.0.jar:0.7.0]
> > at org.apache.nifi.provenance. lucene.DeleteIndexAction.
> execute(DeleteIndexAction. java:52) ~[nifi-persistent-provenance-
> repository-0.7.0.jar:0.7.0]
> > at org.apache.nifi.provenance. PersistentProvenanceRepository
> .purgeOldEvents( PersistentProvenanceRepository .java:907)
> ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> > at org.apache.nifi.provenance. PersistentProvenanceRepository
> $2.run( PersistentProvenanceRepository .java:261)
> [nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> > at java.util.concurrent. Executors$RunnableAdapter.
> call(Executors.java:511) [na:1.8.0_60]
> > at java.util.concurrent. FutureTask.runAndReset(
> FutureTask.java:308) [na:1.8.0_60]
> > at java.util.concurrent. ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$ 301( ScheduledThreadPoolExecutor. java:180)
> [na:1.8.0_60]
> > at java.util.concurrent. ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run( ScheduledThreadPoolExecutor. java:294)
> [na:1.8.0_60]
> > at java.util.concurrent. ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142) [na:1.8.0_60]
> > at java.util.concurrent. ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617) [na:1.8.0_60]
> > at java.lang.Thread.run(Thread. java:745) [na:1.8.0_60]
> >
> >
>
Re: Provenance expiration error
Posted by Joe Percivall <jo...@yahoo.com>.
Hello Adam,
Sorry no one has responded yet.
Taking a look at the stack trace, I think you are running into NIFI-2087[1]. This was addressed in 1.0.0.
[1] https://issues.apache.org/jira/browse/NIFI-2087
Joe
- - - - - -
Joseph Percivall
linkedin.com/in/Percivall
e: joepercivall@yahoo.com
On Saturday, September 10, 2016 12:42 AM, Adam J. Shook <ad...@gmail.com> wrote:
--bump--
Any ideas on the below issue?
Thanks,
--Adam
On Wed, Aug 31, 2016 at 4:46 PM, Adam J. Shook <ad...@gmail.com> wrote:
Hello,
>
>
>I continue to receive the below error regarding deleting entries from the provenance repository. The Googles aren't returning anything too helpful.
>
>
>NiFi v0.7.0 on RHEL 6.8, JDK 1.8.0_60
>
>
>Any ideas?
>
>
>Thanks,
>--Adam
>
>
>2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p. PersistentProvenanceRepository Failed to perform Expiration Action org.apache.nifi.provenance. lucene.DeleteIndexAction@ 4aff1156 on Provenance Event file /data01/nifi/provenance_ repository/5190858.prov.gz due to java.lang. IllegalArgumentException: Cannot skip to block -1 because the value is negative; will not perform additional Expiration Actions on this file at this time
>2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p. PersistentProvenanceRepository
>java.lang. IllegalArgumentException: Cannot skip to block -1 because the value is negative
> at org.apache.nifi.provenance. StandardRecordReader. skipToBlock( StandardRecordReader.java:111) ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance. StandardRecordReader. getMaxEventId( StandardRecordReader.java:458) ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance. lucene.DeleteIndexAction. execute(DeleteIndexAction. java:52) ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance. PersistentProvenanceRepository .purgeOldEvents( PersistentProvenanceRepository .java:907) ~[nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance. PersistentProvenanceRepository $2.run( PersistentProvenanceRepository .java:261) [nifi-persistent-provenance- repository-0.7.0.jar:0.7.0]
> at java.util.concurrent. Executors$RunnableAdapter. call(Executors.java:511) [na:1.8.0_60]
> at java.util.concurrent. FutureTask.runAndReset( FutureTask.java:308) [na:1.8.0_60]
> at java.util.concurrent. ScheduledThreadPoolExecutor$ ScheduledFutureTask.access$ 301( ScheduledThreadPoolExecutor. java:180) [na:1.8.0_60]
> at java.util.concurrent. ScheduledThreadPoolExecutor$ ScheduledFutureTask.run( ScheduledThreadPoolExecutor. java:294) [na:1.8.0_60]
> at java.util.concurrent. ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1142) [na:1.8.0_60]
> at java.util.concurrent. ThreadPoolExecutor$Worker.run( ThreadPoolExecutor.java:617) [na:1.8.0_60]
> at java.lang.Thread.run(Thread. java:745) [na:1.8.0_60]
>
>
Re: Provenance expiration error
Posted by "Adam J. Shook" <ad...@gmail.com>.
--bump--
Any ideas on the below issue?
Thanks,
--Adam
On Wed, Aug 31, 2016 at 4:46 PM, Adam J. Shook <ad...@gmail.com> wrote:
> Hello,
>
> I continue to receive the below error regarding deleting entries from the
> provenance repository. The Googles aren't returning anything too helpful.
>
> NiFi v0.7.0 on RHEL 6.8, JDK 1.8.0_60
>
> Any ideas?
>
> Thanks,
> --Adam
>
> 2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.PersistentProvenanceRepository
> Failed to perform Expiration Action org.apache.nifi.provenance.
> lucene.DeleteIndexAction@4aff1156 on Provenance Event file
> /data01/nifi/provenance_repository/5190858.prov.gz due to java.lang.IllegalArgumentException:
> Cannot skip to block -1 because the value is negative; will not perform
> additional Expiration Actions on this file at this time
> 2016-08-31 16:42:17,763 WARN [Provenance Maintenance Thread-3] o.a.n.p.
> PersistentProvenanceRepository
> java.lang.IllegalArgumentException: Cannot skip to block -1 because the
> value is negative
> at org.apache.nifi.provenance.StandardRecordReader.skipToBlock(StandardRecordReader.java:111)
> ~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance.StandardRecordReader.getMaxEventId(StandardRecordReader.java:458)
> ~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance.lucene.DeleteIndexAction.
> execute(DeleteIndexAction.java:52) ~[nifi-persistent-provenance-
> repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance.PersistentProvenanceRepository
> .purgeOldEvents(PersistentProvenanceRepository.java:907)
> ~[nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
> at org.apache.nifi.provenance.PersistentProvenanceRepository
> $2.run(PersistentProvenanceRepository.java:261)
> [nifi-persistent-provenance-repository-0.7.0.jar:0.7.0]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [na:1.8.0_60]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> [na:1.8.0_60]
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> [na:1.8.0_60]
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> [na:1.8.0_60]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_60]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_60]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
>
>