You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Ravi Papisetti (rpapiset)" <rp...@cisco.com> on 2017/04/13 22:42:50 UTC

SplitText is throwing ArrayIndexOutofBoundException

Hi,

Using Apache Nifi 1.1.2 single node machine, fetching files from hdfs using FetchHDFS and sending to SplitText. I see SplitText is throwing arrayindexoutofboundexception for CSV files. It works fine for TAB separated files.

Below are exception details:

ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] failed to process due to java.lang.ArrayIndexOutOfBoundsException; rolling back session: java.lang.ArrayIndexOutOfBoundsException

2017-04-13 07:37:39,262 ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText

java.lang.ArrayIndexOutOfBoundsException: null


Any thoughts why this can be thrown by SplitText processor?

Appreciate any help.

Thanks,
Ravi Papisetti

Re: SplitText is throwing ArrayIndexOutofBoundException

Posted by "Ravi Papisetti (rpapiset)" <rp...@cisco.com>.
Thank you for the references, Kyle. I did remove templates from flow.xml.gz and removed content from all repos resolved issue.

Thanks,
Ravi Papisetti

From: Kyle Richardson <ky...@gmail.com>
Reply-To: "users@nifi.apache.org" <us...@nifi.apache.org>
Date: Tuesday, April 18, 2017 at 9:54 AM
To: "users@nifi.apache.org" <us...@nifi.apache.org>
Subject: Re: SplitText is throwing ArrayIndexOutofBoundException

Ravi,

You may be running into the same issue I did in v1.1.2. Below is the stack trace from my case. I found that I was running into either NIFI-3495 or NIFI-3278 or both, and that upgrading to the latest master build (1.2.0-SNAPSHOT) resolved the issue.

2017-04-11 16:10:20,703 ERROR [Timer-Driven Process Thread-3] o.a.nifi.processors.standard.SplitText
java.lang.ArrayIndexOutOfBoundsException: 8192
        at org.apache.nifi.stream.io.util.TextLineDemarcator.isEol(TextLineDemarcator.java:162) ~[nifi-utils-1.1.2.jar:1.1.2]
        at org.apache.nifi.stream.io.util.TextLineDemarcator.nextOffsetInfo(TextLineDemarcator.java:113) ~[nifi-utils-1.1.2.jar:1.1.2]
        at org.apache.nifi.stream.io.util.TextLineDemarcator.nextOffsetInfo(TextLineDemarcator.java:85) ~[nifi-utils-1.1.2.jar:1.1.2]
        at org.apache.nifi.processors.standard.SplitText.nextSplit(SplitText.java:405) ~[na:na]
        at org.apache.nifi.processors.standard.SplitText.access$600(SplitText.java:86) ~[na:na]
        at org.apache.nifi.processors.standard.SplitText$1.process(SplitText.java:238) ~[na:na]
        at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2082) ~[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2053) ~[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.processors.standard.SplitText.onTrigger(SplitText.java:206) ~[na:na]
        at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) ~[nifi-api-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1099) ~[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136) [nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) [nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132) [nifi-framework-core-1.1.2.jar:1.1.2]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_121]
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_121]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_121]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]

-Kyle


On Thu, Apr 13, 2017 at 9:41 PM, James Wing <jv...@gmail.com>> wrote:
Ravi,
Can you share a sample of the data you are splitting and the settings of the SplitText processor?  Is there more error stack trace information?
Thanks,
James

On Thu, Apr 13, 2017 at 3:42 PM, Ravi Papisetti (rpapiset) <rp...@cisco.com>> wrote:
Hi,

Using Apache Nifi 1.1.2 single node machine, fetching files from hdfs using FetchHDFS and sending to SplitText. I see SplitText is throwing arrayindexoutofboundexception for CSV files. It works fine for TAB separated files.

Below are exception details:

ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] failed to process due to java.lang.ArrayIndexOutOfBoundsException; rolling back session: java.lang.ArrayIndexOutOfBoundsException

2017-04-13 07:37:39,262 ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText

java.lang.ArrayIndexOutOfBoundsException: null


Any thoughts why this can be thrown by SplitText processor?

Appreciate any help.

Thanks,
Ravi Papisetti

Re: SplitText is throwing ArrayIndexOutofBoundException

Posted by Kyle Richardson <ky...@gmail.com>.
Ravi,

You may be running into the same issue I did in v1.1.2. Below is the stack
trace from my case. I found that I was running into either NIFI-3495 or
NIFI-3278 or both, and that upgrading to the latest master build
(1.2.0-SNAPSHOT) resolved the issue.

2017-04-11 16:10:20,703 ERROR [Timer-Driven Process Thread-3]
o.a.nifi.processors.standard.SplitText
java.lang.ArrayIndexOutOfBoundsException: 8192
        at
org.apache.nifi.stream.io.util.TextLineDemarcator.isEol(TextLineDemarcator.java:162)
~[nifi-utils-1.1.2.jar:1.1.2]
        at
org.apache.nifi.stream.io.util.TextLineDemarcator.nextOffsetInfo(TextLineDemarcator.java:113)
~[nifi-utils-1.1.2.jar:1.1.2]
        at
org.apache.nifi.stream.io.util.TextLineDemarcator.nextOffsetInfo(TextLineDemarcator.java:85)
~[nifi-utils-1.1.2.jar:1.1.2]
        at
org.apache.nifi.processors.standard.SplitText.nextSplit(SplitText.java:405)
~[na:na]
        at
org.apache.nifi.processors.standard.SplitText.access$600(SplitText.java:86)
~[na:na]
        at
org.apache.nifi.processors.standard.SplitText$1.process(SplitText.java:238)
~[na:na]
        at
org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2082)
~[nifi-framework-core-1.1.2.jar:1.1.2]
        at
org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2053)
~[nifi-framework-core-1.1.2.jar:1.1.2]
        at
org.apache.nifi.processors.standard.SplitText.onTrigger(SplitText.java:206)
~[na:na]
        at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
~[nifi-api-1.1.2.jar:1.1.2]
        at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1099)
~[nifi-framework-core-1.1.2.jar:1.1.2]
        at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
[nifi-framework-core-1.1.2.jar:1.1.2]
        at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
[nifi-framework-core-1.1.2.jar:1.1.2]
        at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
[nifi-framework-core-1.1.2.jar:1.1.2]
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_121]
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[na:1.8.0_121]
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_121]
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_121]
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_121]
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]

-Kyle


On Thu, Apr 13, 2017 at 9:41 PM, James Wing <jv...@gmail.com> wrote:

> Ravi,
>
> Can you share a sample of the data you are splitting and the settings of
> the SplitText processor?  Is there more error stack trace information?
>
> Thanks,
>
> James
>
> On Thu, Apr 13, 2017 at 3:42 PM, Ravi Papisetti (rpapiset) <
> rpapiset@cisco.com> wrote:
>
>> Hi,
>>
>>
>>
>> Using Apache Nifi 1.1.2 single node machine, fetching files from hdfs
>> using FetchHDFS and sending to SplitText. I see SplitText is throwing
>> arrayindexoutofboundexception for CSV files. It works fine for TAB
>> separated files.
>>
>>
>>
>> Below are exception details:
>>
>> ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText
>> SplitText[id=10001177-1788-1506-fe7c-2d411cab157b]
>> SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] failed to process due
>> to java.lang.ArrayIndexOutOfBoundsException; rolling back session:
>> java.lang.ArrayIndexOutOfBoundsException
>>
>> 2017-04-13 07:37:39,262 ERROR [Timer-Driven Process Thread-5]
>> o.a.nifi.processors.standard.SplitText
>>
>> java.lang.ArrayIndexOutOfBoundsException: null
>>
>>
>>
>>
>>
>> Any thoughts why this can be thrown by SplitText processor?
>>
>>
>>
>> Appreciate any help.
>>
>>
>>
>> Thanks,
>>
>> Ravi Papisetti
>>
>
>

Re: SplitText is throwing ArrayIndexOutofBoundException

Posted by James Wing <jv...@gmail.com>.
Ravi,

Can you share a sample of the data you are splitting and the settings of
the SplitText processor?  Is there more error stack trace information?

Thanks,

James

On Thu, Apr 13, 2017 at 3:42 PM, Ravi Papisetti (rpapiset) <
rpapiset@cisco.com> wrote:

> Hi,
>
>
>
> Using Apache Nifi 1.1.2 single node machine, fetching files from hdfs
> using FetchHDFS and sending to SplitText. I see SplitText is throwing
> arrayindexoutofboundexception for CSV files. It works fine for TAB
> separated files.
>
>
>
> Below are exception details:
>
> ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText
> SplitText[id=10001177-1788-1506-fe7c-2d411cab157b]
> SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] failed to process due
> to java.lang.ArrayIndexOutOfBoundsException; rolling back session:
> java.lang.ArrayIndexOutOfBoundsException
>
> 2017-04-13 07:37:39,262 ERROR [Timer-Driven Process Thread-5]
> o.a.nifi.processors.standard.SplitText
>
> java.lang.ArrayIndexOutOfBoundsException: null
>
>
>
>
>
> Any thoughts why this can be thrown by SplitText processor?
>
>
>
> Appreciate any help.
>
>
>
> Thanks,
>
> Ravi Papisetti
>