You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Oleg Zhurakousky (JIRA)" <ji...@apache.org> on 2016/11/27 13:51:58 UTC
[jira] [Commented] (NIFI-1920) Poor performance for SplitText when
its 'splits' relationship is cloned
[ https://issues.apache.org/jira/browse/NIFI-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699722#comment-15699722 ]
Oleg Zhurakousky commented on NIFI-1920:
----------------------------------------
[~markap14] Should this be closed in lieu of recent performance improvements in SplitText?
> Poor performance for SplitText when its 'splits' relationship is cloned
> -----------------------------------------------------------------------
>
> Key: NIFI-1920
> URL: https://issues.apache.org/jira/browse/NIFI-1920
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Reporter: Mark Payne
>
> On my laptop, I downloaded the file http://standards.ieee.org/develop/regauth/oui/oui.csv and ran it through SplitText, splitting into 1-line FlowFiles. It completed in about 1.8 seconds. I then routed the 'splits' relationship to a second processor so that the data would be cloned. Rather than completing in 1.8 seconds, when I ran the file through again, it took 2.5 minutes to complete. A stack trace during that time shows the time being spent adding the 'CLONE' Provenance Event in the Provenance Reporter:
> {code}
> "Timer-Driven Process Thread-3" Id=93 RUNNABLE
> at java.util.HashMap$TreeNode.find(HashMap.java:1865)
> at java.util.HashMap$TreeNode.find(HashMap.java:1861)
> at java.util.HashMap$TreeNode.find(HashMap.java:1861)
> at java.util.HashMap$TreeNode.find(HashMap.java:1861)
> at java.util.HashMap$TreeNode.find(HashMap.java:1861)
> at java.util.HashMap$TreeNode.find(HashMap.java:1861)
> at java.util.HashMap$TreeNode.find(HashMap.java:1861)
> at java.util.HashMap$TreeNode.putTreeVal(HashMap.java:1981)
> at java.util.HashMap.putVal(HashMap.java:637)
> at java.util.HashMap.put(HashMap.java:611)
> at java.util.HashSet.add(HashSet.java:219)
> at java.util.AbstractCollection.addAll(AbstractCollection.java:344)
> at org.apache.nifi.controller.repository.StandardProcessSession$Checkpoint.checkpoint(StandardProcessSession.java:2572)
> at org.apache.nifi.controller.repository.StandardProcessSession$Checkpoint.access$100(StandardProcessSession.java:2539)
> at org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:276)
> at org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:282)
> at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:28)
> at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1072)
> at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
> at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
> at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:123)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@3e0d1518
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)