You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Thierry PRATS (Jira)" <ji...@apache.org> on 2021/04/28 12:53:00 UTC
[jira] [Updated] (NIFI-8494) InvokeScriptedProcessor become invalid
after stopped
[ https://issues.apache.org/jira/browse/NIFI-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thierry PRATS updated NIFI-8494:
--------------------------------
Description:
InvokeScriptedProcessor works well when started for the first time.
The Processor become invalid after stopped and cannot be started anymore, also after change parameters. This message appears : Unable to load script: No processor was defined by the script.
We have to delete and recreate the Processor to start it.
The Processor is configured like this :
Script Engine : python
Script body :
{code:java}
from org.apache.nifi.processor import Processor, Relationship
from java.lang import Throwableclass E():
def __init__(self):
pass
def executeScript(self,session, context, log, REL_SUCCESS, REL_FAILURE):
flowFile = session.get()
if (flowFile != None):
flowFile = session.putAttribute(flowFile, 'myAttr', 'myValue')
session.transfer(flowFile, REL_SUCCESS)
#end classclass JythonProcessor(Processor):
REL_SUCCESS = Relationship.Builder().name("success").description('FlowFiles that were successfully processed are routed here').build()
REL_FAILURE = Relationship.Builder().name("failure").description('FlowFiles that were not successfully processed are routed here').build()
log = None
e = E()
def initialize(self,context):
self.log = context.logger
def getRelationships(self):
return set([self.REL_SUCCESS, self.REL_FAILURE])
def validate(self,context):
pass
def onPropertyModified(self,descriptor, oldValue, newValue):
pass
def getPropertyDescriptors(self):
return []
def getIdentifier(self):
return None
def onTrigger(self,context, sessionFactory):
session = sessionFactory.createSession()
try:
self.e.executeScript(session, context, self.log, self.REL_SUCCESS, self.REL_FAILURE)
session.commit()
except Throwable, t:
self.log.error('{} failed to process due to {}; rolling back session', [self, t])
session.rollback(true)
raise t
#end classprocessor = JythonProcessor()
{code}
The logs :
{noformat}
2021-04-28 14:03:06,438 INFO [NiFi Web Server-93413] o.a.nifi.groups.StandardProcessGroup InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] added to StandardProcessGroup[identifier=46a63780-e64b-1f50-ffff-ffffe1229048,name=TEST_ISP]
2021-04-28 14:03:43,335 INFO [NiFi Web Server-93416] o.a.n.c.s.StandardProcessScheduler Starting InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
2021-04-28 14:03:43,335 INFO [NiFi Web Server-93416] o.a.n.controller.StandardProcessorNode Starting InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
2021-04-28 14:03:43,336 INFO [Timer-Driven Process Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run with 1 threads 0
21-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.c.s.StandardProcessScheduler Stopping InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
2021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.controller.StandardProcessorNode Stopping processor: InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
2021-04-28 14:04:03,432 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run 0
21-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.c.s.StandardProcessScheduler Stopping InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
2021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.controller.StandardProcessorNode Stopping processor: InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
2021-04-28 14:04:03,432 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run
2021-04-28 14:04:06,412 ERROR [Validate Components Thread-5] o.a.n.p.script.InvokeScriptedProcessor InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] Unable to load script: No processor was defined by the script.: javax.script.ScriptException: No processor was defined by the script. javax.script.ScriptException: No processor was defined by the script. at org.apache.nifi.processors.script.InvokeScriptedProcessor.reloadScript(InvokeScriptedProcessor.java:421) at org.apache.nifi.processors.script.InvokeScriptedProcessor.reloadScriptBody(InvokeScriptedProcessor.java:310) at org.apache.nifi.processors.script.InvokeScriptedProcessor.setup(InvokeScriptedProcessor.java:230) at org.apache.nifi.processors.script.InvokeScriptedProcessor.customValidate(InvokeScriptedProcessor.java:479) at org.apache.nifi.components.AbstractConfigurableComponent.validate(AbstractConfigurableComponent.java:145) at org.apache.nifi.controller.AbstractComponentNode.computeValidationErrors(AbstractComponentNode.java:609) at org.apache.nifi.controller.StandardProcessorNode.computeValidationErrors(StandardProcessorNode.java:1054) at org.apache.nifi.controller.AbstractComponentNode.performValidation(AbstractComponentNode.java:576) at org.apache.nifi.controller.AbstractComponentNode.performValidation(AbstractComponentNode.java:590) at org.apache.nifi.components.validation.StandardValidationTrigger.trigger(StandardValidationTrigger.java:52) at org.apache.nifi.components.validation.TriggerValidationTask.run(TriggerValidationTask.java:50) at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) {noformat}
was:
InvokeScriptedProcessor works well when started for the first time.
The Processor become invalid after stopped and cannot be started anymore, also after change parameters. This message appears : Unable to load script: No processor was defined by the script.
We have to delete and recreate the Processor to start it.
The Processor is configured like this :
Script Engine : python
Script body :
{code:java}
from org.apache.nifi.processor import Processor, Relationship
from java.lang import Throwableclass E():
def __init__(self):
pass
def executeScript(self,session, context, log, REL_SUCCESS, REL_FAILURE):
flowFile = session.get()
if (flowFile != None):
flowFile = session.putAttribute(flowFile, 'myAttr', 'myValue')
session.transfer(flowFile, REL_SUCCESS)
#end classclass JythonProcessor(Processor):
REL_SUCCESS = Relationship.Builder().name("success").description('FlowFiles that were successfully processed are routed here').build()
REL_FAILURE = Relationship.Builder().name("failure").description('FlowFiles that were not successfully processed are routed here').build()
log = None
e = E()
def initialize(self,context):
self.log = context.logger
def getRelationships(self):
return set([self.REL_SUCCESS, self.REL_FAILURE])
def validate(self,context):
pass
def onPropertyModified(self,descriptor, oldValue, newValue):
pass
def getPropertyDescriptors(self):
return []
def getIdentifier(self):
return None
def onTrigger(self,context, sessionFactory):
session = sessionFactory.createSession()
try:
self.e.executeScript(session, context, self.log, self.REL_SUCCESS, self.REL_FAILURE)
session.commit()
except Throwable, t:
self.log.error('{} failed to process due to {}; rolling back session', [self, t])
session.rollback(true)
raise t
#end classprocessor = JythonProcessor()
{code}
The logs :
{noformat}
2021-04-28 14:03:06,438 INFO [NiFi Web Server-93413] o.a.nifi.groups.StandardProcessGroup InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] added to StandardProcessGroup[identifier=46a63780-e64b-1f50-ffff-ffffe1229048,name=TEST_ISP]
2021-04-28 14:03:43,335 INFO [NiFi Web Server-93416] o.a.n.c.s.StandardProcessScheduler Starting InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] 2021-04-28 14:03:43,335 INFO [NiFi Web Server-93416] o.a.n.controller.StandardProcessorNode Starting InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] 2021-04-28 14:03:43,336 INFO [Timer-Driven Process Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run with 1 threads 021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.c.s.StandardProcessScheduler Stopping InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] 2021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.controller.StandardProcessorNode Stopping processor: InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] 2021-04-28 14:04:03,432 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run 021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.c.s.StandardProcessScheduler Stopping InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] 2021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.controller.StandardProcessorNode Stopping processor: InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] 2021-04-28 14:04:03,432 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run 2021-04-28 14:04:06,412 ERROR [Validate Components Thread-5] o.a.n.p.script.InvokeScriptedProcessor InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] Unable to load script: No processor was defined by the script.: javax.script.ScriptException: No processor was defined by the script. javax.script.ScriptException: No processor was defined by the script. at org.apache.nifi.processors.script.InvokeScriptedProcessor.reloadScript(InvokeScriptedProcessor.java:421) at org.apache.nifi.processors.script.InvokeScriptedProcessor.reloadScriptBody(InvokeScriptedProcessor.java:310) at org.apache.nifi.processors.script.InvokeScriptedProcessor.setup(InvokeScriptedProcessor.java:230) at org.apache.nifi.processors.script.InvokeScriptedProcessor.customValidate(InvokeScriptedProcessor.java:479) at org.apache.nifi.components.AbstractConfigurableComponent.validate(AbstractConfigurableComponent.java:145) at org.apache.nifi.controller.AbstractComponentNode.computeValidationErrors(AbstractComponentNode.java:609) at org.apache.nifi.controller.StandardProcessorNode.computeValidationErrors(StandardProcessorNode.java:1054) at org.apache.nifi.controller.AbstractComponentNode.performValidation(AbstractComponentNode.java:576) at org.apache.nifi.controller.AbstractComponentNode.performValidation(AbstractComponentNode.java:590) at org.apache.nifi.components.validation.StandardValidationTrigger.trigger(StandardValidationTrigger.java:52) at org.apache.nifi.components.validation.TriggerValidationTask.run(TriggerValidationTask.java:50) at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) {noformat}
> InvokeScriptedProcessor become invalid after stopped
> ----------------------------------------------------
>
> Key: NIFI-8494
> URL: https://issues.apache.org/jira/browse/NIFI-8494
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.13.2
> Environment: Ubuntu 20.04 LTS
> openjdk version "11.0.10" 2021-01-19
> Reporter: Thierry PRATS
> Priority: Trivial
> Labels: InvokeScriptedProcessor, nifi
> Fix For: 1.2.0, 1.11.3
>
>
> InvokeScriptedProcessor works well when started for the first time.
> The Processor become invalid after stopped and cannot be started anymore, also after change parameters. This message appears : Unable to load script: No processor was defined by the script.
> We have to delete and recreate the Processor to start it.
> The Processor is configured like this :
> Script Engine : python
> Script body :
> {code:java}
> from org.apache.nifi.processor import Processor, Relationship
> from java.lang import Throwableclass E():
> def __init__(self):
> pass
> def executeScript(self,session, context, log, REL_SUCCESS, REL_FAILURE):
> flowFile = session.get()
> if (flowFile != None):
> flowFile = session.putAttribute(flowFile, 'myAttr', 'myValue')
> session.transfer(flowFile, REL_SUCCESS)
> #end classclass JythonProcessor(Processor):
> REL_SUCCESS = Relationship.Builder().name("success").description('FlowFiles that were successfully processed are routed here').build()
> REL_FAILURE = Relationship.Builder().name("failure").description('FlowFiles that were not successfully processed are routed here').build()
> log = None
> e = E()
> def initialize(self,context):
> self.log = context.logger
> def getRelationships(self):
> return set([self.REL_SUCCESS, self.REL_FAILURE])
> def validate(self,context):
> pass
> def onPropertyModified(self,descriptor, oldValue, newValue):
> pass
> def getPropertyDescriptors(self):
> return []
> def getIdentifier(self):
> return None
> def onTrigger(self,context, sessionFactory):
> session = sessionFactory.createSession()
> try:
> self.e.executeScript(session, context, self.log, self.REL_SUCCESS, self.REL_FAILURE)
> session.commit()
> except Throwable, t:
> self.log.error('{} failed to process due to {}; rolling back session', [self, t])
> session.rollback(true)
> raise t
> #end classprocessor = JythonProcessor()
> {code}
> The logs :
> {noformat}
> 2021-04-28 14:03:06,438 INFO [NiFi Web Server-93413] o.a.nifi.groups.StandardProcessGroup InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] added to StandardProcessGroup[identifier=46a63780-e64b-1f50-ffff-ffffe1229048,name=TEST_ISP]
> 2021-04-28 14:03:43,335 INFO [NiFi Web Server-93416] o.a.n.c.s.StandardProcessScheduler Starting InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
> 2021-04-28 14:03:43,335 INFO [NiFi Web Server-93416] o.a.n.controller.StandardProcessorNode Starting InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
> 2021-04-28 14:03:43,336 INFO [Timer-Driven Process Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run with 1 threads 0
> 21-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.c.s.StandardProcessScheduler Stopping InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
> 2021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.controller.StandardProcessorNode Stopping processor: InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
> 2021-04-28 14:04:03,432 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run 0
> 21-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.c.s.StandardProcessScheduler Stopping InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
> 2021-04-28 14:04:03,432 INFO [NiFi Web Server-91830] o.a.n.controller.StandardProcessorNode Stopping processor: InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411]
> 2021-04-28 14:04:03,432 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] to run
> 2021-04-28 14:04:06,412 ERROR [Validate Components Thread-5] o.a.n.p.script.InvokeScriptedProcessor InvokeScriptedProcessor[id=46a64d6b-e64b-1f50-ffff-ffffc26b9411] Unable to load script: No processor was defined by the script.: javax.script.ScriptException: No processor was defined by the script. javax.script.ScriptException: No processor was defined by the script. at org.apache.nifi.processors.script.InvokeScriptedProcessor.reloadScript(InvokeScriptedProcessor.java:421) at org.apache.nifi.processors.script.InvokeScriptedProcessor.reloadScriptBody(InvokeScriptedProcessor.java:310) at org.apache.nifi.processors.script.InvokeScriptedProcessor.setup(InvokeScriptedProcessor.java:230) at org.apache.nifi.processors.script.InvokeScriptedProcessor.customValidate(InvokeScriptedProcessor.java:479) at org.apache.nifi.components.AbstractConfigurableComponent.validate(AbstractConfigurableComponent.java:145) at org.apache.nifi.controller.AbstractComponentNode.computeValidationErrors(AbstractComponentNode.java:609) at org.apache.nifi.controller.StandardProcessorNode.computeValidationErrors(StandardProcessorNode.java:1054) at org.apache.nifi.controller.AbstractComponentNode.performValidation(AbstractComponentNode.java:576) at org.apache.nifi.controller.AbstractComponentNode.performValidation(AbstractComponentNode.java:590) at org.apache.nifi.components.validation.StandardValidationTrigger.trigger(StandardValidationTrigger.java:52) at org.apache.nifi.components.validation.TriggerValidationTask.run(TriggerValidationTask.java:50) at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) {noformat}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)