You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Sowmya Ramesh (JIRA)" <ji...@apache.org> on 2015/08/29 02:07:45 UTC
[jira] [Updated] (FALCON-1420) NPE in MetadataMappingService when
adding process instance executed
[ https://issues.apache.org/jira/browse/FALCON-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sowmya Ramesh updated FALCON-1420:
----------------------------------
Description:
FALCON-1091 changed value of property WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced the bug. For a process if there are no output feed MetadataMappingService should not go ahead to add output feed instance.
Message:
2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for context WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, operation=GENERATE, contextType=POST_PROCESSING, logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//, falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320, entityType=PROCESS, workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/, brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, subflowId=0000033-150727232450793-oozie-oozi-W@user-action, falconInPaths=IGNORE, userJMSNotificationEnabled=true, timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0, workflowUser=ambari-qa, workflowId=0000033-150727232450793-oozie-oozi-W, userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true, status=SUCCEEDED, contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json, userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00, feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}} (MetadataMappingService:261)
Exception:
{noformat}
2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener org.apache.falcon.metadata.MetadataMappingService (WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
at org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
at org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
at org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
... 11 more
Caused by: java.lang.NullPointerException
at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
at org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
at org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
... 14 more
{noformat}
was:
FALCON-1091 changed value of property WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced the bug. For a process if there are no output feed MetadataMappingService should not go ahead to add output feed instance.
{noformat}
2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for context WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, operation=GENERATE, contextType=POST_PROCESSING, logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//, falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320, entityType=PROCESS, workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/, brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, subflowId=0000033-150727232450793-oozie-oozi-W@user-action, falconInPaths=IGNORE, userJMSNotificationEnabled=true, timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0, workflowUser=ambari-qa, workflowId=0000033-150727232450793-oozie-oozi-W, userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true, status=SUCCEEDED, contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json, userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00, feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}} (MetadataMappingService:261)
{noformat}
Exception:
{noformat}
2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener org.apache.falcon.metadata.MetadataMappingService (WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
at org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
at org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
at org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
... 11 more
Caused by: java.lang.NullPointerException
at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
at org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
at org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
... 14 more
{noformat}
> NPE in MetadataMappingService when adding process instance executed
> -------------------------------------------------------------------
>
> Key: FALCON-1420
> URL: https://issues.apache.org/jira/browse/FALCON-1420
> Project: Falcon
> Issue Type: Bug
> Affects Versions: 0.7
> Reporter: Sowmya Ramesh
>
> FALCON-1091 changed value of property WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced the bug. For a process if there are no output feed MetadataMappingService should not go ahead to add output feed instance.
> Message:
> 2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for context WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, operation=GENERATE, contextType=POST_PROCESSING, logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//, falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320, entityType=PROCESS, workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/, brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, subflowId=0000033-150727232450793-oozie-oozi-W@user-action, falconInPaths=IGNORE, userJMSNotificationEnabled=true, timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0, workflowUser=ambari-qa, workflowId=0000033-150727232450793-oozie-oozi-W, userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true, status=SUCCEEDED, contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json, userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00, feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}} (MetadataMappingService:261)
> Exception:
> {noformat}
> 2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener org.apache.falcon.metadata.MetadataMappingService (WorkflowJobEndNotificationService:104)
> org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.NullPointerException
> at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
> at org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
> at org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
> at org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
> at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
> at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
> at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
> at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
> at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
> at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
> at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
> ... 11 more
> Caused by: java.lang.NullPointerException
> at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
> at org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
> at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
> at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
> at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
> at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
> at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
> at org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
> at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
> at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
> at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
> ... 14 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)