You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@falcon.apache.org by Margus Roo <ma...@roo.ee> on 2016/07/26 13:30:18 UTC
Cluster entity vertex must exist
Hi
I am using falcon 0.6.1
When I am trying to submit process or feed I am getting error:
Cluster entity vertex must exist
In case I just restarted falcon server then I can submit process or feed:
[margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml
falcon/default/Submit successful (process) sign--web3
But after I deleted process:
[margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name sign--web3
falcon/default/sign--web3(process) removed successfully (KILLED in ENGINE)
And I try to submit again then I am getting:
[margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml
ERROR: Bad
Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
java.lang.RuntimeException: java.lang.IllegalStateException: Cluster
entity vertex must exist: Cluster2
and in log:
2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest RemoteUser
is null (Servlets:47)
2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest user.name
param value is margusja (Servlets:53)
2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3 -
b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest RemoteUser
is null (Servlets:47)
2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3 -
b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest user.name
param value is margusja (Servlets:53)
2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest RemoteUser
is falcon (Servlets:47)
2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Logging in falcon (CurrentUser:65)
2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Request from authenticated user: falcon,
URL=/api/entities/submit/process, doAs user: null
(FalconAuthenticationFilter:185)
2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Parsed Entity: sign--web3 (EntityParser:95)
2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Parsed Entity: sign--web3 (EntityParser:95)
2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Creating FS for the login user falcon, impersonation not required
(HadoopClientFactory:191)
2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Adding lineage for entity: sign--web3, type: PROCESS
(MetadataMappingService:209)
2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Illegal State: Cluster entity vertex must exist for Cluster2
(EntityRelationshipGraphBuilder:173)
2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Illegal State: Cluster entity vertex must exist for Cluster2
(EntityRelationshipGraphBuilder:173)
2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Illegal State: Cluster entity vertex must exist for Cluster2
(EntityRelationshipGraphBuilder:173)
2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Unable to persist entity object (AbstractEntityManager:198)
org.apache.falcon.FalconException: java.lang.RuntimeException:
java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2
at
org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
at
org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
at
org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
at
org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
at
org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
at
org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
at
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
at
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
at
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
at
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
at
org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
at
org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
at
org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
at
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
at
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
...
Caused by: java.lang.RuntimeException: java.lang.IllegalStateException:
Cluster entity vertex must exist: Cluster2
at
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
at
com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
at
com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
at
org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
... 64 more
Caused by: java.lang.IllegalStateException: Cluster entity vertex must
exist: Cluster2
at
org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
at
org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
at
org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
at
org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
at
org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
at
com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
... 67 more
2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Action failed: Bad Request
Error: java.lang.RuntimeException: java.lang.IllegalStateException:
Cluster entity vertex must exist: Cluster2 (FalconWebException:83)
2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ Action failed: Bad Request
Error:
default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
java.lang.RuntimeException: java.lang.IllegalStateException: Cluster
entity vertex must exist: Cluster2
(FalconWebException:83)
2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3 -
1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
~ {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status:
FAILED, Time-taken:182944401 ns} (METRIC:38)
~
Any hints?
--
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780
Re: Cluster entity vertex must exist
Posted by Margus Roo <ma...@roo.ee>.
Great! It helped!
That is the impact I hoped from userlist :)
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780
On 27/07/16 11:27, Pallavi Rao wrote:
> Margus,
> Looks like the problem you are facing is similar to what is reported
> in FALCON-1955 <https://issues.apache.org/jira/browse/FALCON-1955>.
> And, the workaround is similar too. The problem goes away on restart,
> but, comes back later. Guess, will need to dig deeper for a fix.
>
> If you are NOT using any of the metadata APIs of Falcon (/falcon
> metadata/ commands of the CLI), you can disable the service in
> startup.properties temporarily till we have a fix for FALCON-1955
> <https://issues.apache.org/jira/browse/FALCON-1955>, so that your
> entity submission is not blocked on this.
>
> On Wed, Jul 27, 2016 at 1:35 PM, Margus Roo <margus@roo.ee
> <ma...@roo.ee>> wrote:
>
> As I understand thous lines will define db in startup.properties file
>
> *.falcon.graph.storage.backend=berkeleyje
> *.falcon.graph.storage.directory=/tmp/hadoop/falcon/data/lineage/graphdb
>
> in directory /tmp/hadoop/falcon/data/lineage/graphdb I have files
>
> -rw-r--r-- 1 falcon hadoop 65K Jul 27 11:01 00000000.jdb
> -rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.info.0
> -rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.info.0.lck
> -rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.lck
>
> Is it possible to connect using some utilit and check what is
> wrong inside? I can delete /tmp/hadoop/falcon/data/lineage/graphdb
> and restart falcon but after some time the problem is back.
>
> I can create a new Cluster in example Cluster3 and it works
> without problems. But I have loads of feeds and processes are
> working with Cluster2 (the problematic).
>
> Is there any workaround to fix Cluster2 ?
>
>
> Margus (margusja) Roo
> http://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
> On 26/07/16 16:34, Ajay Yadav wrote:
>> Is it possible for you to try the latest stable release 0.9?
>>
>> Around 0.6/0.6.1 graph db (used by Apache Falcon to store
>> instances) of Apache Falcon had several issues so I will strongly
>> recommend upgrading.
>>
>>
>>
>> On Tue, 26 Jul 2016 at 19:00 Margus Roo <margus@roo.ee
>> <ma...@roo.ee>> wrote:
>>
>> Hi
>>
>> I am using falcon 0.6.1
>>
>> When I am trying to submit process or feed I am getting error:
>>
>> Cluster entity vertex must exist
>>
>> In case I just restarted falcon server then I can submit
>> process or feed:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process
>> -file web3.xml
>> falcon/default/Submit successful (process) sign--web3
>>
>> But after I deleted process:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process
>> -name sign--web3
>> falcon/default/sign--web3(process) removed successfully
>> (KILLED in ENGINE)
>>
>> And I try to submit again then I am getting:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process
>> -file web3.xml
>> ERROR: Bad
>> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2
>>
>> and in log:
>>
>> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
>> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
>> RemoteUser is null (Servlets:47)
>> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
>> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
>> user.name <http://user.name> param value is margusja
>> (Servlets:53)
>> 2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3
>> - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
>> RemoteUser is null (Servlets:47)
>> 2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3
>> - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
>> user.name <http://user.name> param value is margusja
>> (Servlets:53)
>> 2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3
>> - 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest
>> RemoteUser is falcon (Servlets:47)
>> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Logging in falcon (CurrentUser:65)
>> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Request from authenticated user: falcon,
>> URL=/api/entities/submit/process, doAs user: null
>> (FalconAuthenticationFilter:185)
>> 2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Parsed Entity: sign--web3 (EntityParser:95)
>> 2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Parsed Entity: sign--web3 (EntityParser:95)
>> 2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Creating FS for the login user falcon, impersonation not
>> required (HadoopClientFactory:191)
>> 2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Persisted configuration PROCESS/sign--web3
>> (ConfigurationStore:371)
>> 2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding lineage for entity: sign--web3, type: PROCESS
>> (MetadataMappingService:209)
>> 2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3
>> (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for
>> Cluster2 (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3
>> (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for
>> Cluster2 (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3
>> (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for
>> Cluster2 (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Unable to persist entity object (AbstractEntityManager:198)
>> org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2
>> at
>> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
>> at
>> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
>> at
>> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
>> at
>> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
>> at
>> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
>> at
>> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at
>> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
>> at
>> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
>> at
>> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at
>> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>> at
>> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>> at
>> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>> at
>> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>> at
>> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>>
>> ...
>>
>> Caused by: java.lang.RuntimeException:
>> java.lang.IllegalStateException: Cluster entity vertex must
>> exist: Cluster2
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
>> at
>> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
>> ... 64 more
>> Caused by: java.lang.IllegalStateException: Cluster entity
>> vertex must exist: Cluster2
>> at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
>> at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
>> at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
>> at
>> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
>> at
>> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
>> ... 67 more
>> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Action failed: Bad Request
>> Error: java.lang.RuntimeException:
>> java.lang.IllegalStateException: Cluster entity vertex must
>> exist: Cluster2 (FalconWebException:83)
>> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Action failed: Bad Request
>> Error:
>> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2
>> (FalconWebException:83)
>> 2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3
>> -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process},
>> Status: FAILED, Time-taken:182944401 ns} (METRIC:38)
>> ~
>>
>>
>> Any hints?
>>
>>
>>
>> --
>> Margus (margusja) Roo
>> http://margus.roo.ee
>> skype: margusja
>> +372 51 48 780
>>
>
>
>
> _____________________________________________________________
> The information contained in this communication is intended solely for
> the use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally
> privileged information. If you are not the intended recipient you are
> hereby notified that any disclosure, copying, distribution or taking
> any action in reliance on the contents of this information is strictly
> prohibited and may be unlawful. If you have received this
> communication in error, please notify us immediately by responding to
> this email and then delete it from your system. The firm is neither
> liable for the proper and complete transmission of the information
> contained in this communication nor for any delay in its receipt.
Re: Cluster entity vertex must exist
Posted by Pallavi Rao <pa...@inmobi.com>.
Margus,
Looks like the problem you are facing is similar to what is reported in
FALCON-1955 <https://issues.apache.org/jira/browse/FALCON-1955>. And, the
workaround is similar too. The problem goes away on restart, but, comes
back later. Guess, will need to dig deeper for a fix.
If you are NOT using any of the metadata APIs of Falcon (*falcon metadata*
commands of the CLI), you can disable the service in startup.properties
temporarily till we have a fix for FALCON-1955
<https://issues.apache.org/jira/browse/FALCON-1955>, so that your entity
submission is not blocked on this.
On Wed, Jul 27, 2016 at 1:35 PM, Margus Roo <ma...@roo.ee> wrote:
> As I understand thous lines will define db in startup.properties file
>
> *.falcon.graph.storage.backend=berkeleyje
> *.falcon.graph.storage.directory=/tmp/hadoop/falcon/data/lineage/graphdb
>
> in directory /tmp/hadoop/falcon/data/lineage/graphdb I have files
>
> -rw-r--r-- 1 falcon hadoop 65K Jul 27 11:01 00000000.jdb
> -rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.info.0
> -rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.info.0.lck
> -rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.lck
>
> Is it possible to connect using some utilit and check what is wrong
> inside? I can delete /tmp/hadoop/falcon/data/lineage/graphdb and restart
> falcon but after some time the problem is back.
>
> I can create a new Cluster in example Cluster3 and it works without
> problems. But I have loads of feeds and processes are working with Cluster2
> (the problematic).
>
> Is there any workaround to fix Cluster2 ?
>
>
> Margus (margusja) Roohttp://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
> On 26/07/16 16:34, Ajay Yadav wrote:
>
> Is it possible for you to try the latest stable release 0.9?
>
> Around 0.6/0.6.1 graph db (used by Apache Falcon to store instances) of
> Apache Falcon had several issues so I will strongly recommend upgrading.
>
>
>
> On Tue, 26 Jul 2016 at 19:00 Margus Roo <ma...@roo.ee> wrote:
>
>> Hi
>>
>> I am using falcon 0.6.1
>>
>> When I am trying to submit process or feed I am getting error:
>>
>> Cluster entity vertex must exist
>>
>> In case I just restarted falcon server then I can submit process or feed:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
>> web3.xml
>> falcon/default/Submit successful (process) sign--web3
>>
>> But after I deleted process:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name
>> sign--web3
>> falcon/default/sign--web3(process) removed successfully (KILLED in ENGINE)
>>
>> And I try to submit again then I am getting:
>>
>> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
>> web3.xml
>> ERROR: Bad
>> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
>> vertex must exist: Cluster2
>>
>> and in log:
>>
>> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
>> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest RemoteUser is
>> null (Servlets:47)
>> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
>> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest user.name
>> param value is margusja (Servlets:53)
>> 2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3 -
>> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest RemoteUser is
>> null (Servlets:47)
>> 2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3 -
>> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest user.name
>> param value is margusja (Servlets:53)
>> 2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest RemoteUser is
>> falcon (Servlets:47)
>> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Logging in falcon (CurrentUser:65)
>> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Request from authenticated user: falcon,
>> URL=/api/entities/submit/process, doAs user: null
>> (FalconAuthenticationFilter:185)
>> 2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Parsed Entity: sign--web3 (EntityParser:95)
>> 2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Parsed Entity: sign--web3 (EntityParser:95)
>> 2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Creating FS for the login user falcon, impersonation not required
>> (HadoopClientFactory:191)
>> 2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
>> 2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding lineage for entity: sign--web3, type: PROCESS
>> (MetadataMappingService:209)
>> 2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for Cluster2
>> (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for Cluster2
>> (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
>> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Illegal State: Cluster entity vertex must exist for Cluster2
>> (EntityRelationshipGraphBuilder:173)
>> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Unable to persist entity object (AbstractEntityManager:198)
>> org.apache.falcon.FalconException: java.lang.RuntimeException:
>> java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2
>> at
>> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
>> at
>> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
>> at
>> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
>> at
>> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
>> at
>> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
>> at
>> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at
>> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
>> at
>> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
>> at
>> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
>> at
>> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:497)
>> at
>> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>> at
>> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>> at
>> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>> at
>> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>> at
>> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>>
>> ...
>>
>> Caused by: java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
>> at
>> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
>> ... 64 more
>> Caused by: java.lang.IllegalStateException: Cluster entity vertex must
>> exist: Cluster2
>> at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
>> at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
>> at
>> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
>> at
>> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
>> at
>> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
>> at
>> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
>> ... 67 more
>> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Action failed: Bad Request
>> Error: java.lang.RuntimeException: java.lang.IllegalStateException:
>> Cluster entity vertex must exist: Cluster2 (FalconWebException:83)
>> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ Action failed: Bad Request
>> Error:
>> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
>> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
>> vertex must exist: Cluster2
>> (FalconWebException:83)
>> 2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3 -
>> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
>> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status:
>> FAILED, Time-taken:182944401 ns} (METRIC:38)
>> ~
>>
>>
>> Any hints?
>>
>>
>>
>> --
>> Margus (margusja) Roohttp://margus.roo.ee
>> skype: margusja
>> +372 51 48 780
>>
>>
>
--
_____________________________________________________________
The information contained in this communication is intended solely for the
use of the individual or entity to whom it is addressed and others
authorized to receive it. It may contain confidential or legally privileged
information. If you are not the intended recipient you are hereby notified
that any disclosure, copying, distribution or taking any action in reliance
on the contents of this information is strictly prohibited and may be
unlawful. If you have received this communication in error, please notify
us immediately by responding to this email and then delete it from your
system. The firm is neither liable for the proper and complete transmission
of the information contained in this communication nor for any delay in its
receipt.
Re: Cluster entity vertex must exist
Posted by Margus Roo <ma...@roo.ee>.
As I understand thous lines will define db in startup.properties file
*.falcon.graph.storage.backend=berkeleyje
*.falcon.graph.storage.directory=/tmp/hadoop/falcon/data/lineage/graphdb
in directory /tmp/hadoop/falcon/data/lineage/graphdb I have files
-rw-r--r-- 1 falcon hadoop 65K Jul 27 11:01 00000000.jdb
-rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.info.0
-rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.info.0.lck
-rw-r--r-- 1 falcon hadoop 0 Jul 26 14:25 je.lck
Is it possible to connect using some utilit and check what is wrong
inside? I can delete /tmp/hadoop/falcon/data/lineage/graphdb and restart
falcon but after some time the problem is back.
I can create a new Cluster in example Cluster3 and it works without
problems. But I have loads of feeds and processes are working with
Cluster2 (the problematic).
Is there any workaround to fix Cluster2 ?
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780
On 26/07/16 16:34, Ajay Yadav wrote:
> Is it possible for you to try the latest stable release 0.9?
>
> Around 0.6/0.6.1 graph db (used by Apache Falcon to store instances)
> of Apache Falcon had several issues so I will strongly recommend
> upgrading.
>
>
>
> On Tue, 26 Jul 2016 at 19:00 Margus Roo <margus@roo.ee
> <ma...@roo.ee>> wrote:
>
> Hi
>
> I am using falcon 0.6.1
>
> When I am trying to submit process or feed I am getting error:
>
> Cluster entity vertex must exist
>
> In case I just restarted falcon server then I can submit process
> or feed:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
> web3.xml
> falcon/default/Submit successful (process) sign--web3
>
> But after I deleted process:
>
> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name
> sign--web3
> falcon/default/sign--web3(process) removed successfully (KILLED in
> ENGINE)
>
> And I try to submit again then I am getting:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
> web3.xml
> ERROR: Bad
> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2
>
> and in log:
>
> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
> RemoteUser is null (Servlets:47)
> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
> user.name <http://user.name> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
> RemoteUser is null (Servlets:47)
> 2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
> user.name <http://user.name> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest
> RemoteUser is falcon (Servlets:47)
> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Logging in falcon (CurrentUser:65)
> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Request from authenticated user: falcon,
> URL=/api/entities/submit/process, doAs user: null
> (FalconAuthenticationFilter:185)
> 2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Creating FS for the login user falcon, impersonation not
> required (HadoopClientFactory:191)
> 2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
> 2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding lineage for entity: sign--web3, type: PROCESS
> (MetadataMappingService:209)
> 2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3
> (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3
> (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3
> (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Unable to persist entity object (AbstractEntityManager:198)
> org.apache.falcon.FalconException: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist:
> Cluster2
> at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
> at
> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
> at
> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
> at
> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
> at
> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
> at
> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
> at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
> at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> at
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>
> ...
>
> Caused by: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist:
> Cluster2
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
> at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
> ... 64 more
> Caused by: java.lang.IllegalStateException: Cluster entity vertex
> must exist: Cluster2
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
> at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
> at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
> ... 67 more
> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist:
> Cluster2 (FalconWebException:83)
> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error:
> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2
> (FalconWebException:83)
> 2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process},
> Status: FAILED, Time-taken:182944401 ns} (METRIC:38)
> ~
>
>
> Any hints?
>
>
>
> --
> Margus (margusja) Roo
> http://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
Re: Cluster entity vertex must exist
Posted by Margus Roo <ma...@roo.ee>.
Version 0.6 came from Hortonworks ( HDP-2.3.4.0) But if there is no
solution I will try upgrade.
Margus (margusja) Roo
http://margus.roo.ee
skype: margusja
+372 51 48 780
On 26/07/16 16:34, Ajay Yadav wrote:
> Is it possible for you to try the latest stable release 0.9?
>
> Around 0.6/0.6.1 graph db (used by Apache Falcon to store instances)
> of Apache Falcon had several issues so I will strongly recommend
> upgrading.
>
>
>
> On Tue, 26 Jul 2016 at 19:00 Margus Roo <margus@roo.ee
> <ma...@roo.ee>> wrote:
>
> Hi
>
> I am using falcon 0.6.1
>
> When I am trying to submit process or feed I am getting error:
>
> Cluster entity vertex must exist
>
> In case I just restarted falcon server then I can submit process
> or feed:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
> web3.xml
> falcon/default/Submit successful (process) sign--web3
>
> But after I deleted process:
>
> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name
> sign--web3
> falcon/default/sign--web3(process) removed successfully (KILLED in
> ENGINE)
>
> And I try to submit again then I am getting:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file
> web3.xml
> ERROR: Bad
> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2
>
> and in log:
>
> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
> RemoteUser is null (Servlets:47)
> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest
> user.name <http://user.name> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
> RemoteUser is null (Servlets:47)
> 2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest
> user.name <http://user.name> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest
> RemoteUser is falcon (Servlets:47)
> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Logging in falcon (CurrentUser:65)
> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Request from authenticated user: falcon,
> URL=/api/entities/submit/process, doAs user: null
> (FalconAuthenticationFilter:185)
> 2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Creating FS for the login user falcon, impersonation not
> required (HadoopClientFactory:191)
> 2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
> 2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding lineage for entity: sign--web3, type: PROCESS
> (MetadataMappingService:209)
> 2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3
> (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3
> (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3
> (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Unable to persist entity object (AbstractEntityManager:198)
> org.apache.falcon.FalconException: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist:
> Cluster2
> at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
> at
> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
> at
> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
> at
> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
> at
> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
> at
> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
> at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
> at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> at
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>
> ...
>
> Caused by: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist:
> Cluster2
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
> at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
> ... 64 more
> Caused by: java.lang.IllegalStateException: Cluster entity vertex
> must exist: Cluster2
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
> at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
> at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
> ... 67 more
> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist:
> Cluster2 (FalconWebException:83)
> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error:
> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2
> (FalconWebException:83)
> 2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process},
> Status: FAILED, Time-taken:182944401 ns} (METRIC:38)
> ~
>
>
> Any hints?
>
>
>
> --
> Margus (margusja) Roo
> http://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
Re: Cluster entity vertex must exist
Posted by Ajay Yadav <aj...@gmail.com>.
Is it possible for you to try the latest stable release 0.9?
Around 0.6/0.6.1 graph db (used by Apache Falcon to store instances) of
Apache Falcon had several issues so I will strongly recommend upgrading.
On Tue, 26 Jul 2016 at 19:00 Margus Roo <ma...@roo.ee> wrote:
> Hi
>
> I am using falcon 0.6.1
>
> When I am trying to submit process or feed I am getting error:
>
> Cluster entity vertex must exist
>
> In case I just restarted falcon server then I can submit process or feed:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml
> falcon/default/Submit successful (process) sign--web3
>
> But after I deleted process:
>
> [margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name
> sign--web3
> falcon/default/sign--web3(process) removed successfully (KILLED in ENGINE)
>
> And I try to submit again then I am getting:
>
> [margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml
> ERROR: Bad
> Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
> vertex must exist: Cluster2
>
> and in log:
>
> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest RemoteUser is
> null (Servlets:47)
> 2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 -
> aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest user.name
> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest RemoteUser is
> null (Servlets:47)
> 2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3 -
> b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest user.name
> param value is margusja (Servlets:53)
> 2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest RemoteUser is
> falcon (Servlets:47)
> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Logging in falcon (CurrentUser:65)
> 2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Request from authenticated user: falcon,
> URL=/api/entities/submit/process, doAs user: null
> (FalconAuthenticationFilter:185)
> 2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Parsed Entity: sign--web3 (EntityParser:95)
> 2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Creating FS for the login user falcon, impersonation not required
> (HadoopClientFactory:191)
> 2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)
> 2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding lineage for entity: sign--web3, type: PROCESS
> (MetadataMappingService:209)
> 2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)
> 2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Illegal State: Cluster entity vertex must exist for Cluster2
> (EntityRelationshipGraphBuilder:173)
> 2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Unable to persist entity object (AbstractEntityManager:198)
> org.apache.falcon.FalconException: java.lang.RuntimeException:
> java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2
> at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)
> at
> org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)
> at
> org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)
> at
> org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)
> at
> org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)
> at
> org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)
> at
> org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
> at
> org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
> at
> org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
> at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> at
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>
> ...
>
> Caused by: java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
> at
> com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
> at
> org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)
> ... 64 more
> Caused by: java.lang.IllegalStateException: Cluster entity vertex must
> exist: Cluster2
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)
> at
> org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)
> at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)
> at
> org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)
> at
> com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
> ... 67 more
> 2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error: java.lang.RuntimeException: java.lang.IllegalStateException:
> Cluster entity vertex must exist: Cluster2 (FalconWebException:83)
> 2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ Action failed: Bad Request
> Error:
> default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException:
> java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity
> vertex must exist: Cluster2
> (FalconWebException:83)
> 2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3 -
> 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process]
> ~ {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status:
> FAILED, Time-taken:182944401 ns} (METRIC:38)
> ~
>
>
> Any hints?
>
>
>
> --
> Margus (margusja) Roohttp://margus.roo.ee
> skype: margusja
> +372 51 48 780
>
>