You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/11/09 20:59:00 UTC
[jira] [Commented] (ATLAS-4470) Creating Hive_Process entity is
getting failed due to null startTime
[ https://issues.apache.org/jira/browse/ATLAS-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441357#comment-17441357 ]
ASF subversion and git services commented on ATLAS-4470:
--------------------------------------------------------
Commit e4cfb57d4324079af51c488cae28353689a25f1b in atlas's branch refs/heads/branch-2.0 from Radhika Kundam
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=e4cfb57 ]
ATLAS-4470: Creating Hive_Process entity is getting failed due to empty/null startTime
Signed-off-by: Sidharth Mishra <si...@apache.org>
(cherry picked from commit 10a7c76c8e07a60c65109391e76970714f2122e2)
> Creating Hive_Process entity is getting failed due to null startTime
> --------------------------------------------------------------------
>
> Key: ATLAS-4470
> URL: https://issues.apache.org/jira/browse/ATLAS-4470
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Reporter: Radhika Kundam
> Assignee: Radhika Kundam
> Priority: Major
>
> tIn few scenarios of creation Hive_process entity is failed with below error and this is expected because startTime is mandatory attribute for hive_process entity. This issue is mainly because Hive is not sending startTime in few scenarios and since this issue is inconsistent and not sure of the pattern when Hive is sending empty startTime.
> While processing Hive context Atlas initially assign currentTimeStamp to startTime and then further it proceeds to get startTime from Hive Context and if that value is empty the mentioned issue is occurring. So to avoid that we can have extra check at Atlas to consider StartTime from Hive Context only if it's not empty.
> 2021-10-13 14:40:00,503 ERROR - [NotificationHookConsumer thread-0:] ~ graph rollback due to exception AtlasBaseException:Invalid instance creation/updation parameters passed : hive_process.startTime: mandatory attribute value missing in type hive_process (GraphTransactionInterceptor:169)2021-10-13 14:40:00,504 WARN - [NotificationHookConsumer thread-0:] ~ Error handling message (NotificationHookConsumer:752)org.apache.atlas.exception.AtlasBaseException: Invalid instance creation/updation parameters passed : hive_process.startTime: mandatory attribute value missing in type hive_process at org.apache.atlas.repository.store.graph.v2.AtlasEntityGraphDiscoveryV2.validateAndNormalize(AtlasEntityGraphDiscoveryV2.java:97) at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.preCreateOrUpdate(AtlasEntityStoreV2.java:899) at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:744) at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:275) at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$FastClassBySpringCGLIB$$6861dca9.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) at org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671) at org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$EnhancerBySpringCGLIB$$ff9731b1.createOrUpdate(<generated>) at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.createOrUpdate(NotificationHookConsumer.java:822) at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:671) at org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.doWork(NotificationHookConsumer.java:524) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82) at
--
This message was sent by Atlassian Jira
(v8.20.1#820001)