You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Madhan Neethiraj (Jira)" <ji...@apache.org> on 2020/05/18 02:35:00 UTC

[jira] [Resolved] (ATLAS-464) HiveHook execution threads could crash due to a race condition

     [ https://issues.apache.org/jira/browse/ATLAS-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Madhan Neethiraj resolved ATLAS-464.
------------------------------------
    Resolution: Abandoned

bq. Each thread on initialization tries to check and register the Hive data model
This refers to earlier Atlas code which doesn't exist any more. Data models are not registered by hooks any more; they are loaded by Atlas server during initialization.

> HiveHook execution threads could crash due to a race condition
> --------------------------------------------------------------
>
>                 Key: ATLAS-464
>                 URL: https://issues.apache.org/jira/browse/ATLAS-464
>             Project: Atlas
>          Issue Type: Bug
>            Reporter: Hemanth Yamijala
>            Priority: Major
>         Attachments: hive-hook-exception.txt
>
>
> Enable Atlas HiveHook in Hive with default config and an empty Atlas DB. Fire queries fast to create tables - for e.g. by having table definitions in a file and executing with hive -f <filename>. In the hive logs, we can see exceptions that hive types are being redefined. The executor threads crash due to this exception. Sample of the exception log (will attach the full log separately):
> {code}
> 2016-02-02 16:08:15,152 INFO  [Atlas Logger 4]: hook.HiveHook (HiveHook.java:run(190)) - Atlas hook failed
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE failed with status 400(Bad Request) Response Body ({"error":"Redefinition of type hive_object_type not supported","stackTrace":"org.apache.atlas.AtlasException: Redefinition of type hive_object_type not supported\n\tat org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.step1(TypeSystem.java:348)\n\tat org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.defineTypes(TypeSystem.java:566)\n\tat org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.defineTypes(TypeSystem.java:562)\n\tat org.apache.atlas.typesystem.types.TypeSystem.defineTypes(TypeSystem.java:255)\n\tat org.apache.atlas.typesystem.types.TypeSystem.defineTypes(TypeSystem.java:247)\n\tat org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:173)\n\t
> {code}
> Thanks, [~ssainath] for finding this bug.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)