You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Dharshana M Krishnamoorthy (Jira)" <ji...@apache.org> on 2021/03/04 10:40:00 UTC
[jira] [Created] (ATLAS-4185) [Atlas: Glossary Term Bulk Import]
Facing intermittent failures with Bulk Import
Dharshana M Krishnamoorthy created ATLAS-4185:
-------------------------------------------------
Summary: [Atlas: Glossary Term Bulk Import] Facing intermittent failures with Bulk Import
Key: ATLAS-4185
URL: https://issues.apache.org/jira/browse/ATLAS-4185
Project: Atlas
Issue Type: Bug
Components: atlas-core
Reporter: Dharshana M Krishnamoorthy
Attachments: Screenshot 2021-03-04 at 3.39.32 PM.png
Input used:
{code:java}
GlossaryName, TermName, ShortDescription, LongDescription, Examples, Abbreviation, Usage, AdditionalAttributes, TranslationTerms, ValidValuesFor, Synonyms, ReplacedBy, ValidValues, ReplacementTerms, SeeAlso, TranslatedTerms, IsA, Antonyms, Classifies, PreferredToTerms, PreferredTerms
glossaryBulkImport_2,BwTZ_1
glossaryBulkImport_2,BwTZ_2
glossaryBulkImport_2,BwTZ_3
glossaryBulkImport_2,BwTZ_4
glossaryBulkImport_2,BwTZ_5
glossaryBulkImport_2,BwTZ_6
glossaryBulkImport_2,BwTZ_7
glossaryBulkImport_2,BwTZ_8
glossaryBulkImport_2,BwTZ_9
glossaryBulkImport_2,BwTZ_10
glossaryBulkImport_2,BwTZ_11
glossaryBulkImport_2,BwTZ_12
glossaryBulkImport_2,BwTZ_13
glossaryBulkImport_2,BwTZ_14
glossaryBulkImport_2,BwTZ_15
glossaryBulkImport_2,BwTZ_16
glossaryBulkImport_2,BwTZ_17
glossaryBulkImport_2,BwTZ_18
glossaryBulkImport_2,BwTZ_19
glossaryBulkImport_2,BwTZ_20
glossaryBulkImport_2,BwTZ_21
glossaryBulkImport_2,BwTZ_22
glossaryBulkImport_2,BwTZ_23
glossaryBulkImport_2,BwTZ_24
glossaryBulkImport_2,BwTZ_25
glossaryBulkImport_2,BwTZ_26
glossaryBulkImport_2,BwTZ_27
glossaryBulkImport_2,BwTZ_28
glossaryBulkImport_2,BwTZ_29
glossaryBulkImport_2,BwTZ_30 {code}
While performing bulk import *AtlasBaseException* is thrown
{code:java}
2021-03-04 03:27:25,630 ERROR - [etp1527953000-472:] ~ URL not supported in HA mode: /api/atlas/admin/metrics (ActiveServerFilter:121)
2021-03-04 03:27:25,664 ERROR - [etp1527953000-130:] ~ URL not supported in HA mode: /api/atlas/admin/metrics (ActiveServerFilter:121)
2021-03-04 03:27:25,685 WARN - [etp1527953000-130:] ~ unable to return groups for user HTTP (ShellBasedUnixGroupsMapping:218)
/glossary\/import
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
at org.eclipse.jetty.server.Server.handle(Server.java:501)
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.atlas.exception.AtlasBaseException: Glossary term with qualifiedName BwTZ_1@glossaryBulkImport_2 already exists
at org.apache.atlas.glossary.GlossaryService.createTerm(GlossaryService.java:353)
at org.apache.atlas.glossary.GlossaryService.createGlossaryTerms(GlossaryService.java:1105)
... 114 more
2021-03-04 03:27:34,291 INFO - [etp1527953000-472:] ~ Logged into Atlas as = hrt_qa, by proxyUser = null (AtlasAuthenticationFilter$KerberosFilterChainWrapper:724)
2021-03-04 03:27:34,292 INFO - [etp1527953000-472:knox:GET/api/atlas/v2/glossary] ~ Request from authenticated user: knox, URL=/api/atlas/v2/glossary?doAs=hrt_qa (AtlasAuthenticationFilter$KerberosFilterChainWrapper:739) {code}
The same import succeeded and all the terms got created successfully.
!Screenshot 2021-03-04 at 3.39.32 PM.png|width=338,height=699!
If the term was already present, we might have hit https://issues.apache.org/jira/browse/ATLAS-4129 and none of the following terms would have created.
When same input was used with different set of 30 terms, it went through fine. This is seen once in a while.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)