You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Bharathkrishna Guruvayoor Murali (JIRA)" <ji...@apache.org> on 2018/04/09 17:57:00 UTC

[jira] [Commented] (HIVE-18928) HS2: Perflogger has a race condition

    [ https://issues.apache.org/jira/browse/HIVE-18928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430974#comment-16430974 ] 

Bharathkrishna Guruvayoor Murali commented on HIVE-18928:
---------------------------------------------------------

I was working on another Jira related to PerfLogger behaving differently with multiple threads (HIVE-19133)

I could see that PerfLogger is passed between background and handler threads here

[https://github.com/apache/hive/blob/a2394c5bf2e5b257a3a1b3e2bda4a25b92005315/service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java#L294]

Do you think that is the reason for this race condition as well?

> HS2: Perflogger has a race condition
> ------------------------------------
>
>                 Key: HIVE-18928
>                 URL: https://issues.apache.org/jira/browse/HIVE-18928
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Bharathkrishna Guruvayoor Murali
>            Priority: Major
>         Attachments: HIVE-18928.1.patch
>
>
> {code}
> Caused by: java.util.ConcurrentModificationException
>         at java.util.HashMap$HashIterator.nextNode(HashMap.java:1437) ~[?:1.8.0_112]
>         at java.util.HashMap$EntryIterator.next(HashMap.java:1471) ~[?:1.8.0_112]
>         at java.util.HashMap$EntryIterator.next(HashMap.java:1469) ~[?:1.8.0_112]
>         at java.util.AbstractCollection.toArray(AbstractCollection.java:196) ~[?:1.8.0_112]
>         at com.google.common.collect.Iterables.toArray(Iterables.java:316) ~[guava-19.0.jar:?]
>         at com.google.common.collect.ImmutableMap.copyOf(ImmutableMap.java:342) ~[guava-19.0.jar:?]
>         at com.google.common.collect.ImmutableMap.copyOf(ImmutableMap.java:327) ~[guava-19.0.jar:?]
>         at org.apache.hadoop.hive.ql.log.PerfLogger.getEndTimes(PerfLogger.java:218) ~[hive-common-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>         at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1561) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>         at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1498) ~[hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
>         at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:198) ~[hive-service-3.0.0.3.0.0.2-132.jar:3.0.0.3.0.0.2-132]
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)