[jira] Commented: (HIVE-1539) Concurrent metastore threading problem

["Bennie Schut (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905455#action_12905455 ] 

Bennie Schut commented on HIVE-1539:
------------------------------------

JDOClassLoaderResolver doesn't seem thread safe. That's a bit of a surprise. I filed a bug with datanucleus: 
http://www.datanucleus.org/servlet/jira/browse/NUCCORE-559
I just made my own threadsafe version of the JDOClassLoaderResolver and am loading it to see if that fixes it. Will probably take a few days to be sure it got fixed.

> Concurrent metastore threading problem 
> ---------------------------------------
>
>                 Key: HIVE-1539
>                 URL: https://issues.apache.org/jira/browse/HIVE-1539
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.7.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>         Attachments: thread_dump_hanging.txt
>
>
> When running hive as a service and running a high number of queries concurrently I end up with multiple threads running at 100% cpu without any progress.
> Looking at these threads I notice this thread(484e):
> at org.apache.hadoop.hive.metastore.ObjectStore.getMTable(ObjectStore.java:598)
> But on a different thread(63a2):
> at org.apache.hadoop.hive.metastore.model.MStorageDescriptor.jdoReplaceField(MStorageDescriptor.java)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.