[jira] [Created] (SPARK-13935) Other clients' connection hang up when someone do huge load

["Tao Wang (JIRA)" <ji...@apache.org>]

Tao Wang created SPARK-13935:
--------------------------------

             Summary: Other clients' connection hang up when someone do huge load
                 Key: SPARK-13935
                 URL: https://issues.apache.org/jira/browse/SPARK-13935
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.5.2, 1.5.0
            Reporter: Tao Wang
            Priority: Critical


We run a sql like "insert overwrite table store_returns partition (sr_returned_date) select xxxxxx" using beeline then it will block other beeline connection while invoke the Hive method via "ClientWrapper.loadDynamicPartitions".

The reason is that "withHiveState" will lock "clientLoader". Sadly when a new client comes, it will invoke "setConf" methods which is also sychronized with "clientLoader".

So the problem is that if the first sql took very long time to run, then all other client could not connect to thrift server successfully.

We tested on release 1.5.1. not sure if latest release has same issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org