You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "carlmartin (JIRA)" <ji...@apache.org> on 2016/08/08 03:30:20 UTC

[jira] [Created] (SPARK-16941) SparkSQLOperationManager shuold use synchronization map to store SessionHandle

carlmartin created SPARK-16941:
----------------------------------

             Summary: SparkSQLOperationManager shuold use synchronization map to store SessionHandle
                 Key: SPARK-16941
                 URL: https://issues.apache.org/jira/browse/SPARK-16941
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.0, 1.5.1
            Reporter: carlmartin
            Priority: Minor


When I had run a high concurrency sql query with thriefserver, I found this error without any previous error:
*Error: java.util.NoSuchElementException: key not found: SessionHandle [a2ea264f-d29d-43c4-842f-4e0f2a3cf877] (state=,code=0)*

So I check the code in *SparkSQLOperationManager*, and found the *Map(sessionToContexts and sessionToActivePool)* is not thread safe in it.
I found this error in version 1.5.1 but I think the last master branch will still have this error.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org