[jira] [Commented] (DRILL-4146) Concurrent queries hang in planner in ReflectiveRelMetadataProvider

["Aman Sinha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032862#comment-15032862 ] 

Aman Sinha commented on DRILL-4146:
-----------------------------------

I have verified on a private branch that applying the Calcite fix resolves the issue, so I will go ahead and merge it.  Marking this for 1.4.0. 

> Concurrent queries hang in planner in ReflectiveRelMetadataProvider
> -------------------------------------------------------------------
>
>                 Key: DRILL-4146
>                 URL: https://issues.apache.org/jira/browse/DRILL-4146
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 1.3.0
>            Reporter: Aman Sinha
>            Assignee: Aman Sinha
>
> At concurrency levels of 30 or more for certain workloads we have seen queries hang in the planning phase in Calcite.  The top of the jstack is shown below: 
> {noformat}
> "29b47a17-6ef3-4b7f-98e7-a7c1a702c32f:foreman" daemon prio=10 tid=0x00007f55484a1800 nid=0x289a runnable [0x00007f54b4369000]
>    java.lang.Thread.State: RUNNABLE
>         at java.util.HashMap.getEntry(HashMap.java:465)
>         at java.util.HashMap.get(HashMap.java:417)
>         at org.apache.calcite.rel.metadata.ReflectiveRelMetadataProvider.apply(ReflectiveRelMetadataProvider.java:251)
>         at org.apache.calcite.rel.metadata.ChainedRelMetadataProvider.apply(ChainedRelMetadataProvider.java:60)
>         at org.apache.calcite.rel.metadata.ChainedRelMetadataProvider.apply(ChainedRelMetadataProvider.java:60)
> {noformat}
>  
> After some investigations, we found that this issue was actually addressed by CALCITE-874 (ReflectiveRelMetadataProvider is not thread-safe).   This JIRA is a placeholder to merge that Calcite fix since Drill is currently not up-to-date with Calcite and there is an immediate need for running queries in a high concurrency environment. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)