[SQL]Proper use of spark.sql.thriftserver.scheduler.pool

[Yana Kadiyska <ya...@gmail.com>]

Hi sparkers,

I'm trying to use  spark.sql.thriftserver.scheduler.pool for the first time
(earlier I was stuck because of
https://issues.apache.org/jira/browse/SPARK-4037)

I have two pools setup:
[image: Inline image 1]
and would like to issue a query against the "low priority" pool.

I am doing this (tried both from beeline and a different JDBC client,
output below is from beeline):

 SET spark.sql.thriftserver.scheduler.pool=CRON;
+---------------------------------------------+
|                                             |
+---------------------------------------------+
| spark.sql.thriftserver.scheduler.pool=CRON  |
+---------------------------------------------+
1 row selected (0.09 seconds)
1: jdbc:hive2://myip:10001> select count(*) from mytable;

The query executes OK but does not execute against the CRON pool...Am I
misusing this setting (my goal is to be able to allocate a large set of
cores to Thriftserver but separate out to a "low-priority" pool some
housekeeping tasks)

Thanks for any tips.