You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by liufengdb <gi...@git.apache.org> on 2018/01/18 18:18:23 UTC
[GitHub] spark pull request #20025: [SPARK-22837][SQL]Session timeout checker does no...
Github user liufengdb commented on a diff in the pull request:
https://github.com/apache/spark/pull/20025#discussion_r162426604
--- Diff: sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/SessionManager.java ---
@@ -79,35 +75,19 @@ public synchronized void init(HiveConf hiveConf) {
initOperationLogRootDir();
}
createBackgroundOperationPool();
- addService(operationManager);
- super.init(hiveConf);
- }
-
- private void createBackgroundOperationPool() {
- int poolSize = hiveConf.getIntVar(ConfVars.HIVE_SERVER2_ASYNC_EXEC_THREADS);
- LOG.info("HiveServer2: Background operation thread pool size: " + poolSize);
- int poolQueueSize = hiveConf.getIntVar(ConfVars.HIVE_SERVER2_ASYNC_EXEC_WAIT_QUEUE_SIZE);
- LOG.info("HiveServer2: Background operation thread wait queue size: " + poolQueueSize);
- long keepAliveTime = HiveConf.getTimeVar(
- hiveConf, ConfVars.HIVE_SERVER2_ASYNC_EXEC_KEEPALIVE_TIME, TimeUnit.SECONDS);
- LOG.info(
- "HiveServer2: Background operation thread keepalive time: " + keepAliveTime + " seconds");
-
- // Create a thread pool with #poolSize threads
- // Threads terminate when they are idle for more than the keepAliveTime
- // A bounded blocking queue is used to queue incoming operations, if #operations > poolSize
- String threadPoolName = "HiveServer2-Background-Pool";
- backgroundOperationPool = new ThreadPoolExecutor(poolSize, poolSize,
- keepAliveTime, TimeUnit.SECONDS, new LinkedBlockingQueue<Runnable>(poolQueueSize),
- new ThreadFactoryWithGarbageCleanup(threadPoolName));
- backgroundOperationPool.allowCoreThreadTimeOut(true);
-
--- End diff --
I think we can keep this file unchanged. Looks like the hive thread pool is more flexible than the spark one.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org