You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2016/10/26 07:12:00 UTC
[jira] [Created] (HIVE-15068) Run ClearDanglingScratchDir
periodically inside HS2
Daniel Dai created HIVE-15068:
---------------------------------
Summary: Run ClearDanglingScratchDir periodically inside HS2
Key: HIVE-15068
URL: https://issues.apache.org/jira/browse/HIVE-15068
Project: Hive
Issue Type: Improvement
Components: HiveServer2
Reporter: Daniel Dai
Assignee: Daniel Dai
In HIVE-13429, we introduce a tool which clear dangling scratch directory. In this ticket, we want to invoke the tool automatically on a Hive cluster. Options are:
1. cron job, which would involve manual cron job setup
2. As a metastore thread. However, it is possible we run metastore without hdfs in the future (eg, managing s3 files). ClearDanglingScratchDir needs support which only exists in hdfs, it won't work if the above scenario happens
3. As a HS2 thread. The downside is if no HS2 is running, the tool will not run automatically. But we expect HS2 will be a required component down the road
Here I choose approach 3 in the implementation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)