You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Jason Dere <jd...@hortonworks.com> on 2018/10/25 18:34:06 UTC

Review Request 69173: HIVE-20259 Cleanup of results cache directory

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69173/
-----------------------------------------------------------

Review request for hive and Gopal V.


Bugs: HIVE-20259
    https://issues.apache.org/jira/browse/HIVE-20259


Repository: hive-git


Description
-------

Attached patch with utility DirectoryMarkerUpdate/Cleanup classes to create .cacheupdate files in the cache directory, to indicate that this directory should not be cleaned up by any other process performing DirectoryMarkerCleanup. This uses the last modify date of the .cacheupdate file to determine whether the file should be cleaned up, if the instance running cleanup determines this date is too old then the directory will be deleted.


Diffs
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java e226a1f82d 
  common/src/java/org/apache/hive/common/util/DirectoryMarkerCleanup.java PRE-CREATION 
  common/src/java/org/apache/hive/common/util/DirectoryMarkerUpdate.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/cache/results/QueryResultsCache.java a51b7e750b 


Diff: https://reviews.apache.org/r/69173/diff/1/


Testing
-------


Thanks,

Jason Dere