You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "dingshun (Jira)" <ji...@apache.org> on 2021/01/29 06:34:00 UTC
[jira] [Created] (HIVE-24702) HiveServer2 local task leaves token
crc file never gets deleted
dingshun created HIVE-24702:
-------------------------------
Summary: HiveServer2 local task leaves token crc file never gets deleted
Key: HIVE-24702
URL: https://issues.apache.org/jira/browse/HIVE-24702
Project: Hive
Issue Type: Bug
Components: HiveServer2
Reporter: dingshun
Attachments: 0001-update.patch
in secure clusters, hiveserver2 creates a large number of /tmp/.hive_hadoop_delegation_token*.tmp.crc files, which related the Delegation Token and never gets deleted, when executes local tasks.
{code:java}
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc
-rw-r--r-- 1 hive hadoop 12 Jun 28 2020 /tmp/.hive_hadoop_delegation_token990009534922436653.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Nov 13 19:08 /tmp/.hive_hadoop_delegation_token990009600555210260.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Jan 11 11:07 /tmp/.hive_hadoop_delegation_token99002199141550942.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Jan 28 05:50 /tmp/.hive_hadoop_delegation_token990029730478148481.tmp.crc
{code}
{code:java}
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc|wc -l
4880
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token*.tmp.crc|wc -l
-bash: /bin/ls: Argument list too long
{code}
It's created by SecureCmdDoAs when the local task is executed
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L67]
never gets deleted
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L80]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)