You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yuming Wang (Jira)" <ji...@apache.org> on 2019/09/25 16:03:00 UTC
[jira] [Updated] (SPARK-29247) HiveClientImpl may be log sensitive
information
[ https://issues.apache.org/jira/browse/SPARK-29247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuming Wang updated SPARK-29247:
--------------------------------
Description:
{{HiveClientImpl}} may be log sensitive information. e.g. url, secret and token:
{code:scala}
logDebug(
s"""
|Applying Hadoop/Hive/Spark and extra properties to Hive Conf:
|$k=${if (k.toLowerCase(Locale.ROOT).contains("password")) "xxx" else v}
""".stripMargin)
{code}
We need to redact it. Please refer to {{SQLConf.get.redactOptions}}.
[https://github.com/apache/spark/blob/c8628354b7d2e6116b2a6eb3bdb2fc957c91fd03/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L181-L185]
was:
{{HiveClientImpl}} may be log sensitive information:
{code:scala}
logDebug(
s"""
|Applying Hadoop/Hive/Spark and extra properties to Hive Conf:
|$k=${if (k.toLowerCase(Locale.ROOT).contains("password")) "xxx" else v}
""".stripMargin)
{code}
We need to redact it. Please refer to {{SQLConf.get.redactOptions}}.
[https://github.com/apache/spark/blob/c8628354b7d2e6116b2a6eb3bdb2fc957c91fd03/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L181-L185]
> HiveClientImpl may be log sensitive information
> -----------------------------------------------
>
> Key: SPARK-29247
> URL: https://issues.apache.org/jira/browse/SPARK-29247
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Yuming Wang
> Priority: Major
>
> {{HiveClientImpl}} may be log sensitive information. e.g. url, secret and token:
> {code:scala}
> logDebug(
> s"""
> |Applying Hadoop/Hive/Spark and extra properties to Hive Conf:
> |$k=${if (k.toLowerCase(Locale.ROOT).contains("password")) "xxx" else v}
> """.stripMargin)
> {code}
> We need to redact it. Please refer to {{SQLConf.get.redactOptions}}.
> [https://github.com/apache/spark/blob/c8628354b7d2e6116b2a6eb3bdb2fc957c91fd03/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L181-L185]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org