You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ya...@apache.org on 2023/06/27 08:42:34 UTC
[spark] branch master updated: [SPARK-44204][SQL][HIVE] Add missing recordHiveCall for getPartitionNames
This is an automated email from the ASF dual-hosted git repository.
yangjie01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 43f7a86a05a [SPARK-44204][SQL][HIVE] Add missing recordHiveCall for getPartitionNames
43f7a86a05a is described below
commit 43f7a86a05ad8c7ec7060607e43d9ca4d0fe4166
Author: Cheng Pan <ch...@apache.org>
AuthorDate: Tue Jun 27 16:42:14 2023 +0800
[SPARK-44204][SQL][HIVE] Add missing recordHiveCall for getPartitionNames
### What changes were proposed in this pull request?
The code was added by SPARK-35437, looks like it forgot to call `recordHiveCall` before `hive.getPartitionNames`
### Why are the changes needed?
Correctly call `recordHiveCall` on each HMS invocation.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing CI and Review.
Closes #41756 from pan3793/SPARK-44204.
Authored-by: Cheng Pan <ch...@apache.org>
Signed-off-by: yangjie01 <ya...@baidu.com>
---
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 1 +
1 file changed, 1 insertion(+)
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
index 08615b90d80..63f672b22ba 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
@@ -1180,6 +1180,7 @@ private[client] class Shim_v0_13 extends Shim_v0_12 {
})
}
+ recordHiveCall()
val allPartitionNames = hive.getPartitionNames(
table.getDbName, table.getTableName, -1).asScala
val partNames = allPartitionNames.filter { p =>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org