[GitHub] [iceberg] dilipbiswal commented on a change in pull request #2132: Spark: Minor refactoring for the cardinality check in MERGE

[GitBox <gi...@apache.org>]

dilipbiswal commented on a change in pull request #2132:
URL: https://github.com/apache/iceberg/pull/2132#discussion_r562282592



##########
File path: spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/utils/RewriteRowLevelOperationHelper.scala
##########
@@ -87,7 +87,8 @@ trait RewriteRowLevelOperationHelper extends PredicateHelper with Logging {
 
   protected val FILE_NAME_COL = "_file"
   protected val ROW_POS_COL = "_pos"
-  protected val AFFECTED_FILES_ACC_NAME = "affectedFiles"
+  // `internal.metrics` prefix ensures the accumulator state is not tracked by Spark UI
+  protected val AFFECTED_FILES_ACC_NAME = "internal.metrics.merge.affectedFiles"

Review comment:
       @aokolnychyi I didn't know about this. Thanks Anton !!




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org