You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/01/16 09:19:37 UTC

[GitHub] [spark] wangyum commented on pull request #31189: [SPARK-34122][SQL] Remove duplicated branches in CaseWhen

wangyum commented on pull request #31189:
URL: https://github.com/apache/spark/pull/31189#issuecomment-761532818


   ```
   23:23:35.344 WARN org.apache.spark.sql.TPCDSQueryWithStatsSuite: 
   === Metrics of Analyzer/Optimizer Rules ===
   Total number of runs: 250790
   Total time: 108.592324674 seconds
   
   Rule                                                                              Effective Time / Total Time                     Effective Runs / Total Runs                    
   
   org.apache.spark.sql.catalyst.optimizer.Optimizer$OptimizeSubqueries              14321088049 / 18274459745                       47 / 772                                       
   org.apache.spark.sql.catalyst.optimizer.ColumnPruning                             1475698232 / 6462213868                         345 / 2365                                     
   org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveAggregateFunctions         1500045893 / 3839284215                         49 / 2188                                      
   org.apache.spark.sql.catalyst.analysis.Analyzer$AddMetadataColumns                0 / 3348537630                                  0 / 2198                                       
   org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveSubquery                   2991142986 / 3144807311                         51 / 2188                                      
   org.apache.spark.sql.catalyst.optimizer.CostBasedJoinReorder                      2225590150 / 2679815084                         133 / 386                                      
   org.apache.spark.sql.catalyst.analysis.DecimalPrecision                           1842072462 / 2084782693                         361 / 2188                                     
   org.apache.spark.sql.catalyst.optimizer.PruneFilters                              28626514 / 2052761084                           5 / 1979                                       
   org.apache.spark.sql.catalyst.optimizer.PushDownPredicates                        812005972 / 1679325578                          767 / 2372                                     
   org.apache.spark.sql.catalyst.optimizer.RemoveNoopOperators                       210524011 / 1636049467                          193 / 2751                                     
   org.apache.spark.sql.catalyst.optimizer.BooleanSimplification                     11906137 / 1589174555                           5 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.ReorderJoin                               657190684 / 1552602426                          177 / 1593                                     
   org.apache.spark.sql.catalyst.optimizer.OptimizeCsvJsonExprs                      0 / 1441685653                                  0 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.CollapseProject                           223107693 / 1292246801                          198 / 1979                                     
   org.apache.spark.sql.catalyst.optimizer.NullPropagation                           94736938 / 1260557139                           60 / 1593                                      
   org.apache.spark.sql.catalyst.optimizer.ConstantFolding                           205948762 / 1246137678                          202 / 1593                                     
   org.apache.spark.sql.catalyst.optimizer.SimplifyBinaryComparison                  394113 / 1225418669                             1 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.InferFiltersFromConstraints               1139000717 / 1194159541                         278 / 386                                      
   org.apache.spark.sql.catalyst.optimizer.UnwrapCastInBinaryComparison              12272943 / 1193549865                           8 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.PushFoldableIntoBranches                  18627936 / 1191321943                           23 / 1593                                      
   org.apache.spark.sql.catalyst.optimizer.SimplifyConditionals                      0 / 1182512785                                  0 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.ReorderAssociativeOperator                0 / 1181205446                                  0 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.SimplifyCaseConversionExpressions         0 / 1172627842                                  0 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.SimplifyCasts                             94473421 / 1172497732                           83 / 1593                                      
   org.apache.spark.sql.catalyst.optimizer.PushDownLeftSemiAntiJoin                  8772174 / 1170478835                            11 / 1593                                      
   org.apache.spark.sql.catalyst.optimizer.RemoveDispensableExpressions              0 / 1168530075                                  0 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.LikeSimplification                        694800 / 1164449863                             1 / 1593                                       
   org.apache.spark.sql.catalyst.optimizer.RemoveDuplicatedBranches                  0 / 1160800650                                  0 / 1593 
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org