[GitHub] [spark] adelaocampos commented on pull request #32179: [SPARK-35080][SQL] Only allow a subset of correlated equality predicates when a subquery is aggregated

[GitBox <gi...@apache.org>]

adelaocampos commented on pull request #32179:
URL: https://github.com/apache/spark/pull/32179#issuecomment-1048829162


   Hello @SparkQA @cloud-fan  @viirya @yaooqinn   @allisonwang-db , do you know if the configuration was introduced, the reason why im asking is because we have some pipelines and they are failing after the upgrade to 2.4.8 from 2.4.5
   
   This is really critical to me
   
   We started to see errors as follow:
   
   Exception in thread "main" org.apache.spark.sql.AnalysisException: Correlated column is not allowed in predicate (outer(p2.NAME) = replace(disc_model_anchor.dis_name, 'CPF', 'ADM')):
   Aggregate [first(amount#3835, false) AS first(amount)https://github.com/apache/spark/pull/12269]


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org