You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "MaxGekk (via GitHub)" <gi...@apache.org> on 2023/12/18 11:23:18 UTC

[PR] [WIP][SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config [spark]

MaxGekk opened a new pull request, #44399:
URL: https://github.com/apache/spark/pull/44399

   ### What changes were proposed in this pull request?
   In the PR, I propose to fix the order of arguments of the removed SQL config `park.sql.optimizer.runtimeFilter.semiJoinReduction.enabled` and check the format of Spark version in the constructor of `RemovedConfig`.
   
   ### Why are the changes needed?
   To don't confuse users and prevent such kind of mistakes.
   
   ### Does this PR introduce _any_ user-facing change?
   No.
   
   ### How was this patch tested?
   By running the existing test suite:
   ```
   $ build/sbt "test:testOnly *SQLConfSuite"
   ```
   without the fix the test suite fails with the internal error:
   ```
   Caused by: org.apache.spark.SparkException: [INTERNAL_ERROR] The removed SQL config spark.sql.optimizer.runtimeFilter.semiJoinReduction.enabled has the wrong Spark version: false SQLSTATE: XX000
   	at org.apache.spark.SparkException$.internalError(SparkException.scala:92)
   	at org.apache.spark.SparkException$.internalError(SparkException.scala:96)
   ```
   
   ### Was this patch authored or co-authored using generative AI tooling?
   No.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Re: [PR] [SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config [spark]

Posted by "MaxGekk (via GitHub)" <gi...@apache.org>.
MaxGekk closed pull request #44399: [SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config
URL: https://github.com/apache/spark/pull/44399


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Re: [PR] [SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config [spark]

Posted by "MaxGekk (via GitHub)" <gi...@apache.org>.
MaxGekk commented on PR #44399:
URL: https://github.com/apache/spark/pull/44399#issuecomment-1860667860

   Merging to master/3.5/3.4. Thank you, @beliefer @cloud-fan for review.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org