You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/10/13 10:09:48 UTC

[GitHub] [spark] wangyum edited a comment on pull request #29999: [SPARK-33045][SQL] Support build-in function like_all and fix StackOverflowError issue.

wangyum edited a comment on pull request #29999:
URL: https://github.com/apache/spark/pull/29999#issuecomment-707634498


   @maropu We can reproduce the `java.lang.StackOverflowError` in this way:
   ```scala
   spark.sql("create table SPARK_33045(id string) using parquet")
   val values = Range(1, 10000)
   spark.sql(s"select * from SPARK_33045 where id like all (${values.mkString(", ")})").show
   ```
   This is because we rewrite like all/any to like:
   ```scala
   spark.sql(s"select * from SPARK_33045 where ${values.map(i => s"id like $i").mkString(" and ")}").show
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org