You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Eugene Koifman <eu...@workday.com> on 2019/07/31 20:04:45 UTC

GenerateExec Whole stage code generation is disabled

Hi,

Are there any plans to support this?
If not, could anyone explain why it should not be supported?


It looks like it’s been done in https://github.com/apache/spark/commit/b5c5bd98ea5e8dbfebcf86c5459bdf765f5ceb53#diff-0314224342bb8c30143ab784b3805d19
but there is no clear explanation as to why

It’s still disabled in current master
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/GenerateExec.scala#L127


Thanks,
Eugene