You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Qifan Pu (JIRA)" <ji...@apache.org> on 2016/07/25 19:52:20 UTC
[jira] [Created] (SPARK-16713) Limit codegen method size to 8KB
Qifan Pu created SPARK-16713:
--------------------------------
Summary: Limit codegen method size to 8KB
Key: SPARK-16713
URL: https://issues.apache.org/jira/browse/SPARK-16713
Project: Spark
Issue Type: Improvement
Components: Spark Core, SQL
Affects Versions: 2.0.0
Reporter: Qifan Pu
Ideally, we would wish codegen methods to be less than 8KB for bytecode size. Beyond 8K JIT won't compile and can cause performance degradation. We have seen this for queries with wide schema (30+ fields). This is also a major reason for performance regression when we enable fash aggregate hashmap (such as using VectorizedHashMapGenerator.scala).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org