You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Alex Liu (JIRA)" <ji...@apache.org> on 2015/04/23 20:06:39 UTC
[jira] [Created] (SPARK-7095) Pass DataType to source.Filter
classes
Alex Liu created SPARK-7095:
-------------------------------
Summary: Pass DataType to source.Filter classes
Key: SPARK-7095
URL: https://issues.apache.org/jira/browse/SPARK-7095
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 1.3.0
Reporter: Alex Liu
Priority: Minor
source.Filter class doesn't pass any data type information.
e.g.
{code}
case class GreaterThan(attribute: String, value: Any) extends Filter
{code}
GreaterThan requires data are in the same type.
Data type matching check are required during Implementing PrunedFilteredScan where there are comparison filters.
Data type can be obtained by a case matching method. Since the method is called each time filter a row, it could improve performance if the data type is included in Filter.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org