You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2015/08/14 01:07:07 UTC
spark git commit: [SPARK-9935] [SQL] EqualNotNull not processed in ORC
Repository: spark
Updated Branches:
refs/heads/master a8d2f4c5f -> c2520f501
[SPARK-9935] [SQL] EqualNotNull not processed in ORC
https://issues.apache.org/jira/browse/SPARK-9935
Author: hyukjinkwon <gu...@gmail.com>
Closes #8163 from HyukjinKwon/master.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2520f50
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c2520f50
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c2520f50
Branch: refs/heads/master
Commit: c2520f501a200cf794bbe5dc9c385100f518d020
Parents: a8d2f4c
Author: hyukjinkwon <gu...@gmail.com>
Authored: Thu Aug 13 16:07:03 2015 -0700
Committer: Reynold Xin <rx...@databricks.com>
Committed: Thu Aug 13 16:07:03 2015 -0700
----------------------------------------------------------------------
.../main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala | 5 +++++
1 file changed, 5 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/c2520f50/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala
----------------------------------------------------------------------
diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala
index 86142e5..b3d9f7f 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala
@@ -107,6 +107,11 @@ private[orc] object OrcFilters extends Logging {
.filter(isSearchableLiteral)
.map(builder.equals(attribute, _))
+ case EqualNullSafe(attribute, value) =>
+ Option(value)
+ .filter(isSearchableLiteral)
+ .map(builder.nullSafeEquals(attribute, _))
+
case LessThan(attribute, value) =>
Option(value)
.filter(isSearchableLiteral)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org