You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Lijie Xu (JIRA)" <ji...@apache.org> on 2018/08/25 03:41:00 UTC
[jira] [Updated] (SPARK-25232) Support Full-Text Search in Spark
SQL
[ https://issues.apache.org/jira/browse/SPARK-25232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lijie Xu updated SPARK-25232:
-----------------------------
Description:
Full-text search (i.e., keyword search) is widely used in search engines and relational databases such as MATCH() ... AGAINST operator in MySQL (https://dev.mysql.com/doc/en/fulltext-search.html), Text query in Oracle (https://docs.oracle.com/cd/B28359_01/text.111/b28303/query.htm#g1016054), and text search in PostgreSQL (https://www.postgresql.org/docs/9.5/static/textsearch.html). However, it is not natively supported in Spark SQL. We propose an approach to implement this full-text search in Spark SQL.
Our proposed approach is detailed at [https://github.com/JerryLead/Misc/blob/master/FullTextSearch/Full-text-issue-2018.pdf]
and the prototype is available at [https://github.com/bigdata-iscas/SparkFullTextQuery/tree/like_explorer]
was:
Full-text search (i.e., keyword search) is widely used in search engines and relational databases like MATCH() ... AGAINST operator in MySQL. However, it is not natively supported in Spark SQL. We propose an approach to implement this full-text search in Spark SQL.
Our proposed approach is detailed at https://github.com/JerryLead/Misc/blob/master/FullTextSearch/Full-text-issue-2018.pdf
and the prototype is available at https://github.com/bigdata-iscas/SparkFullTextQuery/tree/like_explorer
> Support Full-Text Search in Spark SQL
> -------------------------------------
>
> Key: SPARK-25232
> URL: https://issues.apache.org/jira/browse/SPARK-25232
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 2.3.1
> Reporter: Lijie Xu
> Priority: Major
>
> Full-text search (i.e., keyword search) is widely used in search engines and relational databases such as MATCH() ... AGAINST operator in MySQL (https://dev.mysql.com/doc/en/fulltext-search.html), Text query in Oracle (https://docs.oracle.com/cd/B28359_01/text.111/b28303/query.htm#g1016054), and text search in PostgreSQL (https://www.postgresql.org/docs/9.5/static/textsearch.html). However, it is not natively supported in Spark SQL. We propose an approach to implement this full-text search in Spark SQL.
> Our proposed approach is detailed at [https://github.com/JerryLead/Misc/blob/master/FullTextSearch/Full-text-issue-2018.pdf]
> and the prototype is available at [https://github.com/bigdata-iscas/SparkFullTextQuery/tree/like_explorer]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org