You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Guillaume Massé (Jira)" <ji...@apache.org> on 2023/06/29 03:19:00 UTC
[jira] [Comment Edited] (CALCITE-5809) enable to_date and to_timestamp in Apache Spark Library
[ https://issues.apache.org/jira/browse/CALCITE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738350#comment-17738350 ]
Guillaume Massé edited comment on CALCITE-5809 at 6/29/23 3:18 AM:
-------------------------------------------------------------------
Here is a list of functions that are already available via other library:
{code:java}
base64 <spark> (called TO_BASE64)
chr BIG_QUERY, ORACLE, POSTGRESQL
concat_ws MYSQL, POSTGRESQL
convert_timezone POSTGRESQL
date BIG_QUERY
date_add BIG_QUERY
date_diff BIG_QUERY
date_from_unix_date BIG_QUERY
date_part POSTGRESQL
date_sub BIG_QUERY
date_trunc BIG_QUERY
dateadd MSSQL, POSTGRESQL
datediff MSSQL, POSTGRESQL
datepart MSSQL
endswith <spark> (called ends_with in BIG_QUERY)
greatest BIG_QUERY, ORACLE
ifnull BIG_QUERY
instr BIG_QUERY, MYSQL, ORACLE
least BIG_QUERY, ORACLE
left BIG_QUERY, MYSQL, POSTGRESQL
log BIG_QUERY
lpad BIG_QUERY, ORACLE
ltrim BIG_QUERY, ORACLE
md5 BIG_QUERY, MYSQL, POSTGRESQL
position <spark> (called strpos in BIG_QUERY, POSTGRESQL)
pow BIG_QUERY
random <spark> (alias for rand)
regexp_replace MYSQL, ORACLE
repeat BIG_QUERY, MYSQL, POSTGRESQL
reverse <spark> (called array_reverse in BIG_QUERY)
right BIG_QUERY, MYSQL, POSTGRESQL
rpad BIG_QUERY, ORACLE
rtrim BIG_QUERY, ORACLE
sha <spark> (alias for sha1)
sha1 BIG_QUERY, MYSQL, POSTGRESQL
soundex BIG_QUERY, MYSQL, POSTGRESQL, ORACLE
space MYSQL
split BIG_QUERY
startswith <spark> (called starts_with in BIG_QUERY)
std <spark> (alias for stddev)
timestamp BIG_QUERY
timestamp_micros BIG_QUERY
timestamp_millis BIG_QUERY
timestamp_seconds BIG_QUERY
to_date POSTGRESQL, ORACLE
to_timestamp POSTGRESQL, ORACLE
translate <spark> (called translate3 in BIG_QUERY, ORACLE, POSTGRESQL)
unix_date BIG_QUERY
unix_micros BIG_QUERY
unix_millis BIG_QUERY
unix_seconds BIG_QUERY {code}
was (Author: masseguillaume):
Here is a list of functions that are already available via other library:
{code:java}
base64 <spark> (called TO_BASE64)
chr BIG_QUERY, ORACLE, POSTGRESQL
concat_ws MYSQL, POSTGRESQL
convert_timezone POSTGRESQL
date BIG_QUERY
date_add BIG_QUERY
date_diff BIG_QUERY
date_from_unix_date BIG_QUERY
date_part POSTGRESQL
date_sub BIG_QUERY
date_trunc BIG_QUERY
dateadd MSSQL, POSTGRESQL
datediff MSSQL, POSTGRESQL
datepart MSSQL
endswith <spark> (called ends_with in BIG_QUERY)
greatest BIG_QUERY, ORACLE
ifnull BIG_QUERY
instr BIG_QUERY, MYSQL, ORACLE
least BIG_QUERY, ORACLE
left BIG_QUERY, MYSQL, POSTGRESQL
log BIG_QUERY
lpad BIG_QUERY, ORACLE
ltrim BIG_QUERY, ORACLE
md5 BIG_QUERY, MYSQL, POSTGRESQL
position <spark> (called strpos in BIG_QUERY, POSTGRESQL)
pow BIG_QUERY
random <spark> (alias for rand)
regexp_replace MYSQL, ORACLE
repeat BIG_QUERY, MYSQL, POSTGRESQL
reverse <spark> (called array_reverse in BIG_QUERY)
right BIG_QUERY, MYSQL, POSTGRESQL
rpad BIG_QUERY, ORACLE
rtrim BIG_QUERY, ORACLE
sha <spark> (alias for sha1)
sha1 BIG_QUERY, MYSQL, POSTGRESQL
soundex BIG_QUERY, MYSQL, POSTGRESQL, ORACLE
space MYSQL
split BIG_QUERY
startswith <spark> (called starts_with in BIG_QUERY)
std <spark> (alias for stddev)
timestamp BIG_QUERY
timestamp_micros BIG_QUERY
timestamp_millis BIG_QUERY
timestamp_seconds BIG_QUERY
to_date POSTGRESQL, ORACLE
to_timestamp POSTGRESQL, ORACLEtranslate <spark> (called translate3 in BIG_QUERY, ORACLE, POSTGRESQL)
unix_date BIG_QUERY
unix_micros BIG_QUERY
unix_millis BIG_QUERY
unix_seconds BIG_QUERY {code}
> enable to_date and to_timestamp in Apache Spark Library
> -------------------------------------------------------
>
> Key: CALCITE-5809
> URL: https://issues.apache.org/jira/browse/CALCITE-5809
> Project: Calcite
> Issue Type: Improvement
> Reporter: Guillaume Massé
> Priority: Minor
>
> Those functions are available in Calcite but via different library, we simply need to add them to the libraries list.
>
> [https://spark.apache.org/docs/2.3.0/api/sql/#to_date]
> [https://github.com/apache/calcite/blob/50f0e185896a4afb7c77bb6fb4efe41c1531dcfe/core/src/main/java/org/apache/calcite/sql/fun/SqlLibraryOperators.java#L1262-L1267]
>
> https://spark.apache.org/docs/2.3.0/api/sql/#to_timestamp
> https://github.com/apache/calcite/blob/50f0e185896a4afb7c77bb6fb4efe41c1531dcfe/core/src/main/java/org/apache/calcite/sql/fun/SqlLibraryOperators.java#L1271-L1276
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)