[jira] [Updated] (FLINK-10281) Fix string literal escaping throughout Table & SQL API

["Timo Walther (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Timo Walther updated FLINK-10281:
---------------------------------
    Summary: Fix string literal escaping throughout Table & SQL API  (was: Table function parse regular expression contains backslash failed)

> Fix string literal escaping throughout Table & SQL API
> ------------------------------------------------------
>
>                 Key: FLINK-10281
>                 URL: https://issues.apache.org/jira/browse/FLINK-10281
>             Project: Flink
>          Issue Type: Bug
>          Components: Table API & SQL
>            Reporter: vinoyang
>            Assignee: vinoyang
>            Priority: Major
>              Labels: pull-request-available
>
> for example,  regular expression matches text ("\w") or number ("\d") :
> {code:java}
> testAllApis(
>   "foothebar".regexExtract("foo([\\w]+)", 1),       //OK, the method got 'foo([\w]+)'
>   "'foothebar'.regexExtract('foo([\\\\w]+)', 1)",   //failed, the method got 'foo([\\w]+)' returns "", but if pass 'foo([\\w]+)' would get compile error.
>   "REGEX_EXTRACT('foothebar', 'foo([\\\\w]+)', 1)", //OK, the method got 'foo([\w]+)' but must pass four '\'
>   "thebar"
> )
> {code}
> the "similar to" function has the same issue.
>  
> Update:
> Proper escaping of quotes was not possible in the past for Table API. SQL and SQL Client
>  were not standard compliant.
> Due to FLINK-8301 backslashes were considered in SQL literals, however, they
>  should only be used in SQL `U&'\1234'` literals. For the Table API, the new
>  logic relies on the Java/Scala escaping and uses duplicate quotes for escaping
>  the quotes in expression strings. For SQL, we rely on unicode string literals
>  with or without the UESCAPE clause. The SQL Client was using backslashes for
>  escaping new lines. For the SQL Client, we allow unescaped new lines and
>  use ';' for statement finalization; similar to other SQL clients.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)