You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "merrily01 (Jira)" <ji...@apache.org> on 2021/08/12 06:46:00 UTC

[jira] [Created] (SPARK-36488) "Invalid usage of '*' in expression" error due to the feature of 'quotedRegexColumnNames' in some scenarios.

merrily01 created SPARK-36488:
---------------------------------

             Summary: "Invalid usage of '*' in expression" error due to the feature of 'quotedRegexColumnNames' in some scenarios.
                 Key: SPARK-36488
                 URL: https://issues.apache.org/jira/browse/SPARK-36488
             Project: Spark
          Issue Type: Bug
          Components: Spark Core, SQL
    Affects Versions: 3.1.2, 2.4.8
         Environment: In some cases, the error happens when the following property is set.
{code:java}
spark.sql("set spark.sql.parser.quotedRegexColumnNames=true")
{code}
*case 1:* 
{code:java}
spark-sql> create table tb_test as select 1 as col_a, 2 as col_b;
spark-sql> select `tb_test`.`col_a`  from tb_test;
1

spark-sql> set spark.sql.parser.quotedRegexColumnNames=true;

spark-sql> select `tb_test`.`col_a`  from tb_test;
Error in query: Invalid usage of '*' in expression 'unresolvedextractvalue'


{code}
 

*case 2:*

 
{code:java}
         > select `col_a`/`col_b` as `col_c` from (select 3 as `col_a` ,  3.14 as `col_b`);
0.955414

spark-sql> set spark.sql.parser.quotedRegexColumnNames=true;

spark-sql> select `col_a`/`col_b` as `col_c` from (select 3 as `col_a` ,  3.14 as `col_b`);

Error in query: Invalid usage of '*' in expression 'divide'
{code}
 

 

This problem exists in 3.X, 2.4.X and master versions. 

 

Related issue : 

 

https://issues.apache.org/jira/browse/SPARK-12139

(As can be seen in the latest comments, some people have encountered the same problem)

 

Similar problems:

https://issues.apache.org/jira/browse/SPARK-28897

 

 

 

 

 

 

 

 

 

 

 

 
            Reporter: merrily01






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org