You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kris Mok (JIRA)" <ji...@apache.org> on 2019/01/18 08:31:00 UTC

[jira] [Created] (SPARK-26661) Show actual class name of the writing command in CTAS explain

Kris Mok created SPARK-26661:
--------------------------------

             Summary: Show actual class name of the writing command in CTAS explain
                 Key: SPARK-26661
                 URL: https://issues.apache.org/jira/browse/SPARK-26661
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Kris Mok


The explain output of the Hive CTAS command, regardless of whether it's actually writing via Hive's SerDe or converted into using Spark's data source, would always show that it's using {{InsertIntoHiveTable}} because it's hardcoded.

e.g.
{code:none}
Execute OptimizedCreateHiveTableAsSelectCommand [Database:default, TableName: foo, InsertIntoHiveTable]
{code}
This CTAS is converted into using Spark's data source, but it still says {{InsertIntoHiveTable}} in the explain output.

It's better to show the actual class name of the writing command used. For the example above, it'd be:
{code:none}
Execute OptimizedCreateHiveTableAsSelectCommand [Database:default, TableName: foo, InsertIntoHadoopFsRelationCommand]
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org