[jira] [Created] (ATLAS-4747) ddlQueries and ALTERTABLE_* lineage missing for spark tables created via spark3-shell

["Umesh Padashetty (Jira)" <ji...@apache.org>]

Umesh Padashetty created ATLAS-4747:
---------------------------------------

             Summary: ddlQueries and ALTERTABLE_* lineage missing for spark tables created via spark3-shell
                 Key: ATLAS-4747
                 URL: https://issues.apache.org/jira/browse/ATLAS-4747
             Project: Atlas
          Issue Type: Bug
          Components:  atlas-core
    Affects Versions: 2.3.0
            Reporter: Umesh Padashetty
         Attachments: Screenshot 2023-04-26 at 1.00.11 AM.png, Screenshot 2023-04-26 at 1.00.17 AM.png, Screenshot 2023-04-26 at 1.00.45 AM.png, Screenshot 2023-04-26 at 1.00.50 AM.png

Ran the below queries via spark3-shell
{code:java}
spark.sql("create table testing_iceberg_spark_alters_1(name string, address string)");

spark.sql("alter table testing_iceberg_spark_alters_1 add column(address2 string)");{code}
ddlQueries and outputFromProcesses (lineage) is missing for the alter queries 

!Screenshot 2023-04-26 at 1.00.11 AM.png!

 

!Screenshot 2023-04-26 at 1.00.17 AM.png!

Running similar queries via beeline, it generates ddlQueries and outputFromProcesses (lineage) for the alter queries 

!Screenshot 2023-04-26 at 1.00.45 AM.png!

!Screenshot 2023-04-26 at 1.00.50 AM.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)