[jira] [Assigned] (SPARK-52759) [SDP] Throw Exception when pipeline is run but no tables are defined

["Sandy Ryza (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-52759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sandy Ryza reassigned SPARK-52759:
----------------------------------

    Assignee: Jacky Wang

> [SDP] Throw Exception when pipeline is run but no tables are defined
> --------------------------------------------------------------------
>
>                 Key: SPARK-52759
>                 URL: https://issues.apache.org/jira/browse/SPARK-52759
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Declarative Pipelines
>    Affects Versions: 4.1
>            Reporter: Jacky Wang
>            Assignee: Jacky Wang
>            Priority: Major
>              Labels: pull-request-available
>
> In Spark Declarative Pipelines, using the CLI tool users run a pipeline that is defined from the configured pipeline root directory. This directory contains information such as the pipeline spec, and the source code files (Python, SQL) that define the pipeline tables/flows/views.
> It’s possible the user tries to run a pipeline defined from a pipeline directory whose source files don’t actually define any tables or views. 
> An exception should be thrown if the pipeline does not have any tables or views, to inform the user they should double check that they are running the pipeline in the correct directory. The current behavior is that the pipeline just run to completion without emitting any info.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org