You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sandy Ryza (Jira)" <ji...@apache.org> on 2025/07/17 20:13:00 UTC

[jira] [Created] (SPARK-52851) Remove public APIs for append once flows

Sandy Ryza created SPARK-52851:
----------------------------------

             Summary: Remove public APIs for append once flows
                 Key: SPARK-52851
                 URL: https://issues.apache.org/jira/browse/SPARK-52851
             Project: Spark
          Issue Type: Improvement
          Components: Declarative Pipelines
    Affects Versions: 4.1.0
            Reporter: Sandy Ryza


The Declarative Pipelines `append_flow` decorator includes a `once` argument, which, if True, indicates the flow should run only once. (It will be rerun upon a full refresh operation.)

I believe there's also SQL syntax for this.

 

However, the server does not currently implement this behavior yet. To avoid accidentally releasing APIs that don't actually work, we should take these arguments out for now. And add them back in when we actually support this functionality.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org