[GitHub] [spark] bogao007 commented on pull request #41752: [SPARK-44201][CONNECT][SS]Add support for Streaming Listener in Scala for Spark Connect

["bogao007 (via GitHub)" <gi...@apache.org>]

bogao007 commented on PR #41752:
URL: https://github.com/apache/spark/pull/41752#issuecomment-1631231464

   > Thanks! I'll take a look later. Just a quick sanity check, can you test if you could do `spark.write` in the listener and in the client verify if the write is there? For example:
   > 
   > ```
   > >>> class MyListener(ConnectStreamingQueryListener):
   > ...     def onQueryStarted(self, event: QueryStartedEvent) -> None: 
   >              print("hi, event query id is: " +  str(event.id)); 
   >              df=spark.createDataFrame(["10","11","13"], "string").toDF("age"); 
   >             df.write.saveAsTable("tbllistener")
   > ```
   > 
   > and do a `spark.read.table()` in client repl
   
   Sure, will do that, thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org