You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/01/05 02:51:00 UTC
[jira] [Updated] (SPARK-41888) Support StreamingQueryListener for connect
[ https://issues.apache.org/jira/browse/SPARK-41888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
jiaan.geng updated SPARK-41888:
-------------------------------
Description:
{code:java}
**********************************************************************
1334
File "/__w/spark/spark/python/pyspark/sql/connect/dataframe.py", line 619, in pyspark.sql.connect.dataframe.DataFrame.observe
1335
Failed example:
1336
observation.get
1337
Exception raised:
1338
Traceback (most recent call last):
1339
File "/usr/lib/python3.9/doctest.py", line 1336, in __run
1340
exec(compile(example.source, filename, "single",
1341
File "<doctest pyspark.sql.connect.dataframe.DataFrame.observe[6]>", line 1, in <module>
1342
observation.get
1343
File "/__w/spark/spark/python/pyspark/sql/utils.py", line 378, in wrapped
1344
raise NotImplementedError()
1345
NotImplementedError
1346
**********************************************************************
1347
File "/__w/spark/spark/python/pyspark/sql/connect/dataframe.py", line 642, in pyspark.sql.connect.dataframe.DataFrame.observe
1348
Failed example:
1349
spark.streams.addListener(MyErrorListener())
1350
Exception raised:
1351
Traceback (most recent call last):
1352
File "/usr/lib/python3.9/doctest.py", line 1336, in __run
1353
exec(compile(example.source, filename, "single",
1354
File "<doctest pyspark.sql.connect.dataframe.DataFrame.observe[9]>", line 1, in <module>
1355
spark.streams.addListener(MyErrorListener())
1356
AttributeError: 'SparkSession' object has no attribute 'streams'
1357
**********************************************************************
{code}
> Support StreamingQueryListener for connect
> ------------------------------------------
>
> Key: SPARK-41888
> URL: https://issues.apache.org/jira/browse/SPARK-41888
> Project: Spark
> Issue Type: Sub-task
> Components: Connect
> Affects Versions: 3.4.0
> Reporter: jiaan.geng
> Priority: Major
>
> {code:java}
> **********************************************************************
> 1334
> File "/__w/spark/spark/python/pyspark/sql/connect/dataframe.py", line 619, in pyspark.sql.connect.dataframe.DataFrame.observe
> 1335
> Failed example:
> 1336
> observation.get
> 1337
> Exception raised:
> 1338
> Traceback (most recent call last):
> 1339
> File "/usr/lib/python3.9/doctest.py", line 1336, in __run
> 1340
> exec(compile(example.source, filename, "single",
> 1341
> File "<doctest pyspark.sql.connect.dataframe.DataFrame.observe[6]>", line 1, in <module>
> 1342
> observation.get
> 1343
> File "/__w/spark/spark/python/pyspark/sql/utils.py", line 378, in wrapped
> 1344
> raise NotImplementedError()
> 1345
> NotImplementedError
> 1346
> **********************************************************************
> 1347
> File "/__w/spark/spark/python/pyspark/sql/connect/dataframe.py", line 642, in pyspark.sql.connect.dataframe.DataFrame.observe
> 1348
> Failed example:
> 1349
> spark.streams.addListener(MyErrorListener())
> 1350
> Exception raised:
> 1351
> Traceback (most recent call last):
> 1352
> File "/usr/lib/python3.9/doctest.py", line 1336, in __run
> 1353
> exec(compile(example.source, filename, "single",
> 1354
> File "<doctest pyspark.sql.connect.dataframe.DataFrame.observe[9]>", line 1, in <module>
> 1355
> spark.streams.addListener(MyErrorListener())
> 1356
> AttributeError: 'SparkSession' object has no attribute 'streams'
> 1357
> **********************************************************************
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org