You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Rohit Mishra (Jira)" <ji...@apache.org> on 2020/08/11 03:46:00 UTC
[jira] [Commented] (SPARK-32583) PySpark Structured Streaming
Testing Support
[ https://issues.apache.org/jira/browse/SPARK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175200#comment-17175200 ]
Rohit Mishra commented on SPARK-32583:
--------------------------------------
[~FelixKJose], Questions are usually answered using either Stackoverflow or User-mail list. Please look at this link for more info-[https://spark.apache.org/community.html]. This task will be marked as resolved here for now but you can reopen it if you want. Thanks.
> PySpark Structured Streaming Testing Support
> --------------------------------------------
>
> Key: SPARK-32583
> URL: https://issues.apache.org/jira/browse/SPARK-32583
> Project: Spark
> Issue Type: Question
> Components: PySpark
> Affects Versions: 2.4.4
> Reporter: Felix Kizhakkel Jose
> Priority: Major
>
> Hello,
> I have investigated a lot but couldn't get any help or resource on how to +{color:#172b4d}*test my pyspark Structured Streaming pipeline job*{color}+ (ingesting from Kafka topics to S3) and how to build Continuous Integration (CI)/Continuous Deployment (CD).
> 1. Is it possible to test (unit test, integration test) pyspark structured stream?
> 2. How to build Continuous Integration (CI)/Continuous Deployment (CD)?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org