You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Shenson Joseph <sh...@gmail.com> on 2020/06/24 13:35:45 UTC

High Availability for spark streaming application running in kubernetes

Hello,

I have a spark streaming application running in kubernetes and we use spark
operator to submit spark jobs. Any suggestion on

1. How to handle high availability for spark streaming applications.
2. What would be the best approach to handle high availability of
checkpoint data if we don't use HDFS?

Thanks
Shenson