You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Kuttaiah Robin <ku...@gmail.com> on 2018/11/02 08:59:06 UTC

Spark Listeners for getting dataset partition information in streaming application

Hello,

Is there a way spark streaming application will get to know during the
start and end of the data read from a dataset partition?
I want to create partition specific cache during the start and delete
during the partition is read completely.

Thanks for you help in advance.

regards,
Robin Kuttaiah