Re: [PR] [SPARK-55271][SS] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark]

["zahed1994 (via GitHub)" <gi...@apache.org>]

zahed1994 commented on PR #54058:
URL: https://github.com/apache/spark/pull/54058#issuecomment-5346392787

   I came across this PR while investigating SPARK-55271 and have opened #58133 with an alternative implementation.
   
   My PR specifically focuses on reproducing the instance metrics() path where latestPartitionOffsets is still null before latestOffset() initializes it, and adds a regression test for that scenario.
   
   I believe this directly exercises the original failure path described in the discussion here.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org