Re: [PR] [SPARK-60231][SS] Improve the put/merge operation in ListState with TTL when there are multiple values [spark]

["kavpreetgrewal (via GitHub)" <gi...@apache.org>]

kavpreetgrewal commented on PR #59452:
URL: https://github.com/apache/spark/pull/59452#issuecomment-6273972318

   @HyukjinKwon Thanks, good catch. This also affects non-TTL list state since SPARK-54118, so I fixed the reader separately in #59521: it now returns one row per value, the first keeps the record's change type and the rest are append. Can you please take a look at that one?
   
   Once that merges, I'll rebase this PR and add change-feed tests for TTL put/appendList with several values and for eviction that keeps several survivors.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org