You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/03/18 05:24:22 UTC
[GitHub] [spark] HeartSaVioR commented on pull request #35909: [SPARK-38593][SS] Carry over the metric of the number of dropped late events into SessionWindowStateStoreSaveExec
HeartSaVioR commented on pull request #35909:
URL: https://github.com/apache/spark/pull/35909#issuecomment-1072045097
We issue the "same" stateful operator ID for both nodes, no? They are "logically" a single operator.
The thing we split the execution node down to two is "implementation details", which end users should not be required to reason about. The thing we take the route of different execution nodes for streaming aggregation and "session window" streaming aggregation is also "implementation details".
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org