You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/02/09 11:42:30 UTC
[GitHub] [pulsar] startjava opened a new issue #14190: 请教：event time的应用场景是什么？
startjava opened a new issue #14190:
URL: https://github.com/apache/pulsar/issues/14190
在Redis中的sorted set有分数的概念，以分数的大小对数据进行排序，
不太明白pulsar中这个event time的使用场景是什么。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] startjava commented on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
startjava commented on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1034655292
可以确保最终状态是canceled，这句话是如何确保的，因为一个消息发过去后马上就消费了，按接收到message的顺序进行消费，如何保证cancel一定是在最后的，，加上event time也不能影响在网络中发送的顺序啊。感谢
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] startjava closed issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
startjava closed issue #14190:
URL: https://github.com/apache/pulsar/issues/14190
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] youzipi commented on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
youzipi commented on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1034547766
@startjava
event time is introduced here: https://github.com/apache/pulsar/wiki/PIP-5:-Event-time
event time is used to clarify the order which event happens in streaming processing.
for example, we have an order, it has 3 events ( by order of occurrence): `create`, `payed`,`cancel`.
we may receive the `payed` after `cancel`, with event time, we can make sure final status is `canceled`.
simply, you can think the event time as `logical clock`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] startjava commented on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
startjava commented on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1039035348
@youzipi 感谢！
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] startjava commented on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
startjava commented on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1034655524
@youzipi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] youzipi edited a comment on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
youzipi edited a comment on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1034769623
> 可以确保最终状态是canceled，这句话是如何确保的，因为一个消息发过去后马上就消费了，按接收到message的顺序进行消费，如何保证cancel一定是在最后的，，加上event time也不能影响在网络中发送的顺序啊。感谢
in this case, you need manually check if the message is old.
you can also put a time field in message to achieve the same goal.
but why put event time in `metadata` but not `message` ？
it is convenient and efficient for developing future advanced features.
(we can get the field directly instead of deserialize and scan the whole message.)
you can check these in the `discusstion thread` in PIP.
> for now(2022-02), i did not found any feature working on event time.
> in flink, you can config `window` and `watermark` to reorder the event in a period.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] youzipi commented on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
youzipi commented on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1034769623
> 可以确保最终状态是canceled，这句话是如何确保的，因为一个消息发过去后马上就消费了，按接收到message的顺序进行消费，如何保证cancel一定是在最后的，，加上event time也不能影响在网络中发送的顺序啊。感谢
in this case, you need manually check if the message is old.
you can also put a time field in message to achieve the same goal.
but why put event time in `metadata` but not `message` ？
it is convenient and efficient for developing future advanced features.
(we can get the field directly instead of deserialize and scan the whole message.)
you can check these in the `discusstion thread` in pip.
> for now(2022-02), i did not found any feature working on event time.
> in flink, it provide a `window` parameter to reorder the event in a period.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] startjava commented on issue #14190: 请教：event time的应用场景是什么？
Posted by GitBox <gi...@apache.org>.
startjava commented on issue #14190:
URL: https://github.com/apache/pulsar/issues/14190#issuecomment-1033677413
An optional timestamp attached to a message by applications. For example, applications attach a timestamp on when the message is processed. If nothing is set to event time, the value is 0.
请问这个event time中的解释：
例如，应用程序在处理消息时附加时间戳。如果没有设置事件时间，则值为0。
（1）这在什么场景下使用的？感谢。比如在什么时候需要手动设置呢，，手动设置时间在哪个业务中应用到呢
（2）上面的翻译 消息处理的时间 这个处理的时间是指 生产的时间 还是消费的时间呢，
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org