[GitHub] [beam] kennknowles opened a new issue, #18364: Allow user provided function to extract custom timestamp from payload in pubsubIO

[GitBox <gi...@apache.org>]

kennknowles opened a new issue, #18364:
URL: https://github.com/apache/beam/issues/18364

   Currently the PubsubIO runner only allows the caller to set a custom timestamp if the timestamp is defined in the attributes of the message.  This can be problematic when the user does not control the publisher.  In such a case, proper windowing of data requires the timestamp to be pulled out of the message payload.  
   
   Since a payload could have arbitrary data, the user would have to provide a Function<T, String\>() that would extract the timestamp from the payload:
   
   PubsubIo.Read.timestampLabel(Function<T, String\> extractor);
   
   Imported from Jira [BEAM-1936](https://issues.apache.org/jira/browse/BEAM-1936). Original Jira may contain additional context.
   Reported by: berkoben.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org