You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Scott Wegner (JIRA)" <ji...@apache.org> on 2016/08/22 18:04:20 UTC

[jira] [Created] (BEAM-575) "Latest String" Aggregator

Scott Wegner created BEAM-575:
---------------------------------

             Summary: "Latest String" Aggregator
                 Key: BEAM-575
                 URL: https://issues.apache.org/jira/browse/BEAM-575
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-core
            Reporter: Scott Wegner
            Assignee: Scott Wegner


Beam SDK recently gained support for "display data", which is construction-time metadata about a pipeline. Display data is limited in that it doesn't provide a way to publish runtime metadata.

Aggregators are the current method for pipelines to publish runtime metadata, but currently focuses on counter-type metadata. It would be valuable to expand the support for dynamically-computed properties like "pub-sub subscription id" or "sink export job status". This would fit nicely into the aggregators API by providing a "Latest" combiner with String-typed data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)