You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2019/03/06 17:15:00 UTC
[jira] [Updated] (BEAM-4581) Python SDK does not correctly set the
serialized_fn of WindowInto when translating to the Dataflow pipeline
description
[ https://issues.apache.org/jira/browse/BEAM-4581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-4581:
----------------------------------
Labels: portability triaged (was: portability)
> Python SDK does not correctly set the serialized_fn of WindowInto when translating to the Dataflow pipeline description
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-4581
> URL: https://issues.apache.org/jira/browse/BEAM-4581
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Luke Cwik
> Priority: Major
> Labels: portability, triaged
>
> serialzed_fn at the bottom should be reference to the pipeline proto ptransform id representing this function.
> {code:java}
> {
> "kind": "ParallelDo",
> "name": "s4",
> "properties": {
> "display_data": [
> {
> "key": "fn",
> "label": "Transform Function",
> "namespace": "apache_beam.transforms.core.WindowInto",
> "shortValue": "WindowIntoFn",
> "type": "STRING",
> "value": "apache_beam.transforms.core.WindowIntoFn"
> }
> ],
> "non_parallel_inputs": {},
> "output_info": [
> {
> "encoding": {
> "@type": "kind:windowed_value",
> "component_encodings": [
> {
> "@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
> "component_encodings": [
> {
> "@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
> "component_encodings": []
> },
> {
> "@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
> "component_encodings": []
> }
> ],
> "is_pair_like": true
> },
> {
> "@type": "kind:global_window"
> }
> ],
> "is_wrapper": true
> },
> "output_name": "out",
> "user_name": "assert_that/WindowInto(WindowIntoFn).out"
> }
> ],
> "parallel_input": {
> "@type": "OutputReference",
> "output_name": "out",
> "step_name": "s2"
> },
> "serialized_fn": "<string of 328 bytes>",
> "user_name": "assert_that/WindowInto(WindowIntoFn)"
> }
> },
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)