You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "shunping (via GitHub)" <gi...@apache.org> on 2025/10/23 23:50:54 UTC

[I] [Bug]: Failed pipeline on Prism when sliding window size is smaller than sliding interval [beam]

shunping opened a new issue, #36609:
URL: https://github.com/apache/beam/issues/36609

   ### What happened?
   
   The following code failed to run in Prism. 
   ```
   import logging
   
   import apache_beam as beam
   from apache_beam.options.pipeline_options import PipelineOptions
   from apache_beam.transforms.window import TimestampedValue, SlidingWindows
   from apache_beam.utils.timestamp import Timestamp
   
   logging.basicConfig(level=logging.INFO)
   
   
   options = PipelineOptions([
       "--environment_type=LOOPBACK",
       "--runner=PrismRunner",
   ])
   
   
   with beam.Pipeline(options=options) as p:
     now = Timestamp.now()
     _ = (
         p | beam.Create([TimestampedValue(1, 1),
                          TimestampedValue(2, 2),
                          TimestampedValue(3, 3),
                          TimestampedValue(4, 4),
                          TimestampedValue(5, 5),
                          TimestampedValue(6, 6),
                          TimestampedValue(7, 7),
                          TimestampedValue(8, 8),
                          TimestampedValue(9, 9),
                          TimestampedValue(10, 10)],
                          )
         | beam.WithKeys(0)
         | beam.WindowInto(SlidingWindows(5, 10))
         | beam.LogElements(
             prefix="result=",
             level=logging.WARNING,
             with_timestamp=True,
             with_window=True,
             use_epoch_time=True))
   
   ```
   
   Error message is like:
   
   ```
   error decoding residual header: sdk provided a windowed value header 0 windows
   ```
   
   ### Issue Priority
   
   Priority: 2 (default / most bugs should be filed as P2)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Infrastructure
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Failed pipeline on Prism when sliding window size is smaller than sliding interval [beam]

Posted by "shunping (via GitHub)" <gi...@apache.org>.
shunping closed issue #36609: [Bug]: Failed pipeline on Prism when sliding window size is smaller than sliding interval
URL: https://github.com/apache/beam/issues/36609


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org