You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2021/08/15 17:23:01 UTC
[jira] [Commented] (BEAM-12085) PubsubLiteIO.read() fails in
DataflowRunner v1 due to lack of BundleFinalizer support
[ https://issues.apache.org/jira/browse/BEAM-12085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399382#comment-17399382 ]
Beam JIRA Bot commented on BEAM-12085:
--------------------------------------
This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3.
Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean.
> PubsubLiteIO.read() fails in DataflowRunner v1 due to lack of BundleFinalizer support
> -------------------------------------------------------------------------------------
>
> Key: BEAM-12085
> URL: https://issues.apache.org/jira/browse/BEAM-12085
> Project: Beam
> Issue Type: New Feature
> Components: extensions-java-gcp
> Affects Versions: 2.28.0
> Reporter: Tianzi Cai
> Priority: P2
> Labels: PubsubLiteIO, dataflow, stale-P2
>
> Reading from a Pub/Sub Lite subscription using PubsubLiteIO fails with DataflowRunner. It works in DirectRunner.
> {code:java}
> import org.apache.beam.sdk.io.gcp.pubsublite.PubsubLiteIO;
> //..
> pipeline
> .apply("Read From Lite", PubsubLiteIO.read(subscriberOpitons))
> .apply("Convert and print", MapElements.into(TypeDescriptors.strings()).via(
> (SequencedMessage sequencedMessage) -> {
> String data = sequencedMessage.getMessage().getData().toStringUtf8();
> LOG.info("Received: " + data);
> return data;
> }
> ));
> {code}
> {noformat}
> java.lang.UnsupportedOperationException: BundleFinalizer unsupported by non-portable Dataflow.
> at org.apache.beam.runners.dataflow.worker.SplittableProcessFnFactory$SplittableDoFnRunnerFactory.lambda$createRunner$2(SplittableProcessFnFactory.java:170)
> at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.OutputAndTimeBoundedSplittableProcessElementInvoker$1.bundleFinalizer(OutputAndTimeBoundedSplittableProcessElementInvoker.java:195)
> at org.apache.beam.sdk.io.gcp.pubsublite.PerSubscriptionPartitionSdf$DoFnInvoker.invokeProcessElement(Unknown Source)
> at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.OutputAndTimeBoundedSplittableProcessElementInvoker.invokeProcessElement(OutputAndTimeBoundedSplittableProcessElementInvoker.java:123)
> at org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SplittableParDoViaKeyedWorkItems$ProcessFn.processElement(SplittableParDoViaKeyedWorkItems.java:523)
> {noformat}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)