You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Miguel Anzo (Jira)" <ji...@apache.org> on 2021/10/01 22:53:00 UTC
[jira] [Commented] (BEAM-8453) Failure in
org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety
[ https://issues.apache.org/jira/browse/BEAM-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423437#comment-17423437 ]
Miguel Anzo commented on BEAM-8453:
-----------------------------------
Hi, I have been trying to get this issue resolved but I have some questions about how to proceed.
I initially thought this could be a concurrency issue, as that is what the test is about, but after analyzing the code and logs it seems that the NullPointerException is happening [here|https://github.com/apache/beam/blob/9a4cdfba601bae9165928d1a4df8035785b4c871/sdks/java/io/jms/src/test/java/org/apache/beam/sdk/io/jms/JmsIOTest.java#L386] which is when the test reads the first messages before the second thread is started and that has made me rethink that it might be a concurrency issue. Inside the advance() method the exception happens during the [receive()|https://github.com/apache/beam/blob/9a4cdfba601bae9165928d1a4df8035785b4c871/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsIO.java#L503] method, there where trying to reproduce the error locally my only success getting the same error was closing the consumer before the read happens, could it be that the flake happens because a closed consumer?
I have seen also that there have been other issues with the checkpoint finalization on JmsIO, is there someone with knowledge is this IO that can answer me some questions regarding the finalizaCheckpoint part and how the consumer is created/closed?
Thanks
> Failure in org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety
> ------------------------------------------------------------------------
>
> Key: BEAM-8453
> URL: https://issues.apache.org/jira/browse/BEAM-8453
> Project: Beam
> Issue Type: Bug
> Components: io-java-jms
> Reporter: Kenneth Knowles
> Assignee: Miguel Anzo
> Priority: P1
> Labels: flake
> Fix For: Not applicable
>
>
> {code}
> Caused by: java.lang.NullPointerException: (No message provided)
> at org.apache.beam.sdk.io.jms.JmsIOTest.lambda$withSlowAcks$2(JmsIOTest.java:463)
> at org.apache.beam.sdk.io.jms.JmsIOTest.lambda$proxyMethod$6(JmsIOTest.java:489)
> at com.sun.proxy.$Proxy62.receiveNoWait(Unknown Source)
> at org.apache.beam.sdk.io.jms.JmsIO$UnboundedJmsReader.advance(JmsIO.java:512)
> at org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety(JmsIOTest.java:381)
> ...
> {code}
> stdout:
> {code}
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartPersistenceAdapter
> INFO: Using Persistence Adapter: MemoryPersistenceAdapter
> Oct 21, 2019 9:52:32 PM org.apache.activemq.store.kahadb.plist.PListStoreImpl doStart
> INFO: PListStore:[/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit@2/src/sdks/java/io/jms/activemq-data/localhost/tmp_storage] started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: Apache ActiveMQ 5.13.1 (localhost, ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is starting
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.TransportConnector start
> INFO: Connector vm://localhost started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: Apache ActiveMQ 5.13.1 (localhost, ID:apache-beam-jenkins-8-45641-1571694713139-0:6) started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: For help or more information please see: http://activemq.apache.org
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost, ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is shutting down
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.TransportConnector stop
> INFO: Connector vm://localhost stopped
> Oct 21, 2019 9:52:33 PM org.apache.activemq.store.kahadb.plist.PListStoreImpl doStop
> INFO: PListStore:[/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit@2/src/sdks/java/io/jms/activemq-data/localhost/tmp_storage] stopped
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost, ID:apache-beam-jenkins-8-45641-1571694713139-0:6) uptime 0.512 seconds
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost, ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is shutdown
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)