You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Mourad (JIRA)" <ji...@apache.org> on 2019/05/26 11:04:00 UTC
[jira] [Created] (BEAM-7427) JmsCheckpointMark AVRO Serialisation
issue with unbounded Source
Mourad created BEAM-7427:
----------------------------
Summary: JmsCheckpointMark AVRO Serialisation issue with unbounded Source
Key: BEAM-7427
URL: https://issues.apache.org/jira/browse/BEAM-7427
Project: Beam
Issue Type: Bug
Components: io-java-jms
Affects Versions: 2.12.0
Environment: Message Broker : solace
JMS Client (Over AMQP) : "org.apache.qpid:qpid-jms-client:0.42.0
Reporter: Mourad
I get the following exception when reading from unbounded JMS Source:
{code:java}
Caused by: org.apache.avro.SchemaParseException: Illegal character in: this$0
at org.apache.avro.Schema.validateName(Schema.java:1151)
at org.apache.avro.Schema.access$200(Schema.java:81)
at org.apache.avro.Schema$Field.<init>(Schema.java:403)
at org.apache.avro.Schema$Field.<init>(Schema.java:396)
at org.apache.avro.reflect.ReflectData.createSchema(ReflectData.java:622)
at org.apache.avro.reflect.ReflectData.createFieldSchema(ReflectData.java:740)
at org.apache.avro.reflect.ReflectData.createSchema(ReflectData.java:604)
at org.apache.avro.specific.SpecificData$2.load(SpecificData.java:218)
at org.apache.avro.specific.SpecificData$2.load(SpecificData.java:215)
at avro.shaded.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
at avro.shaded.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
at avro.shaded.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2313)
at avro.shaded.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2228)
{code}
The exception is thrown by Avro when introspecting {{JmsCheckpointMark}} to generate schema.
JmsIO config :
{{PCollection<DFAMessage> messages = pipeline.apply("read messages from the events broker", JmsIO.<DFAMessage>readMessage() .withConnectionFactory(jmsConnectionFactory) .withTopic(options.getTopic()) .withMessageMapper(new DFAMessageMapper()) .withCoder(AvroCoder.of(DFAMessage.class)));}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)