You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/11/27 11:23:37 UTC
[GitHub] [inlong] wangpeix opened a new issue, #6639: [Bug][Sort] DynamicPulsarDeserializationSchema threw NPE when sourceMetricData is not initialized
wangpeix opened a new issue, #6639:
URL: https://github.com/apache/inlong/issues/6639
### What happened
When sourceMetricData is not initialized, DynamicPulsarDeserializationSchema throws a null pointer exception.
### What you expected to happen
```java
java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.inlong.sort.pulsar.withoutadmin.CallbackCollector.collect(CallbackCollector.java:39)
at org.apache.inlong.sort.formats.inlongmsg.InLongMsgDeserializationSchema.emitRow(InLongMsgDeserializationSchema.java:157)
at org.apache.inlong.sort.formats.inlongmsg.InLongMsgDeserializationSchema.lambda$deserialize$0(InLongMsgDeserializationSchema.java:113)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1380)
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at org.apache.inlong.sort.formats.inlongmsg.InLongMsgDeserializationSchema.deserialize(InLongMsgDeserializationSchema.java:113)
at org.apache.flink.streaming.util.serialization.ThreadSafeDeserializationSchema.deserialize(ThreadSafeDeserializationSchema.java:53)
at org.apache.inlong.sort.pulsar.table.DynamicPulsarDeserializationSchema.deserialize(DynamicPulsarDeserializationSchema.java:128)
at org.apache.inlong.sort.pulsar.table.DynamicPulsarDeserializationSchema.deserialize(DynamicPulsarDeserializationSchema.java:119)
at org.apache.inlong.sort.pulsar.table.DynamicPulsarDeserializationSchema.deserialize(DynamicPulsarDeserializationSchema.java:47)
at org.apache.flink.streaming.connectors.pulsar.internal.ReaderThread.emitRecord(ReaderThread.java:171)
at org.apache.flink.streaming.connectors.pulsar.internal.ReaderThread.run(ReaderThread.java:110)
Caused by: java.lang.NullPointerException
at org.apache.inlong.sort.pulsar.table.DynamicPulsarDeserializationSchema.lambda$deserialize$0(DynamicPulsarDeserializationSchema.java:129)
at org.apache.inlong.sort.pulsar.withoutadmin.CallbackCollector.collect(CallbackCollector.java:37)
... 11 more
```
### How to reproduce
Inlong manager generates the following sql. use this sql can reproduce the problem.
```sql
CREATE TABLE `table_stream_01`(
`uid` STRING,
`event_time` STRING)
WITH (
'inlong.metric.labels' = 'groupId=group_002&streamId=stream_01&nodeId=stream_01',
'connector' = 'pulsar-inlong',
'inlong-msg.csv.disable-quote-character' = 'true',
'inlong-msg.inner.format' = 'csv',
'inlong-msg.csv.allow-comments' = 'false',
'format' = 'inlong-msg',
'inlong-msg.csv.field-delimiter' = ',',
'inlong-msg.csv.ignore-parse-errors' = 'true',
'inlong-msg.ignore-parse-errors' = 'false',
'admin-url' = 'http://x.x.x.x:8080',
'generic' = 'true',
'service-url' = 'pulsar://x.x.x.x:6650',
'topic' = 'public/group_002/stream_01',
'scan.startup.mode' = 'earliest'
);
CREATE TABLE `table_sink_01`(
PRIMARY KEY (`event_time`) NOT ENFORCED,
`uid` STRING,
`event_time` STRING)
WITH (
'inlong.metric.labels' = 'groupId=group_002&streamId=stream_01&nodeId=sink_01',
'connector' = 'jdbc-inlong',
'url' = 'jdbc:mysql://x.x.x.x:3306/test_data',
'username' = 'xxx',
'password' = 'xxx',
'table-name' = 'test_11251558'
);
INSERT INTO `table_sink_01`
SELECT
`uid` AS `uid`,
`event_time` AS `event_time`
FROM `table_stream_01`;
```
### Environment
_No response_
### InLong version
master
### InLong Component
InLong Sort
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] healchow closed issue #6639: [Bug][Sort] DynamicPulsarDeserializationSchema threw NPE when sourceMetricData is not initialized
Posted by GitBox <gi...@apache.org>.
healchow closed issue #6639: [Bug][Sort] DynamicPulsarDeserializationSchema threw NPE when sourceMetricData is not initialized
URL: https://github.com/apache/inlong/issues/6639
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org