You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/03/10 18:28:14 UTC
[GitHub] [incubator-inlong] healchow opened a new issue #3054: [Bug][Sort] Start sort task failed as parsing the config error
healchow opened a new issue #3054:
URL: https://github.com/apache/incubator-inlong/issues/3054
### What happened
The error log in Flink Job Manager:
```
2022-03-11 02:00:31,860 WARN org.apache.flink.runtime.taskmanager.Task [] - Source: Pulsar source (1/1)#661 (c71c4057ed239170759f4775fa43c6bb) switched from INITIALIZING to FAILED with failure cause: org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.exc.InvalidDefinitionException: Cannot construct instance of `org.apache.inlong.sort.protocol.transformation.TransformationRule` (no Creators, like default constructor, exist): abstract types either need to be mapped to concrete types, have custom deserializer, or contain additional type information
at [Source: (byte[])"{"id":3,"source_info":{"type":"pulsar","admin_url":"http://127.0.0.1:8080","service_url":"pulsar://127.0.0.1:6650","topic":"persistent://public/b_test_group/test_stream","subscription_name":"inlong_app_test_stream_consumer_group","deserialization_info":{"type":"json"},"fields":[{"type":"base","name":"dt","format_info":{"type":"timestamp","format":"MILLIS"}},{"type":"base","name":"age","format_info":{"type":"int"}},{"type":"base","name":"name","format_info":{"type":"string"}}],"authentica"[truncated 957 bytes]; line: 1, column: 1131] (through reference chain: org.apache.inlong.sort.protocol.DataFlowInfo["transformation_info"]->org.apache.inlong.sort.protocol.transformation.TransformationInfo["transform_rule"])
at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.exc.InvalidDefinitionException.from(InvalidDefinitionException.java:67)
...
at org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3609)
at org.apache.inlong.sort.meta.zookeeper.ZookeeperMetaWatcher$DataFlowsChildrenWatcherListener.getDataFlowInfo(ZookeeperMetaWatcher.java:158)
at org.apache.inlong.sort.meta.zookeeper.ZookeeperMetaWatcher$DataFlowsChildrenWatcherListener.onChildAdded(ZookeeperMetaWatcher.java:107)
at org.apache.inlong.sort.meta.zookeeper.ZookeeperMetaWatcher$DataFlowsChildrenWatcherListener.onInitialized(ZookeeperMetaWatcher.java:149)
at org.apache.inlong.sort.meta.zookeeper.ZookeeperWatcherUtils.open(ZookeeperWatcherUtils.java:94)
at org.apache.inlong.sort.meta.zookeeper.ZookeeperMetaWatcher.open(ZookeeperMetaWatcher.java:60)
at org.apache.inlong.sort.meta.MetaManager.open(MetaManager.java:100)
at org.apache.inlong.sort.meta.MetaManager.getInstance(MetaManager.java:66)
at org.apache.inlong.sort.flink.multitenant.pulsar.MultiTopicPulsarSourceFunction.open(MultiTopicPulsarSourceFunction.java:66)
```
### What you expected to happen
The Sort task should be started successfully.
### How to reproduce
Push Hive sink info to ZooKeeper and start the Sort job, you'll see the above error.
### Environment
_No response_
### InLong version
master
### InLong Component
InLong Sort
### Are you willing to submit PR?
- [ ] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong] healchow commented on issue #3054: [Bug][Sort] Start sort task failed as parsing the config error
Posted by GitBox <gi...@apache.org>.
healchow commented on issue #3054:
URL: https://github.com/apache/incubator-inlong/issues/3054#issuecomment-1064694907
Fixed by https://github.com/apache/incubator-inlong/pull/3056.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong] healchow closed issue #3054: [Bug][Sort] Start sort task failed as parsing the config error
Posted by GitBox <gi...@apache.org>.
healchow closed issue #3054:
URL: https://github.com/apache/incubator-inlong/issues/3054
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org