You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/04/11 04:58:48 UTC
[GitHub] [incubator-inlong] healchow opened a new issue, #3601: [Bug][Manager] Should not create Hive resource when sink type is Kafka
healchow opened a new issue, #3601:
URL: https://github.com/apache/incubator-inlong/issues/3601
### What happened
Should not create Hive resource when sink type is Kafka:
```
2022-04-11 12:08:47.535 [http-nio-8080-exec-8] WARN o.a.i.m.s.t.hive.CreateHiveTableEventSelector:64 - groupId=b_docker_test_13 streamId=null does not have sink, skip to create hive table
29522 2022-04-11 12:08:47.550 [http-nio-8080-exec-8] INFO o.a.i.m.s.thirdparty.hive.CreateHiveTableListener:57 - begin to create hive table for groupId=b_docker_test_13
2022-04-11 12:08:47.550 [http-nio-8080-exec-8] DEBUG o.a.i.m.d.m.StreamSinkEntityMapper.selectAllConfig:137 - ==> Preparing: select sink.id, sink.inlong_group_id, sink.inlong_stream_id, sink.sink_t ype, sink.description, sink.enable_create_resource, sink.ext_params, sink.status, sink.creator, sink.sink_name, stream.mq_resource_obj, stream.data_source_type, stream.data_type, stream.data_separat or as sourceSeparator, stream.data_escape_char from inlong_stream stream, stream_sink sink WHERE stream.is_deleted = 0 and sink.is_deleted = 0 and stream.inlong_group_id = sink.inlong_group_id and s tream.inlong_stream_id = sink.inlong_stream_id and stream.inlong_group_id = ?
2022-04-11 12:08:47.552 [http-nio-8080-exec-8] DEBUG o.a.i.m.d.m.StreamSinkEntityMapper.selectAllConfig:137 - ==> Parameters: b_docker_test_13(String)
2022-04-11 12:08:47.554 [http-nio-8080-exec-8] DEBUG o.a.i.m.d.m.StreamSinkEntityMapper.selectAllConfig:137 - <== Total: 1
2022-04-11 12:08:47.556 [http-nio-8080-exec-8] ERROR o.a.i.manager.service.utils.SpringContextUtils:82 - Can not getBean:HiveTableOperator,error:No bean named 'HiveTableOperator' available
2022-04-11 12:08:47.560 [http-nio-8080-exec-8] DEBUG o.a.i.m.s.thirdparty.hive.DefaultHiveTableOperator:80 - begin create hive table for inlong group=b_docker_test_13, config=SinkForSortDTO(id=1, in longGroupId=b_docker_test_13, inlongStreamId=docker_test_13, sinkType=KAFKA, sinkName=docker_test_13, description=null, enableCreateResource=1, extParams={"bootstrapServers":"127.0.0.1:9092","topicN ame":"docker_test_13","partitionNum":null,"serializationType":"JSON","autoOffsetReset":null,"properties":{}}, status=110, creator=admin, mqResourceObj=docker_test_13, dataSourceType=FILE, dataType=T EXT, sourceSeparator=124, dataEscapeChar=null)
2022-04-11 12:08:47.564 [http-nio-8080-exec-8] INFO o.a.i.m.s.thirdparty.hive.DefaultHiveTableOperator:119 - begin to get table query bean for groupId=b_docker_test_13, streamId=docker_test_13
```
### What you expected to happen
Should not create Hive resource.
### How to reproduce
Create a Kafka sink, and approve the inlong group.
### Environment
_No response_
### InLong version
master
### InLong Component
InLong Manager
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong] healchow closed issue #3601: [Bug][Manager] Should not create Hive resource when sink type is Kafka
Posted by GitBox <gi...@apache.org>.
healchow closed issue #3601: [Bug][Manager] Should not create Hive resource when sink type is Kafka
URL: https://github.com/apache/incubator-inlong/issues/3601
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org