You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2022/03/24 02:47:11 UTC
[GitHub] [rocketmq-connect] sunxi92 opened a new issue #25: FileSourceConnector cannot send data to a topic specified in RocketMQ
sunxi92 opened a new issue #25:
URL: https://github.com/apache/rocketmq-connect/issues/25
**BUG REPORT**
1. Please describe the issue you observed:
When I test the demo rocketmq-connect-sample, I find that there is no data in the topic fileTopic.
- What did you do (The steps to reproduce)?
follow the link:
https://rocketmq-1.gitbook.io/rocketmq-connector/quick-start/runtime-qs
https://rocketmq-1.gitbook.io/rocketmq-connector/quick-start/file-connector
- What is expected to see?
(1)The topic fileTopic have the data
(2)FileSinkConnector can transfer data to specified file
- What did you see instead?
<img width="1436" alt="image" src="https://user-images.githubusercontent.com/25401190/159831635-b0003b43-8ae7-4dd2-87be-52dda4dc8110.png">
3. Please tell us about your environment:
4. Other information (e.g. detailed explanation, logs, related issues, suggestions on how to fix, etc):
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] odbozhou commented on issue #25: FileSourceConnector cannot send data to a topic specified in RocketMQ
Posted by GitBox <gi...@apache.org>.
odbozhou commented on issue #25:
URL: https://github.com/apache/rocketmq-connect/issues/25#issuecomment-1078677056
Can you describe in detail how it happened? Configuration of FileSourceConnector, using branch of rocketmq-connect ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] sunxi92 commented on issue #25: FileSourceConnector cannot send data to a topic specified in RocketMQ
Posted by GitBox <gi...@apache.org>.
sunxi92 commented on issue #25:
URL: https://github.com/apache/rocketmq-connect/issues/25#issuecomment-1078695879
> Can you describe in detail how it happened? Configuration of FileSourceConnector, using branch of rocketmq-connect ?
I follow the following steps to operate：
(1)Start a RocketMQ cluster and create the topic fileTopic
(2)Build the project
(3)Update the connect.conf, include storePathRootDir、pluginPaths
(4)Copy rocketmq-connect-sample-0.0.1-SNAPSHOT.jar to pluginPaths
(5)Prepare the source data
(6)Run run_worker.sh
(7)Start the source connector:
http://127.0.0.1:8082/connectors/fileConnectorSource?config={
"connector-class":"org.apache.rocketmq.connect.file.FileSourceConnector",
"topic":"fileTopic",
"filename":"/Users/sunxi/Documents/application/rocketmq-connect/source-file/source-file.txt",
"source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"
}
The console information is as follows:
INFO qtp624271064-23 - config: {"connector-class":"org.apache.rocketmq.connect.file.FileSourceConnector","topic":"fileTopic","filename":"/Users/sunxi/Documents/application/rocketmq-connect/source-file/source-file.txt","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}
(8)Start the sink connector:
http://127.0.0.1:8082/connectors/fileConnectorSink?config={
"connector-class":"org.apache.rocketmq.connect.file.FileSinkConnector",
"topicNames":"fileTopic",
"filename":"/Users/sunxi/Documents/application/rocketmq-connect/source-file/sink-file.txt",
"source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"
}
The console information is as follows:
INFO qtp624271064-20 - config: {"connector-class":"org.apache.rocketmq.connect.file.FileSinkConnector","topicNames":"fileTopic","filename":"/Users/sunxi/Documents/application/rocketmq-connect/source-file/sink-file.txt","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}
The results are as follow:
(1)The topic fileTopic has no data
(2)Since there is no data in topic fileTopic, the data is not transferred to the specified file
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] odbozhou commented on issue #25: FileSourceConnector cannot send data to a topic specified in RocketMQ
Posted by GitBox <gi...@apache.org>.
odbozhou commented on issue #25:
URL: https://github.com/apache/rocketmq-connect/issues/25#issuecomment-1085547360
Please update the latest master code, this issue has been resolved. However, due to the upgrade of the api. The latest code has solved this problem.
Please install the latest api, mvn install locally https://github.com/openmessaging/openconnect/pull/37
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org