You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by "waynelao (via GitHub)" <gi...@apache.org> on 2023/05/25 20:02:23 UTC

[GitHub] [streampipes] waynelao created a discussion: Can not create a new adapter

GitHub user waynelao created a discussion: Can not create a new adapter

Hi there,

I am currently using StreamPipes 0.91.0 and run docker-compose up -d to start the application. I follow the documentation here (https://streampipes.apache.org/docs/docs/use-connect.html) to create a new adapter. Once I fill the required infos (access mode, boker hostname, port) and there is an error on Topic. 
[adapter-issue.pdf](https://github.com/apache/streampipes/files/11568782/adapter-issue.pdf)
Any solution to this issue? Really appreciate the help!

GitHub link: https://github.com/apache/streampipes/discussions/1594

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] waynelao edited a discussion: Can not create a new adapter

Posted by "waynelao (via GitHub)" <gi...@apache.org>.
GitHub user waynelao edited a discussion: Can not create a new adapter

Hi there,

I am currently using StreamPipes 0.91.0 and run docker-compose up -d to start the application. I follow the documentation here (https://streampipes.apache.org/docs/docs/use-connect.html) to create a new adapter. Once I fill the required infos (access mode, boker hostname, port) and there is an error on Topic. 
![adapter-issue](https://github.com/apache/streampipes/assets/34040970/dcc97dfb-d031-4943-a868-0a0429b57748)

Any solution to this issue? Really appreciate the help!

GitHub link: https://github.com/apache/streampipes/discussions/1594

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] tenthe added a comment to the discussion: Can not create a new adapter

Posted by "tenthe (via GitHub)" <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Can not create a new adapter

Hi @waynelao,

sure. Here is an example for the configuration:
- **Access Mode:** Unauthenticated Plain
- **Broker Hostname:** kafka
- **Broker Port:** 9092

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6009533

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] waynelao added a comment to the discussion: Can not create a new adapter

Posted by "waynelao (via GitHub)" <gi...@apache.org>.
GitHub user waynelao added a comment to the discussion: Can not create a new adapter

It works great, thank you!

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6013232

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] tenthe added a comment to the discussion: Can not create a new adapter

Posted by "tenthe (via GitHub)" <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Can not create a new adapter

Hi @waynelao,
thanks for reporting the problem.

What does the error message say when you click Details?
It seems that you cannot connect to your Kafka cluster. 
In this stage StreamPipes tries to connect to Kafka and read all available topics.
Is Kafka port 9092 configured in Kafka for this inbound IP?

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6005033

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] waynelao added a comment to the discussion: Can not create a new adapter

Posted by "waynelao (via GitHub)" <gi...@apache.org>.
GitHub user waynelao added a comment to the discussion: Can not create a new adapter

Hi @tenthe,
Thank you for the quick reply. 

Here is the detail error message
![error-info](https://github.com/apache/streampipes/assets/34040970/82dd5853-5cd1-4344-a17f-560d09496e85)
I don't think Kafka is configured in port 9092 as I check the docker.
Here is the docker info:
![docker-info](https://github.com/apache/streampipes/assets/34040970/1e68cf4f-ce39-4e31-a1c6-af95e6b83f35)

Should I manually set up Kafka in port 9092? (I thought by running docker-compose up -d, Kafka is automatically configured).

Thank you!


GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6005139

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


Re: [D] Can not create a new adapter (streampipes)

Posted by "tenthe (via GitHub)" <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Can not create a new adapter

Great, I am happy to hear that. If you have any problems or feedback feel free to share it in a discussion.

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6015655

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] tenthe added a comment to the discussion: Can not create a new adapter

Posted by "tenthe (via GitHub)" <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Can not create a new adapter

Ah ok, if you are using the internal Kafka you must use the DNS name "Kafka" instead of the IP address. 

If you want to use the IP address of your host you must change the configurations of Kafka. Please let me know if this fixes your problem.

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6005695

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] waynelao edited a comment on the discussion: Can not create a new adapter

Posted by "waynelao (via GitHub)" <gi...@apache.org>.
GitHub user waynelao edited a comment on the discussion: Can not create a new adapter

> Ah ok, if you are using the internal Kafka you must use the DNS name "Kafka" instead of the IP address.

Sorry, I don't really understand. Are you talking about making changes in docker-compose.yml file or something else?


Could you please provide step-by-step guidance on how to make StreamPipes connect to Kafka?
Thank you!

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6005879

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org


[GitHub] [streampipes] waynelao added a comment to the discussion: Can not create a new adapter

Posted by "waynelao (via GitHub)" <gi...@apache.org>.
GitHub user waynelao added a comment to the discussion: Can not create a new adapter

> Ah ok, if you are using the internal Kafka you must use the DNS name "Kafka" instead of the IP address.
Sorry, I don't really understand. Are you talking about making changes in docker-compose.yml file or something else?
Could you please provide step-by-step guidance on how to make StreamPipes connect to Kafka?
Thank you!

GitHub link: https://github.com/apache/streampipes/discussions/1594#discussioncomment-6005879

----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org