You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by "vernedeng (via GitHub)" <gi...@apache.org> on 2023/10/10 08:59:24 UTC

[I] [Bug][Sort] Fail to parse InlongMessage when exporting Pulsar and Kafka [inlong]

vernedeng opened a new issue, #9038:
URL: https://github.com/apache/inlong/issues/9038

   ### What happened
   
   Fail to parse InlongMessage when exporting Pulsar.
   
   The reason is that DataProxy puts the InlongGroupId and InlongStreamId into the Pulsar header with the key "groupId" and "streamId" when the transmission protocol is InlongMessage V0. 
   While the key with InlongMessage V1 is "inlongGroupId" and "inlongStreamId", which leads to the null value when the pulsar sink handler tries to parse this information from the message header.
   
   <img width="838" alt="image" src="https://github.com/apache/inlong/assets/45282474/8c937464-4ea7-453f-89de-72861428fcb9">
   
   <img width="1109" alt="image" src="https://github.com/apache/inlong/assets/45282474/8107122d-0317-48da-acfc-65e459c6fc33">
   
   
   ### What you expected to happen
   
   Parse correctlly.
   
   ### How to reproduce
   
   Use InlongMessage V0 as the transmission protocol, and try to export Pulsar and Kafka.
   
   ### Environment
   
   _No response_
   
   ### InLong version
   
   master
   
   ### InLong Component
   
   InLong Sort
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug][Sort] Fail to parse InlongMessage when exporting Pulsar [inlong]

Posted by "vernedeng (via GitHub)" <gi...@apache.org>.
vernedeng closed issue #9038: [Bug][Sort] Fail to parse InlongMessage when exporting Pulsar
URL: https://github.com/apache/inlong/issues/9038


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org