You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/11/02 07:04:20 UTC
[GitHub] [pinot] matthiasValuecloud opened a new issue, #9670: Working with new schema registry consuming serialized avro messages
matthiasValuecloud opened a new issue, #9670:
URL: https://github.com/apache/pinot/issues/9670
I am currently trying to ingest avro messages from a kafka topic using a schema registry into a pinot table.
Currently that results in an errorr: (snapshot from the pinot-server pod)
see image
The error states, that there is an unrecognized field "references", when trying to get the schema for a given kafka topic.
`curl http://localhost:8081/apis/ccompat/v6/schemas/ids/4 | jq` (getting the schema from the registry) results in
` {
"schema": "{...}",
"references": []
}`
As one can see by the url, I am currently using the apicurio schema registry
The problem can be solved by upgrading the confluent package to a newer version e.g. 7.x (testing on a local machine).
Is it possible to upgrade the version of the confluent dependency in the pom.xml?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] matthiasValuecloud commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
matthiasValuecloud commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1378349677
Any news on that subject?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] matthiasValuecloud closed issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
matthiasValuecloud closed issue #9670: Working with new schema registry consuming serialized avro messages
URL: https://github.com/apache/pinot/issues/9670
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1297480529
Is this a confluent library support issue? If so, I don't have a big concern on upgrading the confluent version. We need to make sure the new confluent version is compatible with other dependencies though.
Do you want to help contribute this fix?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1320874287
cc @xiangfu0 any idea on this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] matthiasValuecloud closed issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
matthiasValuecloud closed issue #9670: Working with new schema registry consuming serialized avro messages
URL: https://github.com/apache/pinot/issues/9670
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] matthiasValuecloud closed issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
matthiasValuecloud closed issue #9670: Working with new schema registry consuming serialized avro messages
URL: https://github.com/apache/pinot/issues/9670
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] matthiasValuecloud commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
matthiasValuecloud commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1310294304
f
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1304288238
@matthiasValuecloud Currently Pinot is using `5.5.3`, and there is not much dependency change if we upgrade to ` 5.5.12`. Can you please check if the problem can be fixed with `5.5.12`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1320874860
Also cc @elonazoulay @ddcprg who contributed to the confluent avro package
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] matthiasValuecloud commented on issue #9670: Working with new schema registry consuming serialized avro messages
Posted by GitBox <gi...@apache.org>.
matthiasValuecloud commented on issue #9670:
URL: https://github.com/apache/pinot/issues/9670#issuecomment-1299672784
Of course one needs to make sure that the other dependencies are still compatible.
To be honest, i have never contributed to a big project like this :D.
So maybe it would be suitable for people with better skills in that area can do it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org