You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/07/15 20:45:25 UTC
[GitHub] [incubator-pinot] KKcorps opened a new issue #7166: JDBC driver doesn't work with Kuberneteres Pinot cluster
KKcorps opened a new issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166
The JDBC driver is not able to run queries if pinot is deployed in kubernetes cluster.
The driver uses controller URL in the connection and then fetches the broker list from controller for the tenant specified in JDBC properties
Now what's happening is that in clusters such as k8s, the controller returns the broker hostname and not IP/ingress url
```bash
curl -X GET "http://localhost:9000/v2/brokers/tenants/DefaultTenant?state=ONLINE" -H "accept: application/json"
```
Queries cannot be executed against hostname since it is unresolvable to the drivers which are running outside the Kubernetes cluster.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] xiangfu0 commented on issue #7166: JDBC driver doesn't work with Kubernetes Pinot cluster
Posted by GitBox <gi...@apache.org>.
xiangfu0 commented on issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166#issuecomment-881060908
You are right, pinot client expects to use pinot controller for getting table management info and broker to query.
Here is one workaround solution: modify pinot client to take a flag/param to be controller-only mode, so it can query pinot directly on the controller. Then JDBC-driver also need to pass that flag to the pinot-client.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] KKcorps commented on issue #7166: JDBC driver doesn't work with Kubernetes Pinot cluster
Posted by GitBox <gi...@apache.org>.
KKcorps commented on issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166#issuecomment-882453631
@xiangfu0 The proxy deployment solution is scalable but less pragmatic for users who will be using the driver. Either we should provide an out of the box proxy which can be easily deployed OR expose query endpoint in controller which may not be scalable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] xiangfu0 commented on issue #7166: JDBC driver doesn't work with Kubernetes Pinot cluster
Posted by GitBox <gi...@apache.org>.
xiangfu0 commented on issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166#issuecomment-881061595
another workaround is to write a proxy service to take this if we don't want a lot of traffics to the controller. I know Uber is doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] xiangfu0 edited a comment on issue #7166: JDBC driver doesn't work with Kubernetes Pinot cluster
Posted by GitBox <gi...@apache.org>.
xiangfu0 edited a comment on issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166#issuecomment-881061595
Another way is to write a rest proxy service and deploy it inside the k8s cluster to table traffic for both data and query traffic and only expose this endpoint to external.
This is to avoid putting a large query load on the controller.
I know Uber is doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] KKcorps commented on issue #7166: JDBC driver doesn't work with Kuberneteres Pinot cluster
Posted by GitBox <gi...@apache.org>.
KKcorps commented on issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166#issuecomment-881001979
@Jackie-Jiang @kishoreg
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] KKcorps commented on issue #7166: JDBC driver doesn't work with Kubernetes Pinot cluster
Posted by GitBox <gi...@apache.org>.
KKcorps commented on issue #7166:
URL: https://github.com/apache/incubator-pinot/issues/7166#issuecomment-882453631
@xiangfu0 The proxy deployment solution is scalable but less pragmatic for users who will be using the driver. Either we should provide an out of the box proxy which can be easily deployed OR expose query endpoint in controller which may not be scalable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org