You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/08/13 16:03:29 UTC
[GitHub] [incubator-pinot] lgo opened a new issue #5859: Lack of documentation about cluster networking
lgo opened a new issue #5859:
URL: https://github.com/apache/incubator-pinot/issues/5859
While setting up a Pinot cluster in an environment with strict egress/ingress rules it has been a challenge to bump into various cluster interop that wasn't documented.
Based on the docs I recall, the only concise indication of the connectivity is this diagram: https://docs.pinot.apache.org/basics/architecture#core-components
This came with a couple surprises so far:
* Servers connect to the Controller's API for pulling locally stored segments
* Controllers proxy queries from the query console to the Broker's API
There's other areas that I'm lightly aware of but have not yet dealt with, such as batch ingestion jobs connecting to Controllers for notifying of new segments.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #5859: Lack of documentation about cluster networking
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #5859:
URL: https://github.com/apache/incubator-pinot/issues/5859#issuecomment-675127615
hmm.
In general we expect the inter-communications across zookeeper/controller/broker/server.
From externally access, we had:
- external requests to Controller for cluster/table ops
- external queries go to Controller for query console access
- external queries go to Broker for programatic access with pinot clients
- We expect controller and server to talk to data upstreams(kafka)/deepstore(s3/hdfs) etc
Also if using presto connector, Presto requires full access to pinot controller/broker/server.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #5859: Lack of documentation about cluster networking
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #5859:
URL: https://github.com/apache/incubator-pinot/issues/5859#issuecomment-675127615
In general we expect the inter-communications across zookeeper/controller/broker/server.
From externally access, we had:
- external requests to Controller for cluster/table ops
- external queries go to Controller for query console access
- external queries go to Broker for programatic access with pinot clients
- We expect controller and server to talk to data upstreams(kafka)/deepstore(s3/hdfs) etc
Also if using presto connector, Presto requires full access to pinot controller/broker/server.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org