You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/11/11 05:02:32 UTC
[GitHub] [incubator-pinot] rec7y33 opened a new issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
rec7y33 opened a new issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257
Hello, I followed this guide : https://docs.pinot.apache.org/basics/getting-started/advanced-pinot-setup
and have successfully setup the cluster in docker on my ubuntu VM.
However, once I restart the docker service/ reboot the ubuntu VM, i found out broker log has this error:
`No server found for request 8: select * from sitevisitordata limit 10`
any advice? thanks
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-725599855
if you are running in docker, then you can config the dns resolvable host name in config file.
For docker, usually we can give each container a name, like `pinot-controller-0`, `pinot-broker-1`.
E.g. below will start a pinot controller in container named `pinot-controller-0`
```
docker run --rm -ti \
--name pinot-controller-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
-p 9000:9000 \
apachepinot/pinot:latest StartController \
-configFileName /tmp/controller.conf
```
Then for this setup we can configure the pinot controller host name registered in zk by adding below line into controller configure file.
```
controller.host=pinot-controller-0
```
Similarly, we can configure pinot server conf by adding below line:
```
pinot.server.netty.host=pinot-server-0
```
This `pinot-server-0` is the docker container name, so when we start the docker container, we need to specify the `--name `
e.g.
```
docker run --rm -ti \
--name pinot-server-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
apachepinot/pinot:latest StartServer \
-zkAddress zookeeper:2181 -clusterName pinot-docker \
-configFileName /tmp/server.conf
```
For Pinot broker, it's a bit tricky, the config to add right now is:
instanceId=Broker_<broker host>_<broker port>
```
instanceId=Broker_pinot-broker-0_8099
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-725599855
if you are running in docker, then you can config the dns resolvable host name in config file.
For docker, usually we can give each container a name, like `pinot-controller-0`, `pinot-broker-1`.
E.g. below will start a pinot controller in container named `pinot-controller-0`
```
docker run --rm -ti \
--name pinot-controller-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
-p 9000:9000 \
apachepinot/pinot:latest StartController \
-configFileName /tmp/controller.conf
```
Then for this setup we can configure the pinot controller host name registered in zk by adding below line into controller configure file.
```
controller.host=pinot-controller-0
```
Similarly, we can configure pinot server conf by adding below line:
```
pinot.server.netty.host=pinot-server-0
```
This `pinot-server-0` is the docker container name, so when we start the docker container, we need to specify the `--name `
e.g.
```
docker run --rm -ti \
--name pinot-server-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
apachepinot/pinot:latest StartServer \
-zkAddress zookeeper:2181 -clusterName pinot-docker \
-configFileName /tmp/server.conf
```
For Pinot broker, it's a bit tricky, the config to add right now is:
`instanceId=Broker_${broker_host}_${broker_port}`
```
instanceId=Broker_pinot-broker-0_8099
```
Then you can goto `localhost:9000` to see that pinot instances names don't have ip address in them.
E.g.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-725864875
> @fx19880617 Thanks. But where can I find the config files, or do I need to make them myself?
yes, you can follow this wiki(https://docs.pinot.apache.org/users/tutorials/use-s3-and-pinot-in-docker) to create a sample conf file, note that the wiki doesn't request a conf file for pinot-broker, but you need a one-line conf file to start pinot broker.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] rec7y33 closed issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
rec7y33 closed issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 edited a comment on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
fx19880617 edited a comment on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-725599855
if you are running in docker, then you can config the dns resolvable host name in config file.
For docker, usually we can give each container a name, like `pinot-controller-0`, `pinot-broker-1`.
E.g. below will start a pinot controller in container named `pinot-controller-0`
```
docker run --rm -ti \
--name pinot-controller-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
-p 9000:9000 \
apachepinot/pinot:latest StartController \
-configFileName /tmp/controller.conf
```
Then for this setup we can configure the pinot controller host name registered in zk by adding below line into controller configure file.
```
controller.host=pinot-controller-0
```
Similarly, we can configure pinot server conf by adding below line:
```
pinot.server.netty.host=pinot-server-0
```
This `pinot-server-0` is the docker container name, so when we start the docker container, we need to specify the `--name `
e.g.
```
docker run --rm -ti \
--name pinot-server-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
apachepinot/pinot:latest StartServer \
-zkAddress zookeeper:2181 -clusterName pinot-docker \
-configFileName /tmp/server.conf
```
For Pinot broker, it's a bit tricky, the config to add right now is:
`instanceId=Broker_${broker_host}_${broker_port}`
```
instanceId=Broker_pinot-broker-0_8099
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] rec7y33 commented on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
rec7y33 commented on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-725801362
@fx19880617 Thanks. But where can I find the config files, or do I need to make them myself?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-725599855
if you are running in docker, then you can set this config in pinot server conf file:
```
pinot.server.netty.host=pinot-server-0
```
This `pinot-server-0` is the docker container name, so when we start the docker container, we need to specify the `--name `
e.g.
```
docker run --rm -ti \
--name pinot-server-0 \
--network=pinot-demo \
--mount type=bind,source=/tmp/pinot-docker-conf,target=/tmp \
apachepinot/pinot:latest StartServer \
-zkAddress zookeeper:2181 -clusterName pinot-docker \
-configFileName /tmp/server.conf
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] rec7y33 commented on issue #6257: pinot cluster on docker unable to restore imported data after docker restarts
Posted by GitBox <gi...@apache.org>.
rec7y33 commented on issue #6257:
URL: https://github.com/apache/incubator-pinot/issues/6257#issuecomment-730082619
thanks :)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org