You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "rseetham (via GitHub)" <gi...@apache.org> on 2025/02/26 00:31:02 UTC
[I] Controller fails to startup if DataDir cannot be created [pinot]
rseetham opened a new issue, #15127:
URL: https://github.com/apache/pinot/issues/15127
The controller has a property `controller.data.dir`. When the controller is started, we initialize a class called `ControllerFilePathProvider`. It reads this properpy and tried to load the PinotFS with that scheme. If it cannot be created, the controller start up fails. The dataDir is only used for backingup segments. Pinot can work without backing up segments. The server does not have this check at startup. The segment uploads fail.
We should remove this check. We use hdfs for the dataDir. There was an issue with the hdfs namenode so all segment uploads failed but Pinot was running and serving queries well. At that time, server could be restarted but controllers could not be restarted which is an issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Controller fails to startup if DataDir cannot be created [pinot]
Posted by "rseetham (via GitHub)" <gi...@apache.org>.
rseetham commented on issue #15127:
URL: https://github.com/apache/pinot/issues/15127#issuecomment-3217483501
The pr has been merged. This can be closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Controller fails to startup if DataDir cannot be created [pinot]
Posted by "rseetham (via GitHub)" <gi...@apache.org>.
rseetham commented on issue #15127:
URL: https://github.com/apache/pinot/issues/15127#issuecomment-2695309495
We had a cluster running. Our data dir points to hadoop. There was an issue with the hadoop name node calls failed for 4-5 hours until the issue was fixed. In that time, servers could be restarted. Data backups failed but the server was able to load data segments from the peer when needed. But the controllers could not be restarted. The restart would fail. We want to prevent this situation. When a cluster is running, we want to keep everything in a heathy state and serving queries even if the backup is not accessible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Controller fails to startup if DataDir cannot be created [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang closed issue #15127: Controller fails to startup if DataDir cannot be created
URL: https://github.com/apache/pinot/issues/15127
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Controller fails to startup if DataDir cannot be created [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #15127:
URL: https://github.com/apache/pinot/issues/15127#issuecomment-2684203699
I believe data dir is pointing to the deep store. Without it, server won't be able to download segment. So the check should be mandatory for the cluster to function.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Controller fails to startup if DataDir cannot be created [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #15127:
URL: https://github.com/apache/pinot/issues/15127#issuecomment-2705659469
@chenboat Can you share the experience of operating Pinot on HDFS?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org