You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stormcrawler.apache.org by "rzo1 (via GitHub)" <gi...@apache.org> on 2024/04/26 14:04:07 UTC
[I] Allow to add a custom DNS suffix to OpenSearch Node addresses returned by Sniffer [incubator-stormcrawler]
rzo1 opened a new issue, #1198:
URL: https://github.com/apache/incubator-stormcrawler/issues/1198
# Proposal
Currently, `opensearch.sniffer` is enabled by default. This will automatically return cluster members of an open search cluster and use those hostnames in client queries.
If you have a simple k8s deployment using the recommended way to set things up (opensearch operator), you will have something like:
```
ip heap.percent ram.percent cpu load_1m load_5m load_15m node.role node.roles cluster_manager name
192.168.246.253 17 64 3 0.27 0.43 0.45 dm cluster_manager,data * opensearch-sc-masters-1
192.168.129.88 9 65 3 0.08 0.09 0.14 dm cluster_manager,data - opensearch-sc-masters-0
192.168.174.52 47 63 3 2.41 2.43 2.14 dm cluster_manager,data - opensearch-sc-masters-2
```
However, those cluster member names liek `opensearch-sc-masters-XXX` aren't resolveable by clients connecting.
We would need to append the `cluster name`, which was set during creation of the resource: `opensearch-sc`.
Thus, the correct and resolvable member url would be
```
opensearch-sc-masters-0.opensearch-sc
```
We could add the required suffix for such a use-case in a sniffer implementation, which can add this suffix by loading it from the configuration. The default (for non k8s usage) would remain unchanged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@stormcrawler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to add a custom DNS suffix to OpenSearch Node addresses returned by Sniffer [incubator-stormcrawler]
Posted by "rzo1 (via GitHub)" <gi...@apache.org>.
rzo1 closed issue #1198: Allow to add a custom DNS suffix to OpenSearch Node addresses returned by Sniffer
URL: https://github.com/apache/incubator-stormcrawler/issues/1198
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@stormcrawler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to add a custom DNS suffix to OpenSearch Node addresses returned by Sniffer [incubator-stormcrawler]
Posted by "rzo1 (via GitHub)" <gi...@apache.org>.
rzo1 commented on issue #1198:
URL: https://github.com/apache/incubator-stormcrawler/issues/1198#issuecomment-2082475403
This is not an actual issue if `sniffing` is disabled _or_ the k8s operated resources are configured correctly. Closing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@stormcrawler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org