You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/17 13:46:18 UTC
[GitHub] [hudi] PavelPetukhov opened a new issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
PavelPetukhov opened a new issue #2960:
URL: https://github.com/apache/hudi/issues/2960
I am unable to push metrics to Prometheus pushgateway using following settings
--hoodie-conf hoodie.metrics.on=true
--hoodie-conf hoodie.metrics.reporter.type=PROMETHEUS_PUSHGATEWAY
--hoodie-conf hoodie.metrics.pushgateway.host=https://pushgateway_url.com/
--hoodie-conf hoodie.metrics.pushgateway.port=8080
--hoodie-conf hoodie.metrics.pushgateway.job.name=test_job_1
--hoodie-conf hoodie.metrics.pushgateway.random.job.name.suffix=false
--hoodie-conf hoodie.metrics.pushgateway.delete.on.shutdown=false
Getting the following error
1/04/26 13:29:52 WARN prometheus.PushGatewayReporter: Can't push monitoring information to pushGateway
java.net.UnknownHostException: https
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:607)
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
at sun.net.www.http.HttpClient.(HttpClient.java:242)
at sun.net.www.http.HttpClient.New(HttpClient.java:339)
at sun.net.www.http.HttpClient.New(HttpClient.java:357)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1226)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990)
at io.prometheus.client.exporter.PushGateway.doRequest(PushGateway.java:305)
at io.prometheus.client.exporter.PushGateway.pushAdd(PushGateway.java:160)
at org.apache.hudi.metrics.prometheus.PushGatewayReporter.report(PushGatewayReporter.java:72)
at org.apache.hudi.metrics.prometheus.PushGatewayMetricsReporter.report(PushGatewayMetricsReporter.java:64)
at org.apache.hudi.metrics.Metrics.reportAndCloseReporter(Metrics.java:64)
at org.apache.hudi.metrics.Metrics.lambda$new$0(Metrics.java:57)
at java.lang.Thread.run(Thread.java:748)
**Environment Description**
* Hudi version : 0.7.0
* Spark version : 2.4.7
* Hive version :
* Hadoop version : 2.7
* Storage (HDFS/S3/GCS..) : hdfs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2960:
URL: https://github.com/apache/hudi/issues/2960#issuecomment-851719095
@PavelPetukhov Any updates on this one ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2960:
URL: https://github.com/apache/hudi/issues/2960#issuecomment-847396825
@PavelPetukhov I see you have set the following
```
--hoodie-conf hoodie.metrics.pushgateway.host=https://pushgateway_url.com/
```
Is this a prometheus you are running locally ? If yes, this looks like a `https` protocol which will probably also require a username and password. Is that something you are passing as well ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] liujinhui1994 removed a comment on issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
liujinhui1994 removed a comment on issue #2960:
URL: https://github.com/apache/hudi/issues/2960#issuecomment-881113005
@PavelPetukhov
--hoodie-conf hoodie.metrics.pushgateway.host=10.0.0.0
Something like this will do, configure the destination address, no "http" required
cc @n3nash
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] PavelPetukhov closed issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
PavelPetukhov closed issue #2960:
URL: https://github.com/apache/hudi/issues/2960
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] liujinhui1994 commented on issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
liujinhui1994 commented on issue #2960:
URL: https://github.com/apache/hudi/issues/2960#issuecomment-881113005
@PavelPetukhov
--hoodie-conf hoodie.metrics.pushgateway.host=10.0.0.0
Something like this will do, configure the destination address, no "http" required
cc @n3nash
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] PavelPetukhov commented on issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
PavelPetukhov commented on issue #2960:
URL: https://github.com/apache/hudi/issues/2960#issuecomment-902534034
Thanks a lot! It is working finally
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] liujinhui1994 commented on issue #2960: [SUPPORT] Failed to push metrics to Prometheus pushgateway
Posted by GitBox <gi...@apache.org>.
liujinhui1994 commented on issue #2960:
URL: https://github.com/apache/hudi/issues/2960#issuecomment-881113757
> I am unable to push metrics to Prometheus pushgateway using following settings
>
> --hoodie-conf hoodie.metrics.on=true
> --hoodie-conf hoodie.metrics.reporter.type=PROMETHEUS_PUSHGATEWAY
> --hoodie-conf hoodie.metrics.pushgateway.host=https://pushgateway_url.com/
> --hoodie-conf hoodie.metrics.pushgateway.port=8080
> --hoodie-conf hoodie.metrics.pushgateway.job.name=test_job_1
> --hoodie-conf hoodie.metrics.pushgateway.random.job.name.suffix=false
> --hoodie-conf hoodie.metrics.pushgateway.delete.on.shutdown=false
>
> Getting the following error
> 1/04/26 13:29:52 WARN prometheus.PushGatewayReporter: Can't push monitoring information to pushGateway
> java.net.UnknownHostException: https
> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
> at java.net.Socket.connect(Socket.java:607)
> at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:463)
> at sun.net.www.http.HttpClient.openServer(HttpClient.java:558)
> at sun.net.www.http.HttpClient.(HttpClient.java:242)
> at sun.net.www.http.HttpClient.New(HttpClient.java:339)
> at sun.net.www.http.HttpClient.New(HttpClient.java:357)
> at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1226)
> at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162)
> at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056)
> at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990)
> at io.prometheus.client.exporter.PushGateway.doRequest(PushGateway.java:305)
> at io.prometheus.client.exporter.PushGateway.pushAdd(PushGateway.java:160)
> at org.apache.hudi.metrics.prometheus.PushGatewayReporter.report(PushGatewayReporter.java:72)
> at org.apache.hudi.metrics.prometheus.PushGatewayMetricsReporter.report(PushGatewayMetricsReporter.java:64)
> at org.apache.hudi.metrics.Metrics.reportAndCloseReporter(Metrics.java:64)
> at org.apache.hudi.metrics.Metrics.lambda$new$0(Metrics.java:57)
> at java.lang.Thread.run(Thread.java:748)
>
> **Environment Description**
>
> * Hudi version : 0.7.0
> * Spark version : 2.4.7
> * Hive version :
> * Hadoop version : 2.7
> * Storage (HDFS/S3/GCS..) : hdfs
@PavelPetukhov
--hoodie-conf hoodie.metrics.pushgateway.host=10.0.0.0
Something like this will do, configure the destination address, no "http" required
cc @n3nash
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org