You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2021/12/21 07:02:19 UTC
[GitHub] [druid] applike-ss commented on issue #12082: Pull-deps extremely slow and not working in docker build
applike-ss commented on issue #12082:
URL: https://github.com/apache/druid/issues/12082#issuecomment-998523607
Thank you for this great hint.
Now it only takes 20 seconds (which in tech is still a lot), but a lot faster than ~5 minutes!
By adding the suggested log level parameter and adjusting it to debug, i could see that the pull-deps command is complainig about resources not existing.
i am now running `java -Dlog4j2.level=DEBUG -classpath "/opt/druid/lib/*" org.apache.druid.cli.Main tools pull-deps --no-default-hadoop -c org.apache.druid.extensions.contrib:prometheus-emitter:0.22.1` and when grepping this for error, i get:
```
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/org/apache/apache/21/apache-21.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/com/fasterxml/jackson/jackson-bom/2.10.5.20201202/jackson-bom-2.10.5.20201202.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/com/fasterxml/jackson/jackson-parent/2.10/jackson-parent-2.10.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/com/fasterxml/oss-parent/38/oss-parent-38.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/netty/netty-bom/4.1.68.Final/netty-bom-4.1.68.Final.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/org/sonatype/oss/oss-parent/7/oss-parent-7.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient/0.7.0/simpleclient-0.7.0.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient/0.7.0/simpleclient-0.7.0.pom. Error code 404
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient/0.7.0/simpleclient-0.7.0.pom. Error code 501, HTTPS Required
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/parent/0.7.0/parent-0.7.0.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/parent/0.7.0/parent-0.7.0.pom. Error code 404
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/parent/0.7.0/parent-0.7.0.pom. Error code 501, HTTPS Required
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient_httpserver/0.7.0/simpleclient_httpserver-0.7.0.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient_httpserver/0.7.0/simpleclient_httpserver-0.7.0.pom. Error code 404
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient_httpserver/0.7.0/simpleclient_httpserver-0.7.0.pom. Error code 501, HTTPS Required
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient_common/0.7.0/simpleclient_common-0.7.0.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient_common/0.7.0/simpleclient_common-0.7.0.pom. Error code 404
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient_common/0.7.0/simpleclient_common-0.7.0.pom. Error code 501, HTTPS Required
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient_pushgateway/0.7.0/simpleclient_pushgateway-0.7.0.pom. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient_pushgateway/0.7.0/simpleclient_pushgateway-0.7.0.pom. Error code 404
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient_pushgateway/0.7.0/simpleclient_pushgateway-0.7.0.pom. Error code 501, HTTPS Required
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient/0.7.0/simpleclient-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient_httpserver/0.7.0/simpleclient_httpserver-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient_common/0.7.0/simpleclient_common-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.apache.org/snapshots/io/prometheus/simpleclient_pushgateway/0.7.0/simpleclient_pushgateway-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient/0.7.0/simpleclient-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient_httpserver/0.7.0/simpleclient_httpserver-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient_common/0.7.0/simpleclient_common-0.7.0.jar. Error code 404
io.tesla.aether.connector.ResourceDoesNotExistException: Unable to locate resource https://repository.jboss.org/nexus/content/repositories/thirdparty-uploads/io/prometheus/simpleclient_pushgateway/0.7.0/simpleclient_pushgateway-0.7.0.jar. Error code 404
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient/0.7.0/simpleclient-0.7.0.jar. Error code 501, HTTPS Required
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient_httpserver/0.7.0/simpleclient_httpserver-0.7.0.jar. Error code 501, HTTPS Required
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient_common/0.7.0/simpleclient_common-0.7.0.jar. Error code 501, HTTPS Required
io.tesla.aether.connector.TransferException: Failed to transfer http://repo.maven.apache.org/maven2/io/prometheus/simpleclient_pushgateway/0.7.0/simpleclient_pushgateway-0.7.0.jar. Error code 501, HTTPS Required
```
I'm confused about multiple things: How did nobody ever notice that resources seem to have got lost and why would it try http in times of https?
I don't know if any of those questions really relate for pull-deps or if that is to be asked somewhere else to be honest.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org