Build errors with Atlas 2.2.0: Could not find artifact org.apache.atlas:atlas-buildtools:jar:1.0, and java.security.cert.CertPathValidatorException: validity check failed

[Razzi Abuissa <ra...@wikimedia.org>]

Hi,

I have attempted to follow the installation instructions at
https://atlas.apache.org/#/BuildInstallation, and I have run into an error:

    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ mvn clean -DskipTests
install
    # [...]
    [INFO]
------------------------------------------------------------------------
    [INFO] Reactor Summary for apache-atlas 2.2.0:
    [INFO]
    [INFO] Apache Atlas Server Build Tools .................... SUCCESS [
 7.681 s]
    [INFO] apache-atlas ....................................... FAILURE [
29.221 s]
    [INFO] Apache Atlas Integration ........................... SKIPPED
    [INFO] Apache Atlas Test Utility Tools .................... SKIPPED
    # [...]
    [INFO]
------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO]
------------------------------------------------------------------------
    [INFO] Total time:  47.295 s
    [INFO] Finished at: 2021-12-13T19:30:55Z
    [INFO]
------------------------------------------------------------------------
    [ERROR] Failed to execute goal
org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1:check
(checkstyle-check) on project apache-atlas: Execution checkstyle-check of
goal org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1:check failed:
Plugin org.apache.maven.plugins:maven-checkstyle-plugin:2.9.1 or one of its
dependencies could not be resolved: Could not find artifact
org.apache.atlas:atlas-buildtools:jar:1.0 in central (
https://repo.maven.apache.org/maven2) -> [Help 1]
    [ERROR]
    [ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR]
    [ERROR] For more information about the errors and possible solutions,
please read the following articles:
    [ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
    [ERROR]
    [ERROR] After correcting the problems, you can resume the build with
the command
    [ERROR]   mvn <args> -rf :apache-atlas

I based my installation on Debian 11 Bullseye, running in Vagrant. Here is
my Vagrantfile:

    Vagrant.configure("2") do |config|
      config.vm.box = "debian/bullseye64"
      config.vm.provider "virtualbox" do |vb|
        vb.memory = "4096"
      end
    end

And here are the steps I ran:

    vagrant@bullseye:~$ wget
https://dlcdn.apache.org/atlas/2.2.0/apache-atlas-2.2.0-sources.tar.gz
    vagrant@bullseye:~$ tar -xzf apache-atlas-2.2.0-sources.tar.gz
    vagrant@bullseye:~$ cd apache-atlas-sources-2.2.0/
    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ sudo apt update
    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ sudo apt install maven
    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ export
MAVEN_OPTS="-Xms2g -Xmx2g"
    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ mvn clean -DskipTests
install

Possible issue: On
https://repo.maven.apache.org/maven2/org/apache/atlas/atlas-buildtools/,
the only version available is 0.8.1, but the version maven expected is 1.0.

As a workaround, changing the atlas-buildtools version from
`${project.version}` to 0.8.1 got through that step fine:

    diff --git a/pom.xml b/pom.xml
    index db429d3..ef85431 100644
    --- a/pom.xml
    +++ b/pom.xml
    @@ -2161,7 +2161,7 @@
                        <dependency>
                            <groupId>org.apache.atlas</groupId>
                            <artifactId>atlas-buildtools</artifactId>
    -                        <version>1.0</version>
    +                        <version>0.8.1</version>
                        </dependency>
                    </dependencies>
                    <executions>

However I got a different error:

    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ mvn clean -DskipTests
install
    # [...]
    [INFO] Apache Atlas Test Utility Tools .................... FAILURE [
17.211 s]
    # [...]
    [ERROR] Failed to execute goal on project atlas-testtools: Could not
resolve dependencies for project
org.apache.atlas:atlas-testtools:jar:2.2.0: Failed to collect dependencies
at org.apache.solr:solr-test-framework:jar:8.6.3 ->
org.restlet.jee:org.restlet:jar:2.4.3: Failed to read artifact descriptor
for org.restlet.jee:org.restlet:jar:2.4.3: Could not transfer artifact
org.restlet.jee:org.restlet:pom:2.4.3 from/to maven-restlet (
https://maven.restlet.com): Transfer failed for
https://maven.restlet.com/org/restlet/jee/org.restlet/2.4.3/org.restlet-2.4.3.pom:
PKIX path validation failed: java.security.cert.CertPathValidatorException:
validity check failed: NotAfter: Sat Dec 11 22:28:29 UTC 2021

I was able to work around this validity check as follows:

    vagrant@bullseye:~/apache-atlas-sources-2.2.0$ mvn clean -DskipTests
-Dmaven.wagon.http.ssl.insecure=true -Dmaven.wagon.http.ssl.allowall=true
-Dmaven.wagon.http.ssl.ignore.validity.dates=true install

And the build succeeded, but obviously this isn't a secure way to build the
package.

Have I misconfigured something in maven, or perhaps something wrong with
the jar repository https://repo.maven.apache.org/maven2 ?


Regards,

Razzi

Site Reliability Engineer
Data Engineering team, Wikimedia Foundation