You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hudi.apache.org by Gurudatt Kulkarni <gu...@gmail.com> on 2019/10/18 10:30:52 UTC

Compile failing on master

Hi All,

I ran `mvn compile` on master, but it fails to build completely because it
was unable to find Confluent dependencies. I added
https://packages.confluent.io/maven2 in repositories in the main pom.xml
and it built successfully. Just curious, how you guys are compiling? Can we
add confluent maven repository to the main pom.xml file?

Here's the error that I got

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
(process-resource-bundles) on project hudi-cli: Failed to resolve
dependencies for one or more projects in the reactor. Reason: Missing:
[ERROR] ----------
[ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
[ERROR]
[ERROR]   Try downloading the file manually from the project website.
[ERROR]
[ERROR]   Then, install it using the command:
[ERROR]       mvn install:install-file -DgroupId=io.confluent
-DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]   Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]       mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]   Path to dependency:
[ERROR]   1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]   2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]   3) io.confluent:kafka-avro-serializer:jar:3.0.0
[ERROR]
[ERROR] 2) io.confluent:common-config:jar:3.0.0
[ERROR]
[ERROR]   Try downloading the file manually from the project website.
[ERROR]
[ERROR]   Then, install it using the command:
[ERROR]       mvn install:install-file -DgroupId=io.confluent
-DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]   Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]       mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]   Path to dependency:
[ERROR]   1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]   2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]   3) io.confluent:common-config:jar:3.0.0
[ERROR]
[ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
[ERROR]
[ERROR]   Try downloading the file manually from the project website.
[ERROR]
[ERROR]   Then, install it using the command:
[ERROR]       mvn install:install-file -DgroupId=io.confluent
-DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]   Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]       mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]   Path to dependency:
[ERROR]   1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]   2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]   3) io.confluent:kafka-schema-registry-client:jar:3.0.0
[ERROR]
[ERROR] 4) io.confluent:common-utils:jar:3.0.0
[ERROR]
[ERROR]   Try downloading the file manually from the project website.
[ERROR]
[ERROR]   Then, install it using the command:
[ERROR]       mvn install:install-file -DgroupId=io.confluent
-DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]   Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]       mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]   Path to dependency:
[ERROR]   1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]   2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]   3) io.confluent:common-utils:jar:3.0.0
[ERROR]
[ERROR] ----------
[ERROR] 4 required artifacts are missing.
[ERROR]
[ERROR] for artifact:
[ERROR]   org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR]   libs-milestone (https://repo.spring.io/libs-milestone/,
releases=true, snapshots=true),
[ERROR]   libs-release (https://repo.spring.io/libs-release/,
releases=true, snapshots=true),
[ERROR]   Maven Central (https://repo.maven.apache.org/maven2,
releases=true, snapshots=false),
[ERROR]   cloudera-repo-releases (
https://repository.cloudera.com/artifactory/public/, releases=true,
snapshots=false),
[ERROR]   apache.snapshots (https://repository.apache.org/snapshots,
releases=false, snapshots=true),
[ERROR]   central (https://repo.maven.apache.org/maven2, releases=true,
snapshots=false)
[ERROR]
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]   mvn <args> -rf :hudi-cli

Re: Compile failing on master

Posted by Gurudatt Kulkarni <gu...@gmail.com>.

Ya sure will do it.

On Monday, October 21, 2019, Bhavani Sudha <bh...@gmail.com> wrote:
> Great. Thanks for testing that. Can you send a PR with that change ?
>
>
> On Mon, Oct 21, 2019 at 8:51 AM Gurudatt Kulkarni <gu...@gmail.com>
> wrote:
>
>> Hi Bhavani,
>>
>> Yes it worked for me after moving repositories to parent pom. Thanks
>>
>> Regards,
>> Gurudatt
>> On Monday, October 21, 2019, Bhavani Sudha <bh...@gmail.com>
>> wrote:
>> > Hi Gurudatt,
>> >
>> > I was able to reproduce this with maven 3.6.2. Moving the confluent
>> > repository  from hudi-utilities pom to parent pom helped unblock this
>> > issue. Can you check if that works for you?
>> >
>> > Thanks,
>> > Sudha
>> >
>> > On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <vi...@apache.org>
>> wrote:
>> >
>> >> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I
>> can
>> >> build
>> >>
>> >>  [incubator-hudi]$ mvn -version
>> >> Apache Maven 3.6.1
>> >>
>> >>
>> >>
>> >>
>> >> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <
guruak107@gmail.com
>> >
>> >> wrote:
>> >>
>> >> > Hi Balaji,
>> >> >
>> >> > I think I figured out why it was failing for me. I was on the latest
>> >> maven
>> >> > version(3.6.2). I built it using the 3.5 version that you are using
>> and
>> >> it
>> >> > worked.
>> >> >
>> >> > I forked and built it on Circle CI, to reproduce the behavior
>> >> > Build on 3.5.2 (
>> >> >
>> >> >
>> >>
>>
>>
https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
>> >> > )
>> >> >
>> >> > Built on 3.6.2 (
>> >> >
>> >> >
>> >>
>>
>>
https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
>> >> > )
>> >> >
>> >> > Regards,
>> >> > Gurudatt
>> >> >
>> >> > On Fri, Oct 18, 2019 at 8:22 PM vbalaji@apache.org <
>> vbalaji@apache.org>
>> >> > wrote:
>> >> >
>> >> > >  I just tried deleting confluent jars from my .m2 repo and reran
>> "mvn
>> >> > > clean package -DskipTests". I am able to download it without
problem
>> >> (See
>> >> > > logs below)
>> >> > > My mvn version is : Apache Maven 3.5.4
>> >> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
>> 2018-06-17T11:33:14-07:00)
>> >> > > Try manually curling the url (see logs below) within docker to see
>> if
>> >> > this
>> >> > > is some network issue.
>> >> > > Balaji.V
>> >> > >
>> >> > > [INFO] -------------------< org.apache.hudi:hudi-utilities
>> >> > > >-------------------
>> >> > >
>> >> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6
>> >> > > [8/27]
>> >> > >
>> >> > > [INFO] --------------------------------[ jar
>> >> > > ]---------------------------------
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
>> >> > > (2.4 kB at 7.4 kB/s)
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
>> >> > > (5.9 kB at 196 kB/s)
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
>> >> > > (1.6 kB at 86 kB/s)
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
>> >> > > (1.6 kB at 9.1 kB/s)
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
>> >> > > (4.8 kB at 21 kB/s)
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
>> >> > > (2.1 kB at 8.4 kB/s)
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
>> >> > >
>> >> > > Downloading from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
>> >> > > (36 kB at 426 kB/s)
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
>> >> > > (18 kB at 78 kB/s)
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
>> >> > > (24 kB at 100 kB/s)
>> >> > >
>> >> > > Downloaded from confluent:
>> >> > >
>> >> >
>> >>
>>
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
>> >> > > (19 kB at 51 kB/s)
>> >> > >      On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt
Kulkarni
>> <
>> >> > > guruak107@gmail.com> wrote:
>> >> > >
>> >> > >  Hi Balaji / Pratyaksh,
>> >> > >
>> >> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo
in
>> it
>> >> > and
>> >> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same
>> >> issue.
>> >> > >
>> >> > >
>> >> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <
>> >> pratyaksh13@gmail.com>
>> >> > > wrote:
>> >> > >
>> >> > > > Hi Balaji,
>> >> > > >
>> >> > > > I do not have custom settings.xml file and faced the same
problem.
>> I
>> >> > was
>> >> > > > able to fix it by first running the command as mentioned on the
>> page
>> >> > > > <https://hudi.apache.org/quickstart.html> -
>> >> > > >
>> >> > > > mvn clean install -DskipTests -DskipITs
>> >> > > >
>> >> > > > After running this command, you can run the other commands
without
>> >> any
>> >> > > > error.
>> >> > > >
>> >> > > > On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <
>> >> vbalaji@apache.org
>> >> > >
>> >> > > > wrote:
>> >> > > >
>> >> > > > >
>> >> > > > > I have seen this happens sometimes if you have a custom
>> >> > > > ~/.m2/settings.xml
>> >> > > > > file. Try removing it and check.
>> >> > > > > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT,
>> Gurudatt
>> >> > > > > Kulkarni <gu...@gmail.com> wrote:
>> >> > > > >
>> >> > > > >  Hi All,
>> >> > > > >
>> >> > > > > I ran `mvn compile` on master, but it fails to build
completely
>> >> > because
>> >> > > > it
>> >> > > > > was unable to find Confluent dependencies. I added
>> >> > > > > https://packages.confluent.io/maven2 in repositories in the
>> main
>> >> > > pom.xml
>> >> > > > > and it built successfully. Just curious, how you guys are
>> >> compiling?
>> >> > > Can
>> >> > > > we
>> >> > > > > add confluent maven repository to the main pom.xml file?
>> >> > > > >
>> >> > > > > Here's the error that I got
>> >> > > > >
>> >> > > > > [ERROR] Failed to execute goal
>> >> > > > >
>> org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
>> >> > > > > (process-resource-bundles) on project hudi-cli: Failed to
>> resolve
>> >> > > > > dependencies for one or more projects in the reactor. Reason:
>> >> > Missing:
>> >> > > > > [ERROR] ----------
>> >> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Try downloading the file manually from the project
>> >> website.
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Then, install it using the command:
>> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0
>> -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Alternatively, if you host your own repository you
can
>> >> > deploy
>> >> > > > the
>> >> > > > > file there:
>> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0
>> -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Path to dependency:
>> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Try downloading the file manually from the project
>> >> website.
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Then, install it using the command:
>> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Alternatively, if you host your own repository you
can
>> >> > deploy
>> >> > > > the
>> >> > > > > file there:
>> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Path to dependency:
>> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  3) io.confluent:common-config:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Try downloading the file manually from the project
>> >> website.
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Then, install it using the command:
>> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
>> >> > > -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Alternatively, if you host your own repository you
can
>> >> > deploy
>> >> > > > the
>> >> > > > > file there:
>> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
>> >> > > -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Path to dependency:
>> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  3)
io.confluent:kafka-schema-registry-client:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Try downloading the file manually from the project
>> >> website.
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Then, install it using the command:
>> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Alternatively, if you host your own repository you
can
>> >> > deploy
>> >> > > > the
>> >> > > > > file there:
>> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
>> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> >> > > > > [ERROR]
>> >> > > > > [ERROR]  Path to dependency:
>> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] ----------
>> >> > > > > [ERROR] 4 required artifacts are missing.
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] for artifact:
>> >> > > > > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] from the specified remote repositories:
>> >> > > > > [ERROR]  libs-milestone (
https://repo.spring.io/libs-milestone/
>> ,
>> >> > > > > releases=true, snapshots=true),
>> >> > > > > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
>> >> > > > > releases=true, snapshots=true),
>> >> > > > > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
>> >> > > > > releases=true, snapshots=false),
>> >> > > > > [ERROR]  cloudera-repo-releases (
>> >> > > > > https://repository.cloudera.com/artifactory/public/,
>> >> releases=true,
>> >> > > > > snapshots=false),
>> >> > > > > [ERROR]  apache.snapshots (
>> https://repository.apache.org/snapshots
>> >> ,
>> >> > > > > releases=false, snapshots=true),
>> >> > > > > [ERROR]  central (https://repo.maven.apache.org/maven2,
>> >> > releases=true,
>> >> > > > > snapshots=false)
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] -> [Help 1]
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] To see the full stack trace of the errors, re-run
Maven
>> >> with
>> >> > > the
>> >> > > > -e
>> >> > > > > switch.
>> >> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
>> >> > logging.
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] For more information about the errors and possible
>> >> solutions,
>> >> > > > > please read the following articles:
>> >> > > > > [ERROR] [Help 1]
>> >> > > > >
>> >> > >
>> >>
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> >> > > > > [ERROR]
>> >> > > > > [ERROR] After correcting the problems, you can resume the
build
>> >> with
>> >> > > the
>> >> > > > > command
>> >> > > > > [ERROR]  mvn <args> -rf :hudi-cli
>> >> > > > >
>> >> > > >
>> >> > >
>> >> >
>> >>
>> >
>>
>

Re: Compile failing on master

Posted by Bhavani Sudha <bh...@gmail.com>.

Great. Thanks for testing that. Can you send a PR with that change ?


On Mon, Oct 21, 2019 at 8:51 AM Gurudatt Kulkarni <gu...@gmail.com>
wrote:

> Hi Bhavani,
>
> Yes it worked for me after moving repositories to parent pom. Thanks
>
> Regards,
> Gurudatt
> On Monday, October 21, 2019, Bhavani Sudha <bh...@gmail.com>
> wrote:
> > Hi Gurudatt,
> >
> > I was able to reproduce this with maven 3.6.2. Moving the confluent
> > repository  from hudi-utilities pom to parent pom helped unblock this
> > issue. Can you check if that works for you?
> >
> > Thanks,
> > Sudha
> >
> > On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <vi...@apache.org>
> wrote:
> >
> >> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I
> can
> >> build
> >>
> >>  [incubator-hudi]$ mvn -version
> >> Apache Maven 3.6.1
> >>
> >>
> >>
> >>
> >> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <guruak107@gmail.com
> >
> >> wrote:
> >>
> >> > Hi Balaji,
> >> >
> >> > I think I figured out why it was failing for me. I was on the latest
> >> maven
> >> > version(3.6.2). I built it using the 3.5 version that you are using
> and
> >> it
> >> > worked.
> >> >
> >> > I forked and built it on Circle CI, to reproduce the behavior
> >> > Build on 3.5.2 (
> >> >
> >> >
> >>
>
> https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
> >> > )
> >> >
> >> > Built on 3.6.2 (
> >> >
> >> >
> >>
>
> https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
> >> > )
> >> >
> >> > Regards,
> >> > Gurudatt
> >> >
> >> > On Fri, Oct 18, 2019 at 8:22 PM vbalaji@apache.org <
> vbalaji@apache.org>
> >> > wrote:
> >> >
> >> > >  I just tried deleting confluent jars from my .m2 repo and reran
> "mvn
> >> > > clean package -DskipTests". I am able to download it without problem
> >> (See
> >> > > logs below)
> >> > > My mvn version is : Apache Maven 3.5.4
> >> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
> 2018-06-17T11:33:14-07:00)
> >> > > Try manually curling the url (see logs below) within docker to see
> if
> >> > this
> >> > > is some network issue.
> >> > > Balaji.V
> >> > >
> >> > > [INFO] -------------------< org.apache.hudi:hudi-utilities
> >> > > >-------------------
> >> > >
> >> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6
> >> > > [8/27]
> >> > >
> >> > > [INFO] --------------------------------[ jar
> >> > > ]---------------------------------
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> >> > > (2.4 kB at 7.4 kB/s)
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> >> > > (5.9 kB at 196 kB/s)
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> >> > > (1.6 kB at 86 kB/s)
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> >> > > (1.6 kB at 9.1 kB/s)
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> >> > > (4.8 kB at 21 kB/s)
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> >> > > (2.1 kB at 8.4 kB/s)
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> >> > >
> >> > > Downloading from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> >> > > (36 kB at 426 kB/s)
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> >> > > (18 kB at 78 kB/s)
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> >> > > (24 kB at 100 kB/s)
> >> > >
> >> > > Downloaded from confluent:
> >> > >
> >> >
> >>
>
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> >> > > (19 kB at 51 kB/s)
> >> > >      On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni
> <
> >> > > guruak107@gmail.com> wrote:
> >> > >
> >> > >  Hi Balaji / Pratyaksh,
> >> > >
> >> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in
> it
> >> > and
> >> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same
> >> issue.
> >> > >
> >> > >
> >> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <
> >> pratyaksh13@gmail.com>
> >> > > wrote:
> >> > >
> >> > > > Hi Balaji,
> >> > > >
> >> > > > I do not have custom settings.xml file and faced the same problem.
> I
> >> > was
> >> > > > able to fix it by first running the command as mentioned on the
> page
> >> > > > <https://hudi.apache.org/quickstart.html> -
> >> > > >
> >> > > > mvn clean install -DskipTests -DskipITs
> >> > > >
> >> > > > After running this command, you can run the other commands without
> >> any
> >> > > > error.
> >> > > >
> >> > > > On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <
> >> vbalaji@apache.org
> >> > >
> >> > > > wrote:
> >> > > >
> >> > > > >
> >> > > > > I have seen this happens sometimes if you have a custom
> >> > > > ~/.m2/settings.xml
> >> > > > > file. Try removing it and check.
> >> > > > > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT,
> Gurudatt
> >> > > > > Kulkarni <gu...@gmail.com> wrote:
> >> > > > >
> >> > > > >  Hi All,
> >> > > > >
> >> > > > > I ran `mvn compile` on master, but it fails to build completely
> >> > because
> >> > > > it
> >> > > > > was unable to find Confluent dependencies. I added
> >> > > > > https://packages.confluent.io/maven2 in repositories in the
> main
> >> > > pom.xml
> >> > > > > and it built successfully. Just curious, how you guys are
> >> compiling?
> >> > > Can
> >> > > > we
> >> > > > > add confluent maven repository to the main pom.xml file?
> >> > > > >
> >> > > > > Here's the error that I got
> >> > > > >
> >> > > > > [ERROR] Failed to execute goal
> >> > > > >
> org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> >> > > > > (process-resource-bundles) on project hudi-cli: Failed to
> resolve
> >> > > > > dependencies for one or more projects in the reactor. Reason:
> >> > Missing:
> >> > > > > [ERROR] ----------
> >> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Try downloading the file manually from the project
> >> website.
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Then, install it using the command:
> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0
> -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Alternatively, if you host your own repository you can
> >> > deploy
> >> > > > the
> >> > > > > file there:
> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> >> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0
> -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Path to dependency:
> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Try downloading the file manually from the project
> >> website.
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Then, install it using the command:
> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Alternatively, if you host your own repository you can
> >> > deploy
> >> > > > the
> >> > > > > file there:
> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> >> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Path to dependency:
> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  3) io.confluent:common-config:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Try downloading the file manually from the project
> >> website.
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Then, install it using the command:
> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> >> > > -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Alternatively, if you host your own repository you can
> >> > deploy
> >> > > > the
> >> > > > > file there:
> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> >> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> >> > > -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Path to dependency:
> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Try downloading the file manually from the project
> >> website.
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Then, install it using the command:
> >> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Alternatively, if you host your own repository you can
> >> > deploy
> >> > > > the
> >> > > > > file there:
> >> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> >> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> >> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> >> > > > > [ERROR]
> >> > > > > [ERROR]  Path to dependency:
> >> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> >> > > > > [ERROR]
> >> > > > > [ERROR] ----------
> >> > > > > [ERROR] 4 required artifacts are missing.
> >> > > > > [ERROR]
> >> > > > > [ERROR] for artifact:
> >> > > > > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> >> > > > > [ERROR]
> >> > > > > [ERROR] from the specified remote repositories:
> >> > > > > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/
> ,
> >> > > > > releases=true, snapshots=true),
> >> > > > > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> >> > > > > releases=true, snapshots=true),
> >> > > > > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> >> > > > > releases=true, snapshots=false),
> >> > > > > [ERROR]  cloudera-repo-releases (
> >> > > > > https://repository.cloudera.com/artifactory/public/,
> >> releases=true,
> >> > > > > snapshots=false),
> >> > > > > [ERROR]  apache.snapshots (
> https://repository.apache.org/snapshots
> >> ,
> >> > > > > releases=false, snapshots=true),
> >> > > > > [ERROR]  central (https://repo.maven.apache.org/maven2,
> >> > releases=true,
> >> > > > > snapshots=false)
> >> > > > > [ERROR]
> >> > > > > [ERROR] -> [Help 1]
> >> > > > > [ERROR]
> >> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven
> >> with
> >> > > the
> >> > > > -e
> >> > > > > switch.
> >> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> >> > logging.
> >> > > > > [ERROR]
> >> > > > > [ERROR] For more information about the errors and possible
> >> solutions,
> >> > > > > please read the following articles:
> >> > > > > [ERROR] [Help 1]
> >> > > > >
> >> > >
> >> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> >> > > > > [ERROR]
> >> > > > > [ERROR] After correcting the problems, you can resume the build
> >> with
> >> > > the
> >> > > > > command
> >> > > > > [ERROR]  mvn <args> -rf :hudi-cli
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
>

Re: Compile failing on master

Posted by Gurudatt Kulkarni <gu...@gmail.com>.

Hi Bhavani,

Yes it worked for me after moving repositories to parent pom. Thanks

Regards,
Gurudatt
On Monday, October 21, 2019, Bhavani Sudha <bh...@gmail.com> wrote:
> Hi Gurudatt,
>
> I was able to reproduce this with maven 3.6.2. Moving the confluent
> repository  from hudi-utilities pom to parent pom helped unblock this
> issue. Can you check if that works for you?
>
> Thanks,
> Sudha
>
> On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <vi...@apache.org> wrote:
>
>> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I can
>> build
>>
>>  [incubator-hudi]$ mvn -version
>> Apache Maven 3.6.1
>>
>>
>>
>>
>> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <gu...@gmail.com>
>> wrote:
>>
>> > Hi Balaji,
>> >
>> > I think I figured out why it was failing for me. I was on the latest
>> maven
>> > version(3.6.2). I built it using the 3.5 version that you are using and
>> it
>> > worked.
>> >
>> > I forked and built it on Circle CI, to reproduce the behavior
>> > Build on 3.5.2 (
>> >
>> >
>>
https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
>> > )
>> >
>> > Built on 3.6.2 (
>> >
>> >
>>
https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
>> > )
>> >
>> > Regards,
>> > Gurudatt
>> >
>> > On Fri, Oct 18, 2019 at 8:22 PM vbalaji@apache.org <vb...@apache.org>
>> > wrote:
>> >
>> > >  I just tried deleting confluent jars from my .m2 repo and reran "mvn
>> > > clean package -DskipTests". I am able to download it without problem
>> (See
>> > > logs below)
>> > > My mvn version is : Apache Maven 3.5.4
>> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00)
>> > > Try manually curling the url (see logs below) within docker to see if
>> > this
>> > > is some network issue.
>> > > Balaji.V
>> > >
>> > > [INFO] -------------------< org.apache.hudi:hudi-utilities
>> > > >-------------------
>> > >
>> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6
>> > > [8/27]
>> > >
>> > > [INFO] --------------------------------[ jar
>> > > ]---------------------------------
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
>> > > (2.4 kB at 7.4 kB/s)
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
>> > > (5.9 kB at 196 kB/s)
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
>> > > (1.6 kB at 86 kB/s)
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
>> > > (1.6 kB at 9.1 kB/s)
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
>> > > (4.8 kB at 21 kB/s)
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
>> > > (2.1 kB at 8.4 kB/s)
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
>> > >
>> > > Downloading from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
>> > > (36 kB at 426 kB/s)
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
>> > > (18 kB at 78 kB/s)
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
>> > > (24 kB at 100 kB/s)
>> > >
>> > > Downloaded from confluent:
>> > >
>> >
>>
https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
>> > > (19 kB at 51 kB/s)
>> > >      On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni
<
>> > > guruak107@gmail.com> wrote:
>> > >
>> > >  Hi Balaji / Pratyaksh,
>> > >
>> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in
it
>> > and
>> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same
>> issue.
>> > >
>> > >
>> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <
>> pratyaksh13@gmail.com>
>> > > wrote:
>> > >
>> > > > Hi Balaji,
>> > > >
>> > > > I do not have custom settings.xml file and faced the same problem.
I
>> > was
>> > > > able to fix it by first running the command as mentioned on the
page
>> > > > <https://hudi.apache.org/quickstart.html> -
>> > > >
>> > > > mvn clean install -DskipTests -DskipITs
>> > > >
>> > > > After running this command, you can run the other commands without
>> any
>> > > > error.
>> > > >
>> > > > On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <
>> vbalaji@apache.org
>> > >
>> > > > wrote:
>> > > >
>> > > > >
>> > > > > I have seen this happens sometimes if you have a custom
>> > > > ~/.m2/settings.xml
>> > > > > file. Try removing it and check.
>> > > > > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT,
Gurudatt
>> > > > > Kulkarni <gu...@gmail.com> wrote:
>> > > > >
>> > > > >  Hi All,
>> > > > >
>> > > > > I ran `mvn compile` on master, but it fails to build completely
>> > because
>> > > > it
>> > > > > was unable to find Confluent dependencies. I added
>> > > > > https://packages.confluent.io/maven2 in repositories in the main
>> > > pom.xml
>> > > > > and it built successfully. Just curious, how you guys are
>> compiling?
>> > > Can
>> > > > we
>> > > > > add confluent maven repository to the main pom.xml file?
>> > > > >
>> > > > > Here's the error that I got
>> > > > >
>> > > > > [ERROR] Failed to execute goal
>> > > > >
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
>> > > > > (process-resource-bundles) on project hudi-cli: Failed to resolve
>> > > > > dependencies for one or more projects in the reactor. Reason:
>> > Missing:
>> > > > > [ERROR] ----------
>> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR]  Try downloading the file manually from the project
>> website.
>> > > > > [ERROR]
>> > > > > [ERROR]  Then, install it using the command:
>> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0
-Dpackaging=jar
>> > > > > -Dfile=/path/to/file
>> > > > > [ERROR]
>> > > > > [ERROR]  Alternatively, if you host your own repository you can
>> > deploy
>> > > > the
>> > > > > file there:
>> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0
-Dpackaging=jar
>> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> > > > > [ERROR]
>> > > > > [ERROR]  Path to dependency:
>> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR]  Try downloading the file manually from the project
>> website.
>> > > > > [ERROR]
>> > > > > [ERROR]  Then, install it using the command:
>> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
>> > > > > -Dfile=/path/to/file
>> > > > > [ERROR]
>> > > > > [ERROR]  Alternatively, if you host your own repository you can
>> > deploy
>> > > > the
>> > > > > file there:
>> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
>> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> > > > > [ERROR]
>> > > > > [ERROR]  Path to dependency:
>> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  3) io.confluent:common-config:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR]  Try downloading the file manually from the project
>> website.
>> > > > > [ERROR]
>> > > > > [ERROR]  Then, install it using the command:
>> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
>> > > -Dpackaging=jar
>> > > > > -Dfile=/path/to/file
>> > > > > [ERROR]
>> > > > > [ERROR]  Alternatively, if you host your own repository you can
>> > deploy
>> > > > the
>> > > > > file there:
>> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
>> > > -Dpackaging=jar
>> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> > > > > [ERROR]
>> > > > > [ERROR]  Path to dependency:
>> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR]  Try downloading the file manually from the project
>> website.
>> > > > > [ERROR]
>> > > > > [ERROR]  Then, install it using the command:
>> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
>> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
>> > > > > -Dfile=/path/to/file
>> > > > > [ERROR]
>> > > > > [ERROR]  Alternatively, if you host your own repository you can
>> > deploy
>> > > > the
>> > > > > file there:
>> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
>> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
>> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>> > > > > [ERROR]
>> > > > > [ERROR]  Path to dependency:
>> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
>> > > > > [ERROR]
>> > > > > [ERROR] ----------
>> > > > > [ERROR] 4 required artifacts are missing.
>> > > > > [ERROR]
>> > > > > [ERROR] for artifact:
>> > > > > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
>> > > > > [ERROR]
>> > > > > [ERROR] from the specified remote repositories:
>> > > > > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
>> > > > > releases=true, snapshots=true),
>> > > > > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
>> > > > > releases=true, snapshots=true),
>> > > > > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
>> > > > > releases=true, snapshots=false),
>> > > > > [ERROR]  cloudera-repo-releases (
>> > > > > https://repository.cloudera.com/artifactory/public/,
>> releases=true,
>> > > > > snapshots=false),
>> > > > > [ERROR]  apache.snapshots (
https://repository.apache.org/snapshots
>> ,
>> > > > > releases=false, snapshots=true),
>> > > > > [ERROR]  central (https://repo.maven.apache.org/maven2,
>> > releases=true,
>> > > > > snapshots=false)
>> > > > > [ERROR]
>> > > > > [ERROR] -> [Help 1]
>> > > > > [ERROR]
>> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven
>> with
>> > > the
>> > > > -e
>> > > > > switch.
>> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
>> > logging.
>> > > > > [ERROR]
>> > > > > [ERROR] For more information about the errors and possible
>> solutions,
>> > > > > please read the following articles:
>> > > > > [ERROR] [Help 1]
>> > > > >
>> > >
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> > > > > [ERROR]
>> > > > > [ERROR] After correcting the problems, you can resume the build
>> with
>> > > the
>> > > > > command
>> > > > > [ERROR]  mvn <args> -rf :hudi-cli
>> > > > >
>> > > >
>> > >
>> >
>>
>

Re: Compile failing on master

Posted by Bhavani Sudha <bh...@gmail.com>.

Hi Gurudatt,

I was able to reproduce this with maven 3.6.2. Moving the confluent
repository  from hudi-utilities pom to parent pom helped unblock this
issue. Can you check if that works for you?

Thanks,
Sudha

On Sat, Oct 19, 2019 at 11:50 AM Vinoth Chandar <vi...@apache.org> wrote:

> Not sure why the maven version would matter. FWIW I am on 3.6.1 and I can
> build
>
>  [incubator-hudi]$ mvn -version
> Apache Maven 3.6.1
>
>
>
>
> On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <gu...@gmail.com>
> wrote:
>
> > Hi Balaji,
> >
> > I think I figured out why it was failing for me. I was on the latest
> maven
> > version(3.6.2). I built it using the 3.5 version that you are using and
> it
> > worked.
> >
> > I forked and built it on Circle CI, to reproduce the behavior
> > Build on 3.5.2 (
> >
> >
> https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
> > )
> >
> > Built on 3.6.2 (
> >
> >
> https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
> > )
> >
> > Regards,
> > Gurudatt
> >
> > On Fri, Oct 18, 2019 at 8:22 PM vbalaji@apache.org <vb...@apache.org>
> > wrote:
> >
> > >  I just tried deleting confluent jars from my .m2 repo and reran "mvn
> > > clean package -DskipTests". I am able to download it without problem
> (See
> > > logs below)
> > > My mvn version is : Apache Maven 3.5.4
> > > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00)
> > > Try manually curling the url (see logs below) within docker to see if
> > this
> > > is some network issue.
> > > Balaji.V
> > >
> > > [INFO] -------------------< org.apache.hudi:hudi-utilities
> > > >-------------------
> > >
> > > [INFO] Building hudi-utilities 0.5.0-incubating-rc6
> > > [8/27]
> > >
> > > [INFO] --------------------------------[ jar
> > > ]---------------------------------
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> > > (2.4 kB at 7.4 kB/s)
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> > > (5.9 kB at 196 kB/s)
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> > > (1.6 kB at 86 kB/s)
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> > > (1.6 kB at 9.1 kB/s)
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> > > (4.8 kB at 21 kB/s)
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> > > (2.1 kB at 8.4 kB/s)
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> > >
> > > Downloading from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> > > (36 kB at 426 kB/s)
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> > > (18 kB at 78 kB/s)
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> > > (24 kB at 100 kB/s)
> > >
> > > Downloaded from confluent:
> > >
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> > > (19 kB at 51 kB/s)
> > >      On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni <
> > > guruak107@gmail.com> wrote:
> > >
> > >  Hi Balaji / Pratyaksh,
> > >
> > > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it
> > and
> > > ran `mvn clean install -DskipTests -DskipITs` but it has the same
> issue.
> > >
> > >
> > > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <
> pratyaksh13@gmail.com>
> > > wrote:
> > >
> > > > Hi Balaji,
> > > >
> > > > I do not have custom settings.xml file and faced the same problem. I
> > was
> > > > able to fix it by first running the command as mentioned on the page
> > > > <https://hudi.apache.org/quickstart.html> -
> > > >
> > > > mvn clean install -DskipTests -DskipITs
> > > >
> > > > After running this command, you can run the other commands without
> any
> > > > error.
> > > >
> > > > On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <
> vbalaji@apache.org
> > >
> > > > wrote:
> > > >
> > > > >
> > > > > I have seen this happens sometimes if you have a custom
> > > > ~/.m2/settings.xml
> > > > > file. Try removing it and check.
> > > > > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt
> > > > > Kulkarni <gu...@gmail.com> wrote:
> > > > >
> > > > >  Hi All,
> > > > >
> > > > > I ran `mvn compile` on master, but it fails to build completely
> > because
> > > > it
> > > > > was unable to find Confluent dependencies. I added
> > > > > https://packages.confluent.io/maven2 in repositories in the main
> > > pom.xml
> > > > > and it built successfully. Just curious, how you guys are
> compiling?
> > > Can
> > > > we
> > > > > add confluent maven repository to the main pom.xml file?
> > > > >
> > > > > Here's the error that I got
> > > > >
> > > > > [ERROR] Failed to execute goal
> > > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> > > > > (process-resource-bundles) on project hudi-cli: Failed to resolve
> > > > > dependencies for one or more projects in the reactor. Reason:
> > Missing:
> > > > > [ERROR] ----------
> > > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR]  Try downloading the file manually from the project
> website.
> > > > > [ERROR]
> > > > > [ERROR]  Then, install it using the command:
> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > > > > -Dfile=/path/to/file
> > > > > [ERROR]
> > > > > [ERROR]  Alternatively, if you host your own repository you can
> > deploy
> > > > the
> > > > > file there:
> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > > [ERROR]
> > > > > [ERROR]  Path to dependency:
> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR]  Try downloading the file manually from the project
> website.
> > > > > [ERROR]
> > > > > [ERROR]  Then, install it using the command:
> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > > > > -Dfile=/path/to/file
> > > > > [ERROR]
> > > > > [ERROR]  Alternatively, if you host your own repository you can
> > deploy
> > > > the
> > > > > file there:
> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > > [ERROR]
> > > > > [ERROR]  Path to dependency:
> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  3) io.confluent:common-config:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR]  Try downloading the file manually from the project
> website.
> > > > > [ERROR]
> > > > > [ERROR]  Then, install it using the command:
> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> > > -Dpackaging=jar
> > > > > -Dfile=/path/to/file
> > > > > [ERROR]
> > > > > [ERROR]  Alternatively, if you host your own repository you can
> > deploy
> > > > the
> > > > > file there:
> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> > > -Dpackaging=jar
> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > > [ERROR]
> > > > > [ERROR]  Path to dependency:
> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR]  Try downloading the file manually from the project
> website.
> > > > > [ERROR]
> > > > > [ERROR]  Then, install it using the command:
> > > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > > > > -Dfile=/path/to/file
> > > > > [ERROR]
> > > > > [ERROR]  Alternatively, if you host your own repository you can
> > deploy
> > > > the
> > > > > file there:
> > > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > > [ERROR]
> > > > > [ERROR]  Path to dependency:
> > > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> > > > > [ERROR]
> > > > > [ERROR] ----------
> > > > > [ERROR] 4 required artifacts are missing.
> > > > > [ERROR]
> > > > > [ERROR] for artifact:
> > > > > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > > [ERROR]
> > > > > [ERROR] from the specified remote repositories:
> > > > > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
> > > > > releases=true, snapshots=true),
> > > > > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> > > > > releases=true, snapshots=true),
> > > > > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> > > > > releases=true, snapshots=false),
> > > > > [ERROR]  cloudera-repo-releases (
> > > > > https://repository.cloudera.com/artifactory/public/,
> releases=true,
> > > > > snapshots=false),
> > > > > [ERROR]  apache.snapshots (https://repository.apache.org/snapshots
> ,
> > > > > releases=false, snapshots=true),
> > > > > [ERROR]  central (https://repo.maven.apache.org/maven2,
> > releases=true,
> > > > > snapshots=false)
> > > > > [ERROR]
> > > > > [ERROR] -> [Help 1]
> > > > > [ERROR]
> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven
> with
> > > the
> > > > -e
> > > > > switch.
> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> > logging.
> > > > > [ERROR]
> > > > > [ERROR] For more information about the errors and possible
> solutions,
> > > > > please read the following articles:
> > > > > [ERROR] [Help 1]
> > > > >
> > >
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > > > [ERROR]
> > > > > [ERROR] After correcting the problems, you can resume the build
> with
> > > the
> > > > > command
> > > > > [ERROR]  mvn <args> -rf :hudi-cli
> > > > >
> > > >
> > >
> >
>

Re: Compile failing on master

Posted by Vinoth Chandar <vi...@apache.org>.

Not sure why the maven version would matter. FWIW I am on 3.6.1 and I can
build

 [incubator-hudi]$ mvn -version
Apache Maven 3.6.1




On Fri, Oct 18, 2019 at 11:43 AM Gurudatt Kulkarni <gu...@gmail.com>
wrote:

> Hi Balaji,
>
> I think I figured out why it was failing for me. I was on the latest maven
> version(3.6.2). I built it using the 3.5 version that you are using and it
> worked.
>
> I forked and built it on Circle CI, to reproduce the behavior
> Build on 3.5.2 (
>
> https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
> )
>
> Built on 3.6.2 (
>
> https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
> )
>
> Regards,
> Gurudatt
>
> On Fri, Oct 18, 2019 at 8:22 PM vbalaji@apache.org <vb...@apache.org>
> wrote:
>
> >  I just tried deleting confluent jars from my .m2 repo and reran "mvn
> > clean package -DskipTests". I am able to download it without problem (See
> > logs below)
> > My mvn version is : Apache Maven 3.5.4
> > (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00)
> > Try manually curling the url (see logs below) within docker to see if
> this
> > is some network issue.
> > Balaji.V
> >
> > [INFO] -------------------< org.apache.hudi:hudi-utilities
> > >-------------------
> >
> > [INFO] Building hudi-utilities 0.5.0-incubating-rc6
> > [8/27]
> >
> > [INFO] --------------------------------[ jar
> > ]---------------------------------
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> > (2.4 kB at 7.4 kB/s)
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> > (5.9 kB at 196 kB/s)
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> > (1.6 kB at 86 kB/s)
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> > (1.6 kB at 9.1 kB/s)
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> > (4.8 kB at 21 kB/s)
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> > (2.1 kB at 8.4 kB/s)
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> >
> > Downloading from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> > (36 kB at 426 kB/s)
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> > (18 kB at 78 kB/s)
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> > (24 kB at 100 kB/s)
> >
> > Downloaded from confluent:
> >
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> > (19 kB at 51 kB/s)
> >      On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni <
> > guruak107@gmail.com> wrote:
> >
> >  Hi Balaji / Pratyaksh,
> >
> > I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it
> and
> > ran `mvn clean install -DskipTests -DskipITs` but it has the same issue.
> >
> >
> > On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <pr...@gmail.com>
> > wrote:
> >
> > > Hi Balaji,
> > >
> > > I do not have custom settings.xml file and faced the same problem. I
> was
> > > able to fix it by first running the command as mentioned on the page
> > > <https://hudi.apache.org/quickstart.html> -
> > >
> > > mvn clean install -DskipTests -DskipITs
> > >
> > > After running this command, you can run the other commands without any
> > > error.
> > >
> > > On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <vbalaji@apache.org
> >
> > > wrote:
> > >
> > > >
> > > > I have seen this happens sometimes if you have a custom
> > > ~/.m2/settings.xml
> > > > file. Try removing it and check.
> > > > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt
> > > > Kulkarni <gu...@gmail.com> wrote:
> > > >
> > > >  Hi All,
> > > >
> > > > I ran `mvn compile` on master, but it fails to build completely
> because
> > > it
> > > > was unable to find Confluent dependencies. I added
> > > > https://packages.confluent.io/maven2 in repositories in the main
> > pom.xml
> > > > and it built successfully. Just curious, how you guys are compiling?
> > Can
> > > we
> > > > add confluent maven repository to the main pom.xml file?
> > > >
> > > > Here's the error that I got
> > > >
> > > > [ERROR] Failed to execute goal
> > > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> > > > (process-resource-bundles) on project hudi-cli: Failed to resolve
> > > > dependencies for one or more projects in the reactor. Reason:
> Missing:
> > > > [ERROR] ----------
> > > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR]  Try downloading the file manually from the project website.
> > > > [ERROR]
> > > > [ERROR]  Then, install it using the command:
> > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > > > -Dfile=/path/to/file
> > > > [ERROR]
> > > > [ERROR]  Alternatively, if you host your own repository you can
> deploy
> > > the
> > > > file there:
> > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > [ERROR]
> > > > [ERROR]  Path to dependency:
> > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR] 2) io.confluent:common-config:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR]  Try downloading the file manually from the project website.
> > > > [ERROR]
> > > > [ERROR]  Then, install it using the command:
> > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > > > -Dfile=/path/to/file
> > > > [ERROR]
> > > > [ERROR]  Alternatively, if you host your own repository you can
> deploy
> > > the
> > > > file there:
> > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > [ERROR]
> > > > [ERROR]  Path to dependency:
> > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  3) io.confluent:common-config:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR]  Try downloading the file manually from the project website.
> > > > [ERROR]
> > > > [ERROR]  Then, install it using the command:
> > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> > -Dpackaging=jar
> > > > -Dfile=/path/to/file
> > > > [ERROR]
> > > > [ERROR]  Alternatively, if you host your own repository you can
> deploy
> > > the
> > > > file there:
> > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> > -Dpackaging=jar
> > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > [ERROR]
> > > > [ERROR]  Path to dependency:
> > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR]  Try downloading the file manually from the project website.
> > > > [ERROR]
> > > > [ERROR]  Then, install it using the command:
> > > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > > > -Dfile=/path/to/file
> > > > [ERROR]
> > > > [ERROR]  Alternatively, if you host your own repository you can
> deploy
> > > the
> > > > file there:
> > > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > > [ERROR]
> > > > [ERROR]  Path to dependency:
> > > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> > > > [ERROR]
> > > > [ERROR] ----------
> > > > [ERROR] 4 required artifacts are missing.
> > > > [ERROR]
> > > > [ERROR] for artifact:
> > > > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > > [ERROR]
> > > > [ERROR] from the specified remote repositories:
> > > > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
> > > > releases=true, snapshots=true),
> > > > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> > > > releases=true, snapshots=true),
> > > > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> > > > releases=true, snapshots=false),
> > > > [ERROR]  cloudera-repo-releases (
> > > > https://repository.cloudera.com/artifactory/public/, releases=true,
> > > > snapshots=false),
> > > > [ERROR]  apache.snapshots (https://repository.apache.org/snapshots,
> > > > releases=false, snapshots=true),
> > > > [ERROR]  central (https://repo.maven.apache.org/maven2,
> releases=true,
> > > > snapshots=false)
> > > > [ERROR]
> > > > [ERROR] -> [Help 1]
> > > > [ERROR]
> > > > [ERROR] To see the full stack trace of the errors, re-run Maven with
> > the
> > > -e
> > > > switch.
> > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> logging.
> > > > [ERROR]
> > > > [ERROR] For more information about the errors and possible solutions,
> > > > please read the following articles:
> > > > [ERROR] [Help 1]
> > > >
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > > [ERROR]
> > > > [ERROR] After correcting the problems, you can resume the build with
> > the
> > > > command
> > > > [ERROR]  mvn <args> -rf :hudi-cli
> > > >
> > >
> >
>

Re: Compile failing on master

Posted by Gurudatt Kulkarni <gu...@gmail.com>.

Hi Balaji,

I think I figured out why it was failing for me. I was on the latest maven
version(3.6.2). I built it using the 3.5 version that you are using and it
worked.

I forked and built it on Circle CI, to reproduce the behavior
Build on 3.5.2 (
https://circleci.com/gh/Guru107/incubator-hudi/2?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
)

Built on 3.6.2 (
https://circleci.com/gh/Guru107/incubator-hudi/3?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
)

Regards,
Gurudatt

On Fri, Oct 18, 2019 at 8:22 PM vbalaji@apache.org <vb...@apache.org>
wrote:

>  I just tried deleting confluent jars from my .m2 repo and reran "mvn
> clean package -DskipTests". I am able to download it without problem (See
> logs below)
> My mvn version is : Apache Maven 3.5.4
> (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00)
> Try manually curling the url (see logs below) within docker to see if this
> is some network issue.
> Balaji.V
>
> [INFO] -------------------< org.apache.hudi:hudi-utilities
> >-------------------
>
> [INFO] Building hudi-utilities 0.5.0-incubating-rc6
> [8/27]
>
> [INFO] --------------------------------[ jar
> ]---------------------------------
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom
> (2.4 kB at 7.4 kB/s)
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom
> (5.9 kB at 196 kB/s)
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom
> (1.6 kB at 86 kB/s)
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom
> (1.6 kB at 9.1 kB/s)
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom
> (4.8 kB at 21 kB/s)
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom
> (2.1 kB at 8.4 kB/s)
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
>
> Downloading from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar
> (36 kB at 426 kB/s)
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar
> (18 kB at 78 kB/s)
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar
> (24 kB at 100 kB/s)
>
> Downloaded from confluent:
> https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar
> (19 kB at 51 kB/s)
>      On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni <
> guruak107@gmail.com> wrote:
>
>  Hi Balaji / Pratyaksh,
>
> I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it and
> ran `mvn clean install -DskipTests -DskipITs` but it has the same issue.
>
>
> On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <pr...@gmail.com>
> wrote:
>
> > Hi Balaji,
> >
> > I do not have custom settings.xml file and faced the same problem. I was
> > able to fix it by first running the command as mentioned on the page
> > <https://hudi.apache.org/quickstart.html> -
> >
> > mvn clean install -DskipTests -DskipITs
> >
> > After running this command, you can run the other commands without any
> > error.
> >
> > On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <vb...@apache.org>
> > wrote:
> >
> > >
> > > I have seen this happens sometimes if you have a custom
> > ~/.m2/settings.xml
> > > file. Try removing it and check.
> > > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt
> > > Kulkarni <gu...@gmail.com> wrote:
> > >
> > >  Hi All,
> > >
> > > I ran `mvn compile` on master, but it fails to build completely because
> > it
> > > was unable to find Confluent dependencies. I added
> > > https://packages.confluent.io/maven2 in repositories in the main
> pom.xml
> > > and it built successfully. Just curious, how you guys are compiling?
> Can
> > we
> > > add confluent maven repository to the main pom.xml file?
> > >
> > > Here's the error that I got
> > >
> > > [ERROR] Failed to execute goal
> > > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> > > (process-resource-bundles) on project hudi-cli: Failed to resolve
> > > dependencies for one or more projects in the reactor. Reason: Missing:
> > > [ERROR] ----------
> > > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> > > [ERROR]
> > > [ERROR]  Try downloading the file manually from the project website.
> > > [ERROR]
> > > [ERROR]  Then, install it using the command:
> > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > > -Dfile=/path/to/file
> > > [ERROR]
> > > [ERROR]  Alternatively, if you host your own repository you can deploy
> > the
> > > file there:
> > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > [ERROR]
> > > [ERROR]  Path to dependency:
> > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> > > [ERROR]
> > > [ERROR] 2) io.confluent:common-config:jar:3.0.0
> > > [ERROR]
> > > [ERROR]  Try downloading the file manually from the project website.
> > > [ERROR]
> > > [ERROR]  Then, install it using the command:
> > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > > -Dfile=/path/to/file
> > > [ERROR]
> > > [ERROR]  Alternatively, if you host your own repository you can deploy
> > the
> > > file there:
> > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > [ERROR]
> > > [ERROR]  Path to dependency:
> > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > [ERROR]  3) io.confluent:common-config:jar:3.0.0
> > > [ERROR]
> > > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > > [ERROR]
> > > [ERROR]  Try downloading the file manually from the project website.
> > > [ERROR]
> > > [ERROR]  Then, install it using the command:
> > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> -Dpackaging=jar
> > > -Dfile=/path/to/file
> > > [ERROR]
> > > [ERROR]  Alternatively, if you host your own repository you can deploy
> > the
> > > file there:
> > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0
> -Dpackaging=jar
> > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > [ERROR]
> > > [ERROR]  Path to dependency:
> > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > > [ERROR]
> > > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> > > [ERROR]
> > > [ERROR]  Try downloading the file manually from the project website.
> > > [ERROR]
> > > [ERROR]  Then, install it using the command:
> > > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > > -Dfile=/path/to/file
> > > [ERROR]
> > > [ERROR]  Alternatively, if you host your own repository you can deploy
> > the
> > > file there:
> > > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > > [ERROR]
> > > [ERROR]  Path to dependency:
> > > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> > > [ERROR]
> > > [ERROR] ----------
> > > [ERROR] 4 required artifacts are missing.
> > > [ERROR]
> > > [ERROR] for artifact:
> > > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > > [ERROR]
> > > [ERROR] from the specified remote repositories:
> > > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
> > > releases=true, snapshots=true),
> > > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> > > releases=true, snapshots=true),
> > > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> > > releases=true, snapshots=false),
> > > [ERROR]  cloudera-repo-releases (
> > > https://repository.cloudera.com/artifactory/public/, releases=true,
> > > snapshots=false),
> > > [ERROR]  apache.snapshots (https://repository.apache.org/snapshots,
> > > releases=false, snapshots=true),
> > > [ERROR]  central (https://repo.maven.apache.org/maven2, releases=true,
> > > snapshots=false)
> > > [ERROR]
> > > [ERROR] -> [Help 1]
> > > [ERROR]
> > > [ERROR] To see the full stack trace of the errors, re-run Maven with
> the
> > -e
> > > switch.
> > > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > > [ERROR]
> > > [ERROR] For more information about the errors and possible solutions,
> > > please read the following articles:
> > > [ERROR] [Help 1]
> > >
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > [ERROR]
> > > [ERROR] After correcting the problems, you can resume the build with
> the
> > > command
> > > [ERROR]  mvn <args> -rf :hudi-cli
> > >
> >
>

Re: Compile failing on master

Posted by "vbalaji@apache.org" <vb...@apache.org>.

 I just tried deleting confluent jars from my .m2 repo and reran "mvn clean package -DskipTests". I am able to download it without problem (See logs below)
My mvn version is : Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T11:33:14-07:00)
Try manually curling the url (see logs below) within docker to see if this is some network issue.
Balaji.V

[INFO] -------------------< org.apache.hudi:hudi-utilities >-------------------

[INFO] Building hudi-utilities 0.5.0-incubating-rc6                      [8/27]

[INFO] --------------------------------[ jar ]---------------------------------

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.pom (2.4 kB at 7.4 kB/s)

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-parent/3.0.0/kafka-schema-registry-parent-3.0.0.pom (5.9 kB at 196 kB/s)

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.pom (1.6 kB at 86 kB/s)

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.pom (1.6 kB at 9.1 kB/s)

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common/3.0.0/common-3.0.0.pom (4.8 kB at 21 kB/s)

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.pom (2.1 kB at 8.4 kB/s)

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar

Downloading from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-schema-registry-client/3.0.0/kafka-schema-registry-client-3.0.0.jar (36 kB at 426 kB/s)

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-utils/3.0.0/common-utils-3.0.0.jar (18 kB at 78 kB/s)

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/kafka-avro-serializer/3.0.0/kafka-avro-serializer-3.0.0.jar (24 kB at 100 kB/s)

Downloaded from confluent: https://packages.confluent.io/maven/io/confluent/common-config/3.0.0/common-config-3.0.0.jar (19 kB at 51 kB/s)
     On Friday, October 18, 2019, 06:17:45 AM PDT, Gurudatt Kulkarni <gu...@gmail.com> wrote:  
 
 Hi Balaji / Pratyaksh,

I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it and
ran `mvn clean install -DskipTests -DskipITs` but it has the same issue.


On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <pr...@gmail.com>
wrote:

> Hi Balaji,
>
> I do not have custom settings.xml file and faced the same problem. I was
> able to fix it by first running the command as mentioned on the page
> <https://hudi.apache.org/quickstart.html> -
>
> mvn clean install -DskipTests -DskipITs
>
> After running this command, you can run the other commands without any
> error.
>
> On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <vb...@apache.org>
> wrote:
>
> >
> > I have seen this happens sometimes if you have a custom
> ~/.m2/settings.xml
> > file. Try removing it and check.
> > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt
> > Kulkarni <gu...@gmail.com> wrote:
> >
> >  Hi All,
> >
> > I ran `mvn compile` on master, but it fails to build completely because
> it
> > was unable to find Confluent dependencies. I added
> > https://packages.confluent.io/maven2 in repositories in the main pom.xml
> > and it built successfully. Just curious, how you guys are compiling? Can
> we
> > add confluent maven repository to the main pom.xml file?
> >
> > Here's the error that I got
> >
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> > (process-resource-bundles) on project hudi-cli: Failed to resolve
> > dependencies for one or more projects in the reactor. Reason: Missing:
> > [ERROR] ----------
> > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> > [ERROR]
> > [ERROR] 2) io.confluent:common-config:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:common-config:jar:3.0.0
> > [ERROR]
> > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > [ERROR]
> > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> > [ERROR]
> > [ERROR] ----------
> > [ERROR] 4 required artifacts are missing.
> > [ERROR]
> > [ERROR] for artifact:
> > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]
> > [ERROR] from the specified remote repositories:
> > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
> > releases=true, snapshots=true),
> > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> > releases=true, snapshots=true),
> > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> > releases=true, snapshots=false),
> > [ERROR]  cloudera-repo-releases (
> > https://repository.cloudera.com/artifactory/public/, releases=true,
> > snapshots=false),
> > [ERROR]  apache.snapshots (https://repository.apache.org/snapshots,
> > releases=false, snapshots=true),
> > [ERROR]  central (https://repo.maven.apache.org/maven2, releases=true,
> > snapshots=false)
> > [ERROR]
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR]  mvn <args> -rf :hudi-cli
> >
>

Re: Compile failing on master

Posted by Gurudatt Kulkarni <gu...@gmail.com>.

Hi Balaji / Pratyaksh,

I just pulled maven:3.6.2-jdk-8 docker image and cloned the repo in it and
ran `mvn clean install -DskipTests -DskipITs` but it has the same issue.


On Fri, Oct 18, 2019 at 4:36 PM Pratyaksh Sharma <pr...@gmail.com>
wrote:

> Hi Balaji,
>
> I do not have custom settings.xml file and faced the same problem. I was
> able to fix it by first running the command as mentioned on the page
> <https://hudi.apache.org/quickstart.html> -
>
> mvn clean install -DskipTests -DskipITs
>
> After running this command, you can run the other commands without any
> error.
>
> On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <vb...@apache.org>
> wrote:
>
> >
> > I have seen this happens sometimes if you have a custom
> ~/.m2/settings.xml
> > file. Try removing it and check.
> > Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt
> > Kulkarni <gu...@gmail.com> wrote:
> >
> >  Hi All,
> >
> > I ran `mvn compile` on master, but it fails to build completely because
> it
> > was unable to find Confluent dependencies. I added
> > https://packages.confluent.io/maven2 in repositories in the main pom.xml
> > and it built successfully. Just curious, how you guys are compiling? Can
> we
> > add confluent maven repository to the main pom.xml file?
> >
> > Here's the error that I got
> >
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> > (process-resource-bundles) on project hudi-cli: Failed to resolve
> > dependencies for one or more projects in the reactor. Reason: Missing:
> > [ERROR] ----------
> > [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> > [ERROR]
> > [ERROR] 2) io.confluent:common-config:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:common-config:jar:3.0.0
> > [ERROR]
> > [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> > [ERROR]
> > [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> > [ERROR]
> > [ERROR]  Try downloading the file manually from the project website.
> > [ERROR]
> > [ERROR]  Then, install it using the command:
> > [ERROR]      mvn install:install-file -DgroupId=io.confluent
> > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file
> > [ERROR]
> > [ERROR]  Alternatively, if you host your own repository you can deploy
> the
> > file there:
> > [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> > -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> > -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> > [ERROR]
> > [ERROR]  Path to dependency:
> > [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> > [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> > [ERROR]
> > [ERROR] ----------
> > [ERROR] 4 required artifacts are missing.
> > [ERROR]
> > [ERROR] for artifact:
> > [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> > [ERROR]
> > [ERROR] from the specified remote repositories:
> > [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
> > releases=true, snapshots=true),
> > [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> > releases=true, snapshots=true),
> > [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> > releases=true, snapshots=false),
> > [ERROR]  cloudera-repo-releases (
> > https://repository.cloudera.com/artifactory/public/, releases=true,
> > snapshots=false),
> > [ERROR]  apache.snapshots (https://repository.apache.org/snapshots,
> > releases=false, snapshots=true),
> > [ERROR]  central (https://repo.maven.apache.org/maven2, releases=true,
> > snapshots=false)
> > [ERROR]
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR]  mvn <args> -rf :hudi-cli
> >
>

Re: Compile failing on master

Posted by Pratyaksh Sharma <pr...@gmail.com>.

Hi Balaji,

I do not have custom settings.xml file and faced the same problem. I was
able to fix it by first running the command as mentioned on the page
<https://hudi.apache.org/quickstart.html> -

mvn clean install -DskipTests -DskipITs

After running this command, you can run the other commands without any
error.

On Fri, Oct 18, 2019 at 4:24 PM vbalaji@apache.org <vb...@apache.org>
wrote:

>
> I have seen this happens sometimes if you have a custom ~/.m2/settings.xml
> file. Try removing it and check.
> Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt
> Kulkarni <gu...@gmail.com> wrote:
>
>  Hi All,
>
> I ran `mvn compile` on master, but it fails to build completely because it
> was unable to find Confluent dependencies. I added
> https://packages.confluent.io/maven2 in repositories in the main pom.xml
> and it built successfully. Just curious, how you guys are compiling? Can we
> add confluent maven repository to the main pom.xml file?
>
> Here's the error that I got
>
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
> (process-resource-bundles) on project hudi-cli: Failed to resolve
> dependencies for one or more projects in the reactor. Reason: Missing:
> [ERROR] ----------
> [ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
> [ERROR]
> [ERROR]  Try downloading the file manually from the project website.
> [ERROR]
> [ERROR]  Then, install it using the command:
> [ERROR]      mvn install:install-file -DgroupId=io.confluent
> -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file
> [ERROR]
> [ERROR]  Alternatively, if you host your own repository you can deploy the
> file there:
> [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> -DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> [ERROR]
> [ERROR]  Path to dependency:
> [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> [ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
> [ERROR]
> [ERROR] 2) io.confluent:common-config:jar:3.0.0
> [ERROR]
> [ERROR]  Try downloading the file manually from the project website.
> [ERROR]
> [ERROR]  Then, install it using the command:
> [ERROR]      mvn install:install-file -DgroupId=io.confluent
> -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file
> [ERROR]
> [ERROR]  Alternatively, if you host your own repository you can deploy the
> file there:
> [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> -DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> [ERROR]
> [ERROR]  Path to dependency:
> [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> [ERROR]  3) io.confluent:common-config:jar:3.0.0
> [ERROR]
> [ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> [ERROR]
> [ERROR]  Try downloading the file manually from the project website.
> [ERROR]
> [ERROR]  Then, install it using the command:
> [ERROR]      mvn install:install-file -DgroupId=io.confluent
> -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file
> [ERROR]
> [ERROR]  Alternatively, if you host your own repository you can deploy the
> file there:
> [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> -DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> [ERROR]
> [ERROR]  Path to dependency:
> [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> [ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
> [ERROR]
> [ERROR] 4) io.confluent:common-utils:jar:3.0.0
> [ERROR]
> [ERROR]  Try downloading the file manually from the project website.
> [ERROR]
> [ERROR]  Then, install it using the command:
> [ERROR]      mvn install:install-file -DgroupId=io.confluent
> -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file
> [ERROR]
> [ERROR]  Alternatively, if you host your own repository you can deploy the
> file there:
> [ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
> -DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> [ERROR]
> [ERROR]  Path to dependency:
> [ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> [ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
> [ERROR]  3) io.confluent:common-utils:jar:3.0.0
> [ERROR]
> [ERROR] ----------
> [ERROR] 4 required artifacts are missing.
> [ERROR]
> [ERROR] for artifact:
> [ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
> [ERROR]
> [ERROR] from the specified remote repositories:
> [ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
> releases=true, snapshots=true),
> [ERROR]  libs-release (https://repo.spring.io/libs-release/,
> releases=true, snapshots=true),
> [ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
> releases=true, snapshots=false),
> [ERROR]  cloudera-repo-releases (
> https://repository.cloudera.com/artifactory/public/, releases=true,
> snapshots=false),
> [ERROR]  apache.snapshots (https://repository.apache.org/snapshots,
> releases=false, snapshots=true),
> [ERROR]  central (https://repo.maven.apache.org/maven2, releases=true,
> snapshots=false)
> [ERROR]
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]  mvn <args> -rf :hudi-cli
>

Re: Compile failing on master

Posted by "vbalaji@apache.org" <vb...@apache.org>.

 
I have seen this happens sometimes if you have a custom ~/.m2/settings.xml file. Try removing it and check.
Balaji.V    On Friday, October 18, 2019, 03:31:09 AM PDT, Gurudatt Kulkarni <gu...@gmail.com> wrote:  
 
 Hi All,

I ran `mvn compile` on master, but it fails to build completely because it
was unable to find Confluent dependencies. I added
https://packages.confluent.io/maven2 in repositories in the main pom.xml
and it built successfully. Just curious, how you guys are compiling? Can we
add confluent maven repository to the main pom.xml file?

Here's the error that I got

[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
(process-resource-bundles) on project hudi-cli: Failed to resolve
dependencies for one or more projects in the reactor. Reason: Missing:
[ERROR] ----------
[ERROR] 1) io.confluent:kafka-avro-serializer:jar:3.0.0
[ERROR]
[ERROR]  Try downloading the file manually from the project website.
[ERROR]
[ERROR]  Then, install it using the command:
[ERROR]      mvn install:install-file -DgroupId=io.confluent
-DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]  Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=kafka-avro-serializer -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]  Path to dependency:
[ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]  3) io.confluent:kafka-avro-serializer:jar:3.0.0
[ERROR]
[ERROR] 2) io.confluent:common-config:jar:3.0.0
[ERROR]
[ERROR]  Try downloading the file manually from the project website.
[ERROR]
[ERROR]  Then, install it using the command:
[ERROR]      mvn install:install-file -DgroupId=io.confluent
-DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]  Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=common-config -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]  Path to dependency:
[ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]  3) io.confluent:common-config:jar:3.0.0
[ERROR]
[ERROR] 3) io.confluent:kafka-schema-registry-client:jar:3.0.0
[ERROR]
[ERROR]  Try downloading the file manually from the project website.
[ERROR]
[ERROR]  Then, install it using the command:
[ERROR]      mvn install:install-file -DgroupId=io.confluent
-DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]  Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=kafka-schema-registry-client -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]  Path to dependency:
[ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]  3) io.confluent:kafka-schema-registry-client:jar:3.0.0
[ERROR]
[ERROR] 4) io.confluent:common-utils:jar:3.0.0
[ERROR]
[ERROR]  Try downloading the file manually from the project website.
[ERROR]
[ERROR]  Then, install it using the command:
[ERROR]      mvn install:install-file -DgroupId=io.confluent
-DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file
[ERROR]
[ERROR]  Alternatively, if you host your own repository you can deploy the
file there:
[ERROR]      mvn deploy:deploy-file -DgroupId=io.confluent
-DartifactId=common-utils -Dversion=3.0.0 -Dpackaging=jar
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR]  Path to dependency:
[ERROR]  1) org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]  2) org.apache.hudi:hudi-utilities:jar:0.5.1-SNAPSHOT
[ERROR]  3) io.confluent:common-utils:jar:3.0.0
[ERROR]
[ERROR] ----------
[ERROR] 4 required artifacts are missing.
[ERROR]
[ERROR] for artifact:
[ERROR]  org.apache.hudi:hudi-cli:jar:0.5.1-SNAPSHOT
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR]  libs-milestone (https://repo.spring.io/libs-milestone/,
releases=true, snapshots=true),
[ERROR]  libs-release (https://repo.spring.io/libs-release/,
releases=true, snapshots=true),
[ERROR]  Maven Central (https://repo.maven.apache.org/maven2,
releases=true, snapshots=false),
[ERROR]  cloudera-repo-releases (
https://repository.cloudera.com/artifactory/public/, releases=true,
snapshots=false),
[ERROR]  apache.snapshots (https://repository.apache.org/snapshots,
releases=false, snapshots=true),
[ERROR]  central (https://repo.maven.apache.org/maven2, releases=true,
snapshots=false)
[ERROR]
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR]  mvn <args> -rf :hudi-cli