You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cxf.apache.org by Andriy Redko <dr...@gmail.com> on 2018/06/08 01:27:18 UTC
Re: Builds on Jenkins
Hey guys,
Quick update on this. The issue is not resolved, BUT I accidentally reproduced the it on my local box. So I used to
build with `Apache Maven 3.2.1` and have never seen any issues, but recently I run the CXF build with `Apache Maven 3.5.2`,
by accident actually, and ... the same 15 mins delay on snapshot downloads ... !!! 100% of the time, I don't know the cause
yet but I believe this is not an infrastructure problem so I closed https://issues.apache.org/jira/browse/INFRA-16489 ticket.
I will be looking into this, at least with a goal to pinpoint the Maven version to blame, so we could figure out the root of
it.
PS: FYI, running build on Windows box / Java 8. Will check on Linux shortly (but gut feeling tells me the 15 mins delay
will be there)
Best Regards,
Andriy Redko
Sunday, May 6, 2018, 2:42:05 AM, you wrote:
DK> Hi Andriy,
DK> thanks for the analysis.
>> John, guys, any hints who might help us here? Infra team?
DK> Could you please open an issue at:
DK> https://issues.apache.org/jira/projects/INFRA/
DK> Cheers
DK> Dennis
Re: Builds on Jenkins
Posted by Dennis Kieselhorst <de...@apache.org>.
Have you tried to do a thread dump to see where it's hanging? So far I
couldn't reproduce this, maybe I have to try with a clean local repo.
Dennis
Am 08.06.2018 um 11:14 schrieb Colm O hEigeartaigh:
> I've also noticed Maven "pausing" recently when downloading SNAPSHOTs on my
> local machine (ubuntu).
>
> Colm.
>
> On Fri, Jun 8, 2018 at 2:27 AM, Andriy Redko <dr...@gmail.com> wrote:
>
>> Hey guys,
>>
>> Quick update on this. The issue is not resolved, BUT I accidentally
>> reproduced the it on my local box. So I used to
>> build with `Apache Maven 3.2.1` and have never seen any issues, but
>> recently I run the CXF build with `Apache Maven 3.5.2`,
>> by accident actually, and ... the same 15 mins delay on snapshot downloads
>> ... !!! 100% of the time, I don't know the cause
>> yet but I believe this is not an infrastructure problem so I closed
>> https://issues.apache.org/jira/browse/INFRA-16489 ticket.
>> I will be looking into this, at least with a goal to pinpoint the Maven
>> version to blame, so we could figure out the root of
>> it.
>>
>> PS: FYI, running build on Windows box / Java 8. Will check on Linux
>> shortly (but gut feeling tells me the 15 mins delay
>> will be there)
>>
>> Best Regards,
>> Andriy Redko
>>
>> Sunday, May 6, 2018, 2:42:05 AM, you wrote:
>>
>> DK> Hi Andriy,
>>
>> DK> thanks for the analysis.
>>>> John, guys, any hints who might help us here? Infra team?
>> DK> Could you please open an issue at:
>> DK> https://issues.apache.org/jira/projects/INFRA/
>>
>> DK> Cheers
>> DK> Dennis
>>
>>
>
Re: Builds on Jenkins
Posted by "John D. Ament" <jo...@apache.org>.
I'll take a look at Jenkins when back in the office. Worst case probably
ask infra on hipchat
On Thu, Jun 14, 2018, 7:42 AM Andriy Redko <dr...@gmail.com> wrote:
> Hey guys,
>
> So here is what I found. I was able to get the thread dump with Apache
> Maven 3.5.2 and here is the victim:
>
> "DefaultMetadataResolver-1-0" #31 daemon prio=5 os_prio=0
> tid=0x000000001a9ae800 nid=0x18bc waiting on condition [0x000000002021e000]
> java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at
> org.eclipse.aether.connector.basic.PartialFile$LockFile.lock(PartialFile.java:113)
>
> at
> org.eclipse.aether.connector.basic.PartialFile$LockFile.<init>(PartialFile.java:69)
>
> at
> org.eclipse.aether.connector.basic.PartialFile$Factory.newInstance(PartialFile.java:278)
>
> at
> org.eclipse.aether.connector.basic.BasicRepositoryConnector$GetTaskRunner.runTask(BasicRepositoryConnector.java:438)
>
> at
> org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:360)
>
> at
> org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:75)
>
> at
> org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:583)
>
> at
> org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:232)
>
> at
> org.eclipse.aether.internal.impl.DefaultMetadataResolver$ResolveTask.run(DefaultMetadataResolver.java:593)
>
> at
> org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:75)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>
> at java.lang.Thread.run(Thread.java:748)
>
> Maven stuck on obtaining file lock, in this case for:
>
> Downloading from apache.snapshots:
> https://repository.apache.org/snapshots/org/apache/cxf/xjcplugins/cxf-xjc-dv/3.2.2-SNAPSHOT/maven-metadata.xml
> Downloading from apache.snapshots:
> https://repository.apache.org/snapshots/org/apache/cxf/xjcplugins/cxf-xjc-dv/3.2.2-SNAPSHOT/maven-metadata.xml
> Downloaded from apache.snapshots:
> https://repository.apache.org/snapshots/org/apache/cxf/xjcplugins/cxf-xjc-dv/3.2.2-SNAPSHOT/maven-metadata.xml
> (785 B at 2.1 kB/s)
>
> It seems to be related to https://issues.apache.org/jira/browse/MNG-6323
> and fixed in Apache Maven 3.5.3. Indeed, I have tried Apache Maven 3.5.3
> and the issue is not there anymore, at least for me. It is reproducible
> 100% (just switching from 3.5.3 back to 3.5.2 and below manifests the
> problem right away). It is still not clear to me why Colm sees slow builds
> with 3.5.3, could be another issue?
>
> Regarding Jenkins, I am not able to find what is behind "Maven 3 (latest)"
> in the tooling, I don't have right permissions. Dennis, John any chance you
> guys could help to figure it out? Thanks.
>
> Best Regards,
> Andriy Redko
>
>
>
> Friday, June 8, 2018, 6:58:37 AM, you wrote:
>
>
> The latest - 3.5.3.
>
> Colm.
>
> On Fri, Jun 8, 2018 at 11:55 AM, Andriy Redko <dr...@gmail.com> wrote:
>
> Hi Colm,
>
> Thanks for confirming, what version of Apache Maven you are using? As a
> temp workaround,
> if you build with Maven 3.2.1 (or I think 3.2.x in general), the issue
> shouldn't manifest.
>
> Best Regards,
> Andriy Redko
>
>
> Friday, June 8, 2018, 5:14:38 AM, you wrote:
>
> COh> I've also noticed Maven "pausing" recently when downloading SNAPSHOTs
> on my local machine (ubuntu).
>
>
> COh> Colm.
>
>
> COh> On Fri, Jun 8, 2018 at 2:27 AM, Andriy Redko <dr...@gmail.com>
> wrote:
>
> COh> Hey guys,
>
> COh> Quick update on this. The issue is not resolved, BUT I accidentally
> reproduced the it on my local box. So I used to
> COh> build with `Apache Maven 3.2.1` and have never seen any issues, but
> recently I run the CXF build with `Apache Maven 3.5.2`,
> COh> by accident actually, and ... the same 15 mins delay on snapshot
> downloads ... !!! 100% of the time, I don't know the cause
> COh> yet but I believe this is not an infrastructure problem so I closed
> COh> https://issues.apache.org/jira/browse/INFRA-16489 ticket.
> COh> I will be looking into this, at least with a goal to pinpoint the
> Maven version to blame, so we could figure out the root of
> COh> it.
>
> COh> PS: FYI, running build on Windows box / Java 8. Will check on Linux
> shortly (but gut feeling tells me the 15 mins delay
> COh> will be there)
>
> COh> Best Regards,
> COh> Andriy Redko
>
> COh> Sunday, May 6, 2018, 2:42:05 AM, you wrote:
>
> DK>> Hi Andriy,
>
> DK>> thanks for the analysis.
> >>> John, guys, any hints who might help us here? Infra team?
>
> DK>> Could you please open an issue at:
> DK>> https://issues.apache.org/jira/projects/INFRA/
>
> DK>> Cheers
> DK>> Dennis
>
>
>
>
>
>
>
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>
>
Re: Builds on Jenkins
Posted by Andriy Redko <dr...@gmail.com>.
Hey guys,
So here is what I found. I was able to get the thread dump with Apache Maven 3.5.2 and here is the victim:
"DefaultMetadataResolver-1-0" #31 daemon prio=5 os_prio=0 tid=0x000000001a9ae800 nid=0x18bc waiting on condition [0x000000002021e000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.eclipse.aether.connector.basic.PartialFile$LockFile.lock(PartialFile.java:113)
at org.eclipse.aether.connector.basic.PartialFile$LockFile.<init>(PartialFile.java:69)
at org.eclipse.aether.connector.basic.PartialFile$Factory.newInstance(PartialFile.java:278)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector$GetTaskRunner.runTask(BasicRepositoryConnector.java:438)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:360)
at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:75)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:583)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:232)
at org.eclipse.aether.internal.impl.DefaultMetadataResolver$ResolveTask.run(DefaultMetadataResolver.java:593)
at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:75)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Maven stuck on obtaining file lock, in this case for:
Downloading from apache.snapshots: https://repository.apache.org/snapshots/org/apache/cxf/xjcplugins/cxf-xjc-dv/3.2.2-SNAPSHOT/maven-metadata.xml
Downloading from apache.snapshots: https://repository.apache.org/snapshots/org/apache/cxf/xjcplugins/cxf-xjc-dv/3.2.2-SNAPSHOT/maven-metadata.xml
Downloaded from apache.snapshots: https://repository.apache.org/snapshots/org/apache/cxf/xjcplugins/cxf-xjc-dv/3.2.2-SNAPSHOT/maven-metadata.xml (785 B at 2.1 kB/s)
It seems to be related to https://issues.apache.org/jira/browse/MNG-6323 and fixed in Apache Maven 3.5.3. Indeed, I have tried Apache Maven 3.5.3 and the issue is not there anymore, at least for me. It is reproducible 100% (just switching from 3.5.3 back to 3.5.2 and below manifests the problem right away). It is still not clear to me why Colm sees slow builds with 3.5.3, could be another issue?
Regarding Jenkins, I am not able to find what is behind "Maven 3 (latest)" in the tooling, I don't have right permissions. Dennis, John any chance you guys could help to figure it out? Thanks.
Best Regards,
Andriy Redko
Friday, June 8, 2018, 6:58:37 AM, you wrote:
The latest - 3.5.3.
Colm.
On Fri, Jun 8, 2018 at 11:55 AM, Andriy Redko <dr...@gmail.com> wrote:
Hi Colm,
Thanks for confirming, what version of Apache Maven you are using? As a temp workaround,
if you build with Maven 3.2.1 (or I think 3.2.x in general), the issue shouldn't manifest.
Best Regards,
Andriy Redko
Friday, June 8, 2018, 5:14:38 AM, you wrote:
COh> I've also noticed Maven "pausing" recently when downloading SNAPSHOTs on my local machine (ubuntu).
COh> Colm.
COh> On Fri, Jun 8, 2018 at 2:27 AM, Andriy Redko <dr...@gmail.com> wrote:
COh> Hey guys,
COh> Quick update on this. The issue is not resolved, BUT I accidentally reproduced the it on my local box. So I used to
COh> build with `Apache Maven 3.2.1` and have never seen any issues, but recently I run the CXF build with `Apache Maven 3.5.2`,
COh> by accident actually, and ... the same 15 mins delay on snapshot downloads ... !!! 100% of the time, I don't know the cause
COh> yet but I believe this is not an infrastructure problem so I closed
COh> https://issues.apache.org/jira/browse/INFRA-16489 ticket.
COh> I will be looking into this, at least with a goal to pinpoint the Maven version to blame, so we could figure out the root of
COh> it.
COh> PS: FYI, running build on Windows box / Java 8. Will check on Linux shortly (but gut feeling tells me the 15 mins delay
COh> will be there)
COh> Best Regards,
COh> Andriy Redko
COh> Sunday, May 6, 2018, 2:42:05 AM, you wrote:
DK>> Hi Andriy,
DK>> thanks for the analysis.
>>> John, guys, any hints who might help us here? Infra team?
DK>> Could you please open an issue at:
DK>> https://issues.apache.org/jira/projects/INFRA/
DK>> Cheers
DK>> Dennis
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Builds on Jenkins
Posted by Colm O hEigeartaigh <co...@apache.org>.
The latest - 3.5.3.
Colm.
On Fri, Jun 8, 2018 at 11:55 AM, Andriy Redko <dr...@gmail.com> wrote:
> Hi Colm,
>
> Thanks for confirming, what version of Apache Maven you are using? As a
> temp workaround,
> if you build with Maven 3.2.1 (or I think 3.2.x in general), the issue
> shouldn't manifest.
>
> Best Regards,
> Andriy Redko
>
>
> Friday, June 8, 2018, 5:14:38 AM, you wrote:
>
> COh> I've also noticed Maven "pausing" recently when downloading SNAPSHOTs
> on my local machine (ubuntu).
>
>
> COh> Colm.
>
>
> COh> On Fri, Jun 8, 2018 at 2:27 AM, Andriy Redko <dr...@gmail.com>
> wrote:
>
> COh> Hey guys,
>
> COh> Quick update on this. The issue is not resolved, BUT I accidentally
> reproduced the it on my local box. So I used to
> COh> build with `Apache Maven 3.2.1` and have never seen any issues, but
> recently I run the CXF build with `Apache Maven 3.5.2`,
> COh> by accident actually, and ... the same 15 mins delay on snapshot
> downloads ... !!! 100% of the time, I don't know the cause
> COh> yet but I believe this is not an infrastructure problem so I closed
> COh> https://issues.apache.org/jira/browse/INFRA-16489 ticket.
> COh> I will be looking into this, at least with a goal to pinpoint the
> Maven version to blame, so we could figure out the root of
> COh> it.
>
> COh> PS: FYI, running build on Windows box / Java 8. Will check on Linux
> shortly (but gut feeling tells me the 15 mins delay
> COh> will be there)
>
> COh> Best Regards,
> COh> Andriy Redko
>
> COh> Sunday, May 6, 2018, 2:42:05 AM, you wrote:
>
> DK>> Hi Andriy,
>
> DK>> thanks for the analysis.
> >>> John, guys, any hints who might help us here? Infra team?
>
> DK>> Could you please open an issue at:
> DK>> https://issues.apache.org/jira/projects/INFRA/
>
> DK>> Cheers
> DK>> Dennis
>
>
>
>
>
>
>
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Builds on Jenkins
Posted by Andriy Redko <dr...@gmail.com>.
Hi Colm,
Thanks for confirming, what version of Apache Maven you are using? As a temp workaround,
if you build with Maven 3.2.1 (or I think 3.2.x in general), the issue shouldn't manifest.
Best Regards,
Andriy Redko
Friday, June 8, 2018, 5:14:38 AM, you wrote:
COh> I've also noticed Maven "pausing" recently when downloading SNAPSHOTs on my local machine (ubuntu).
COh> Colm.
COh> On Fri, Jun 8, 2018 at 2:27 AM, Andriy Redko <dr...@gmail.com> wrote:
COh> Hey guys,
COh> Quick update on this. The issue is not resolved, BUT I accidentally reproduced the it on my local box. So I used to
COh> build with `Apache Maven 3.2.1` and have never seen any issues, but recently I run the CXF build with `Apache Maven 3.5.2`,
COh> by accident actually, and ... the same 15 mins delay on snapshot downloads ... !!! 100% of the time, I don't know the cause
COh> yet but I believe this is not an infrastructure problem so I closed
COh> https://issues.apache.org/jira/browse/INFRA-16489 ticket.
COh> I will be looking into this, at least with a goal to pinpoint the Maven version to blame, so we could figure out the root of
COh> it.
COh> PS: FYI, running build on Windows box / Java 8. Will check on Linux shortly (but gut feeling tells me the 15 mins delay
COh> will be there)
COh> Best Regards,
COh> Andriy Redko
COh> Sunday, May 6, 2018, 2:42:05 AM, you wrote:
DK>> Hi Andriy,
DK>> thanks for the analysis.
>>> John, guys, any hints who might help us here? Infra team?
DK>> Could you please open an issue at:
DK>> https://issues.apache.org/jira/projects/INFRA/
DK>> Cheers
DK>> Dennis
Re: Builds on Jenkins
Posted by Colm O hEigeartaigh <co...@apache.org>.
I've also noticed Maven "pausing" recently when downloading SNAPSHOTs on my
local machine (ubuntu).
Colm.
On Fri, Jun 8, 2018 at 2:27 AM, Andriy Redko <dr...@gmail.com> wrote:
> Hey guys,
>
> Quick update on this. The issue is not resolved, BUT I accidentally
> reproduced the it on my local box. So I used to
> build with `Apache Maven 3.2.1` and have never seen any issues, but
> recently I run the CXF build with `Apache Maven 3.5.2`,
> by accident actually, and ... the same 15 mins delay on snapshot downloads
> ... !!! 100% of the time, I don't know the cause
> yet but I believe this is not an infrastructure problem so I closed
> https://issues.apache.org/jira/browse/INFRA-16489 ticket.
> I will be looking into this, at least with a goal to pinpoint the Maven
> version to blame, so we could figure out the root of
> it.
>
> PS: FYI, running build on Windows box / Java 8. Will check on Linux
> shortly (but gut feeling tells me the 15 mins delay
> will be there)
>
> Best Regards,
> Andriy Redko
>
> Sunday, May 6, 2018, 2:42:05 AM, you wrote:
>
> DK> Hi Andriy,
>
> DK> thanks for the analysis.
> >> John, guys, any hints who might help us here? Infra team?
>
> DK> Could you please open an issue at:
> DK> https://issues.apache.org/jira/projects/INFRA/
>
> DK> Cheers
> DK> Dennis
>
>
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com