You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@netbeans.apache.org by Michael Bien <mb...@gmail.com> on 2022/11/23 23:30:12 UTC

Re: CI - the final migration (is complete!)

Hello again,

Just do follow up on this thread:

thanks to Svata for finding and fixing an issue in the nb-javac ant 
task, the LSP test can now also run on github CI.

This means all jobs have been migrated!

PR is ready to review:
https://github.com/apache/netbeans/pull/4817


I added also a new feature which might be useful for some:

The ci:dev-build label will produce a NetBeans zip distribution artifact 
for testing purposes if set. The artifact has currently 7 days of 
retention time and can be downloaded from the summary page of the PR 
workflow run.

I don't know at what point storage will become a problem, so use it only 
when its useful for the PR. Artifacts can be also manually removed if 
needed.

best regards,
michael


On 05.11.22 20:28, Svata Dedic wrote:
> Hi,
>
> please temporarily disable the java.lsp.server test in the main suite, 
> I will take the #4921 over next week.
>
> Great job with the migration !
> -Svata
>
>
> On 05. 11. 22 19:18, Michael Bien wrote:
>> Hi devs,
>>
>> at first we weren't sure if we should migrate all travis jobs to 
>> github, then we weren't sure if we actually can without using up all 
>> of apache's resources. Well, those fears/concerns don't matter 
>> anymore since we have to finish migration till the end of this year 
>> when travis support for apache projects ends:
>>
>> https://cwiki.apache.org/confluence/display/INFRA/Travis+Migrations
>>
>>
>> This PR migrates almost all of the remaining jobs to gh actions:
>>
>> https://github.com/apache/netbeans/pull/4817
>>
>> feedback appreciated. Esp if you want to run certain jobs on certain 
>> labels. New label additions are: 'Groovy', 'GraalVM', 'VSCode 
>> Extension' and 'tests'. Other newly migrated jobs either run always 
>> since they don't take much time or were mapped to previously used 
>> labels.
>>
>>
>> One job is missing. It turned out that the LSP job is the final boss 
>> of this endeavor. I tried to replicate the travis environment, bumped 
>> timeouts, incrementally commented out tests, diffed logs between 
>> local runs and gh runs, but the job managed to generate new 
>> exceptions to keep things interesting. Migrating unreliable tests is 
>> extra painful since you never know if that exception you are looking 
>> at is of kind: regular, regular-new, sporadic or sporadic-new :)
>>
>> So I have given up on that one for now until I regain more willpower 
>> for this task.
>>
>> A test setup is here if anyone is interested to take a look (feel 
>> free to push into the PR if you want, its not meant for merging):
>>
>> https://github.com/apache/netbeans/pull/4921
>>
>>
>> best regards,
>>
>> michael
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
>> For additional commands, e-mail: dev-help@netbeans.apache.org
>>
>> For further information about the NetBeans mailing lists, visit:
>> https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
>>
>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
> For additional commands, e-mail: dev-help@netbeans.apache.org
>
> For further information about the NetBeans mailing lists, visit:
> https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
>
>
>


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists




RE: CI - the final migration (is complete!)

Posted by Eric Barboni <sk...@apache.org>.
Many thanks for that,

Eric
-----Message d'origine-----
De : Neil C Smith <ne...@apache.org> 
Envoyé : lundi 5 décembre 2022 14:51
À : Michael Bien <mb...@gmail.com>
Cc : dev@netbeans.apache.org
Objet : Re: CI - the final migration (is complete!)

Hi,

On Mon, 5 Dec 2022 at 07:41, Michael Bien <mb...@gmail.com> wrote:
>
> we lost the ability to restart travis jobs. So we pretty much have to 
> merge this now so that the tests remain still usable.
>
> Planning to merge this today unless someone gives their -1 to this.
> Would be good to get a review with a second set of eyes though.

Replying here so as to be a good citizen and not reply to your notice email! :-)

Just wanted to say a massive thank you for all your work getting this migrated!

And goodbye to Travis - I shall not miss your restart test button one bit.

Best wishes,

Neil

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists





---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists




Re: CI - the final migration (is complete!)

Posted by Neil C Smith <ne...@apache.org>.
Hi,

On Mon, 5 Dec 2022 at 07:41, Michael Bien <mb...@gmail.com> wrote:
>
> we lost the ability to restart travis jobs. So we pretty much have to
> merge this now so that the tests remain still usable.
>
> Planning to merge this today unless someone gives their -1 to this.
> Would be good to get a review with a second set of eyes though.

Replying here so as to be a good citizen and not reply to your notice email! :-)

Just wanted to say a massive thank you for all your work getting this migrated!

And goodbye to Travis - I shall not miss your restart test button one bit.

Best wishes,

Neil

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists




Re: CI - the final migration (is complete!)

Posted by Michael Bien <mb...@gmail.com>.
we lost the ability to restart travis jobs. So we pretty much have to 
merge this now so that the tests remain still usable.

Planning to merge this today unless someone gives their -1 to this. 
Would be good to get a review with a second set of eyes though.

-mbien

On 24.11.22 00:30, Michael Bien wrote:
> Hello again,
>
> Just do follow up on this thread:
>
> thanks to Svata for finding and fixing an issue in the nb-javac ant 
> task, the LSP test can now also run on github CI.
>
> This means all jobs have been migrated!
>
> PR is ready to review:
> https://github.com/apache/netbeans/pull/4817
>
>
> I added also a new feature which might be useful for some:
>
> The ci:dev-build label will produce a NetBeans zip distribution 
> artifact for testing purposes if set. The artifact has currently 7 
> days of retention time and can be downloaded from the summary page of 
> the PR workflow run.
>
> I don't know at what point storage will become a problem, so use it 
> only when its useful for the PR. Artifacts can be also manually 
> removed if needed.
>
> best regards,
> michael
>
>
> On 05.11.22 20:28, Svata Dedic wrote:
>> Hi,
>>
>> please temporarily disable the java.lsp.server test in the main 
>> suite, I will take the #4921 over next week.
>>
>> Great job with the migration !
>> -Svata
>>
>>
>> On 05. 11. 22 19:18, Michael Bien wrote:
>>> Hi devs,
>>>
>>> at first we weren't sure if we should migrate all travis jobs to 
>>> github, then we weren't sure if we actually can without using up all 
>>> of apache's resources. Well, those fears/concerns don't matter 
>>> anymore since we have to finish migration till the end of this year 
>>> when travis support for apache projects ends:
>>>
>>> https://cwiki.apache.org/confluence/display/INFRA/Travis+Migrations
>>>
>>>
>>> This PR migrates almost all of the remaining jobs to gh actions:
>>>
>>> https://github.com/apache/netbeans/pull/4817
>>>
>>> feedback appreciated. Esp if you want to run certain jobs on certain 
>>> labels. New label additions are: 'Groovy', 'GraalVM', 'VSCode 
>>> Extension' and 'tests'. Other newly migrated jobs either run always 
>>> since they don't take much time or were mapped to previously used 
>>> labels.
>>>
>>>
>>> One job is missing. It turned out that the LSP job is the final boss 
>>> of this endeavor. I tried to replicate the travis environment, 
>>> bumped timeouts, incrementally commented out tests, diffed logs 
>>> between local runs and gh runs, but the job managed to generate new 
>>> exceptions to keep things interesting. Migrating unreliable tests is 
>>> extra painful since you never know if that exception you are looking 
>>> at is of kind: regular, regular-new, sporadic or sporadic-new :)
>>>
>>> So I have given up on that one for now until I regain more willpower 
>>> for this task.
>>>
>>> A test setup is here if anyone is interested to take a look (feel 
>>> free to push into the PR if you want, its not meant for merging):
>>>
>>> https://github.com/apache/netbeans/pull/4921
>>>
>>>
>>> best regards,
>>>
>>> michael
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
>>> For additional commands, e-mail: dev-help@netbeans.apache.org
>>>
>>> For further information about the NetBeans mailing lists, visit:
>>> https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
>>>
>>>
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
>> For additional commands, e-mail: dev-help@netbeans.apache.org
>>
>> For further information about the NetBeans mailing lists, visit:
>> https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
>>
>>
>>
>


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org

For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists