You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@royale.apache.org by Yishay Weiss <yi...@hotmail.com> on 2020/04/12 15:09:59 UTC
Prioritize Release Jobs on CI
One thing that bothers me with the CI is that if there are jobs already running or in the queue, it might take a long time to see the results of a release step. I’d like to be able to tell Jenkins to prioritize the release steps and reschedule all running or waiting jobs, which is what this plugin [1] seems to do. Should we install it?
[1] https://plugins.jenkins.io/accelerated-build-now-plugin/
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
I agree with that. It would be nice to have instant feedback, but the issue is more with waiting on the non-release jobs.
From: Alex Harui<ma...@adobe.com.INVALID>
Sent: Sunday, April 12, 2020 9:45 PM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
FWIW, I just looked and the longest job in the release steps so far is 8 minutes. Most are under 2 minutes. There might be jobs later that take longer that we haven't run yet. IMO, the issue isn't speed of the machine, it is just that we are sharing the machine with longer jobs (1 hour for TourDeFlexMigration). And again, the machine will be idle for stretches of time while the RM verifies artifacts after each step.
-Alex
On 4/12/20, 11:32 AM, "Harbs" <ha...@gmail.com> wrote:
Fair enough.
I expect builds to be somewhere between 10 and 20 times faster on a powerful machine.
Yeah. It’s probably going to be a bit of work changing the server, but probably worth it in the long run.
I think I’ll try this when I do the next release unless Yishay wants to work with me on this for this release — but I’m not going to be able to help until after Passover (i.e. next week).
Thanks,
Harbs
> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>
> I think I am reading changes to the build process in your suggestions. I do not really want to spend more of my time on this process. But if you want to do the work, that's fine with me.
>
> -Alex
>
> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <ma...@gmail.com>> wrote:
>
> What kind of horsepower is included in the free Azure account?
>
> The server I mentioned builds (considerably) faster than my own local machine. The ci server seems to build many times slower.
>
> One thing we can do to minimize running server time would be to transfer the artifacts to storage instead of keeping them on the server. On AWS, I’d probably use S3. Not sure what the similar service on Azure is called.
>
>> On Apr 12, 2020, at 8:26 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
>>
>> Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
>>
>> -Alex
>>
>> On 4/12/20, 10:15 AM, "Harbs" <ha...@gmail.com> wrote:
>>
>> My experience is with AWS.
>>
>> I assume Microsoft has similar offerings, but I don’t have experience with Azure.
>>
>> AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
>>
>> Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
>>
>> For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
>>
>> Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
>>
>> I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
>>
>> [1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0><https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0>>
>>
>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>
>>> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>>>
>>> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>>>
>>> -Alex
>>>
>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>>>
>>> I’m willing to do this.
>>>
>>> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>>>
>>> The only complication would be that each RM would need valid credentials to spin up the server.
>>>
>>> Harbs
>>>
>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>>
>>>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Mon, Apr 13, 2020 at 12:50 AM Alex Harui <ah...@adobe.com.invalid>
wrote:
> I don't know much about Azure. I could not figure out how to add a user.
> I have to stop work for tonight. If you have explicit steps I can try
> again tomorrow evening.
>
Alex, it would be easier if we can get into a Zoom call and do a screen
share so I can walk you through it. Let me know when a good time is for
you is?
Thanks,
Om
>
> -Alex
>
> On 4/13/20, 12:34 AM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> You wont have to share your MSDN credentials. You can add me as a
> user in
> your Azure account. I should be able to access it.
>
> I can't do it via RDP because cloning an image is done at the Azure
> level,
> not at the VM level. Something along these lines:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdevblogs.microsoft.com%2Fcse%2F2018%2F02%2F15%2Fcopy-custom-vm-images-on-azure%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=M2xbiNxHbz5D0J2rBY2xwQ6alFnmuHXuU3h0KvS3C3U%3D&reserved=0
>
> Thanks
> Om
>
> On Mon, Apr 13, 2020 at 12:24 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > I don't think I should be giving out my MSDN credentials. If you can
> > install other shell capabilities or access the image via RDP, go for
> it.
> > If there is some secure way to share the image let me know what it
> is. I
> > don't know much about Azure.
> >
> > -Alex
> >
> > On 4/13/20, 12:02 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
> >
> > Related, as most (all?) of the instructions don’t require
> anything but
> > a shell wouldn’t it be easier and faster to access the machine with
> ssh
> > [1], rather than using remote desktop?
> >
> > [1]
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=b6VBmPhRIejL8drAKghDRk1WImwF52ggWOPToj%2FRMhs%3D&reserved=0
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Monday, April 13, 2020 9:55 AM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > Can’t you do that with remote desktop?
> >
> > ________________________________
> > From: OmPrakash Muppirala <bi...@gmail.com>
> > Sent: Monday, April 13, 2020 9:51:25 AM
> > To: Apache Royale Development <de...@royale.apache.org>
> > Subject: Re: Prioritize Release Jobs on CI
> >
> > Alex,
> >
> > I believe this is your personal Azure subscription right? Any
> chance
> > I can
> > get access to it so I can try to copy the image out the machine
> and
> > redeploy it somewhere else?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > bigosmallm@gmail.com>
> > wrote:
> >
> > > I can help set this up on Azure. Give me some time to work
> out the
> > > details?
> > >
> > > Thanks,
> > > Om
> > >
> > > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com>
> wrote:
> > >
> > >> OK. Good to know.
> > >>
> > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> <aharui@adobe.com.INVALID
> > >
> > >> wrote:
> > >> >
> > >> > FWIW, I just looked and the longest job in the release
> steps so
> > far is
> > >> 8 minutes. Most are under 2 minutes. There might be jobs
> later
> > that take
> > >> longer that we haven't run yet. IMO, the issue isn't speed
> of the
> > machine,
> > >> it is just that we are sharing the machine with longer jobs
> (1 hour
> > for
> > >> TourDeFlexMigration). And again, the machine will be idle for
> > stretches of
> > >> time while the RM verifies artifacts after each step.
> > >> >
> > >> > -Alex
> > >> >
> > >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com>> wrote:
> > >> >
> > >> > Fair enough.
> > >> >
> > >> > I expect builds to be somewhere between 10 and 20 times
> faster
> > on a
> > >> powerful machine.
> > >> >
> > >> > Yeah. It’s probably going to be a bit of work changing
> the
> > server,
> > >> but probably worth it in the long run.
> > >> >
> > >> > I think I’ll try this when I do the next release unless
> Yishay
> > wants
> > >> to work with me on this for this release — but I’m not going
> to be
> > able to
> > >> help until after Passover (i.e. next week).
> > >> >
> > >> > Thanks,
> > >> > Harbs
> > >> >
> > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> <aharui@adobe.com.INVALID
> > >
> > >> wrote:
> > >> >>
> > >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB
> memory)
> > >> >>
> > >> >> I think I am reading changes to the build process in your
> > >> suggestions. I do not really want to spend more of my time
> on this
> > >> process. But if you want to do the work, that's fine with me.
> > >> >>
> > >> >> -Alex
> > >> >>
> > >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> > >> harbs.lists@gmail.com>>> wrote:
> > >> >>
> > >> >> What kind of horsepower is included in the free Azure
> account?
> > >> >>
> > >> >> The server I mentioned builds (considerably) faster than
> my own
> > >> local machine. The ci server seems to build many times slower.
> > >> >>
> > >> >> One thing we can do to minimize running server time
> would be to
> > >> transfer the artifacts to storage instead of keeping them on
> the
> > server. On
> > >> AWS, I’d probably use S3. Not sure what the similar service on
> > Azure is
> > >> called.
> > >> >>
> > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > >> <ma...@adobe.com.INVALID>> wrote:
> > >> >>>
> > >> >>> OK, that's pretty much how I understand Azure as well.
> The key
> > thing
> > >> is that "running" includes time where the CI server is not
> running
> > any
> > >> Jenkins jobs. The CI Server steps might take only a few
> hours of
> > actual
> > >> server time, but there is time where the RM is verifying
> artifacts
> > locally
> > >> so you'd be paying for that or the RM would have to keep
> shutting
> > down and
> > >> restarting.
> > >> >>>
> > >> >>> Seems like it would be cheaper/simpler to get the free
> MSDN
> > account
> > >> and leave it running.
> > >> >>>
> > >> >>> -Alex
> > >> >>>
> > >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com>> wrote:
> > >> >>>
> > >> >>> My experience is with AWS.
> > >> >>>
> > >> >>> I assume Microsoft has similar offerings, but I don’t
> have
> > >> experience with Azure.
> > >> >>>
> > >> >>> AWS has on-demand EC2 instances which you pay for only
> the
> > actual
> > >> time that they are running.[1]
> > >> >>>
> > >> >>> Instances can be started and stopped via command line
> (or via
> > the
> > >> web interface) as long as you have valid credentials to do so.
> > >> >>>
> > >> >>> For example: an m5.4xlarge instance has 16 cores and
> costs
> > about
> > >> $1.5 per hour. On a machine like that, a full build would
> probably
> > take
> > >> less than 10 minutes. It’s probably possible to do a full
> release
> > with only
> > >> a few hours of server time.
> > >> >>>
> > >> >>> Leaving a server like that running all the time would get
> > expensive,
> > >> but if it’s just spun up for releases, you’d get very fast
> builds
> > at a
> > >> reasonable price.
> > >> >>>
> > >> >>> I’d be happy to pay $10-$50 (and possibly more) per
> release to
> > make
> > >> the release process painless for the RM.
> > >> >>>
> > >> >>> [1]
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> ><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> >><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> ><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> > >> >>>
> > >> >>>
> > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > <ah...@adobe.com.INVALID>
> > >> wrote:
> > >> >>>>
> > >> >>>> I'm not very experienced with spinning up servers. The
> CI
> > server we
> > >> are using is effectively free, based on a generous donation
> from
> > Microsoft
> > >> of MSDN accounts to ASF committers. So I leave it up 24/7,
> and
> > share the
> > >> RDP access on private@. I think any other ASF committer
> could do
> > the
> > >> same. IIRC, if that server actually is stopped, I have to
> use my
> > personal
> > >> (unshared) MSDN credentials to start it again. AIUI, if I
> > actually paid
> > >> for the server, it would cost me to leave it running even if
> it
> > didn't run
> > >> jobs between releases.
> > >> >>>>
> > >> >>>> Is that what you are basically saying? I think it might
> be
> > best if
> > >> another committer got a CI server going via the MS donation
> and
> > could leave
> > >> it up 24/7.
> > >> >>>>
> > >> >>>> -Alex
> > >> >>>>
> > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com>
> wrote:
> > >> >>>>
> > >> >>>> I’m willing to do this.
> > >> >>>>
> > >> >>>> Considering that the release will be run infrequently, it
> > should be
> > >> doable to have a relatively powerful server that could be
> spun up on
> > >> demand. This is something I have setup for my own releases.
> > >> >>>>
> > >> >>>> The only complication would be that each RM would need
> valid
> > >> credentials to spin up the server.
> > >> >>>>
> > >> >>>> Harbs
> > >> >>>>
> > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > <ah...@adobe.com.INVALID>
> > >> wrote:
> > >> >>>>>
> > >> >>>>> A better solution, IMO, is for someone else to offer up
> a CI
> > server
> > >> only for release jobs.
> > >>
> > >>
> >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
I don't know much about Azure. I could not figure out how to add a user. I have to stop work for tonight. If you have explicit steps I can try again tomorrow evening.
-Alex
On 4/13/20, 12:34 AM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
You wont have to share your MSDN credentials. You can add me as a user in
your Azure account. I should be able to access it.
I can't do it via RDP because cloning an image is done at the Azure level,
not at the VM level. Something along these lines:
https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdevblogs.microsoft.com%2Fcse%2F2018%2F02%2F15%2Fcopy-custom-vm-images-on-azure%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=M2xbiNxHbz5D0J2rBY2xwQ6alFnmuHXuU3h0KvS3C3U%3D&reserved=0
Thanks
Om
On Mon, Apr 13, 2020 at 12:24 AM Alex Harui <ah...@adobe.com.invalid>
wrote:
> I don't think I should be giving out my MSDN credentials. If you can
> install other shell capabilities or access the image via RDP, go for it.
> If there is some secure way to share the image let me know what it is. I
> don't know much about Azure.
>
> -Alex
>
> On 4/13/20, 12:02 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
>
> Related, as most (all?) of the instructions don’t require anything but
> a shell wouldn’t it be easier and faster to access the machine with ssh
> [1], rather than using remote desktop?
>
> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=b6VBmPhRIejL8drAKghDRk1WImwF52ggWOPToj%2FRMhs%3D&reserved=0
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 9:55 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Can’t you do that with remote desktop?
>
> ________________________________
> From: OmPrakash Muppirala <bi...@gmail.com>
> Sent: Monday, April 13, 2020 9:51:25 AM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> Alex,
>
> I believe this is your personal Azure subscription right? Any chance
> I can
> get access to it so I can try to copy the image out the machine and
> redeploy it somewhere else?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > I can help set this up on Azure. Give me some time to work out the
> > details?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
> >
> >> OK. Good to know.
> >>
> >> > On Apr 12, 2020, at 9:45 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >
> >> > FWIW, I just looked and the longest job in the release steps so
> far is
> >> 8 minutes. Most are under 2 minutes. There might be jobs later
> that take
> >> longer that we haven't run yet. IMO, the issue isn't speed of the
> machine,
> >> it is just that we are sharing the machine with longer jobs (1 hour
> for
> >> TourDeFlexMigration). And again, the machine will be idle for
> stretches of
> >> time while the RM verifies artifacts after each step.
> >> >
> >> > -Alex
> >> >
> >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >
> >> > Fair enough.
> >> >
> >> > I expect builds to be somewhere between 10 and 20 times faster
> on a
> >> powerful machine.
> >> >
> >> > Yeah. It’s probably going to be a bit of work changing the
> server,
> >> but probably worth it in the long run.
> >> >
> >> > I think I’ll try this when I do the next release unless Yishay
> wants
> >> to work with me on this for this release — but I’m not going to be
> able to
> >> help until after Passover (i.e. next week).
> >> >
> >> > Thanks,
> >> > Harbs
> >> >
> >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >>
> >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
> >> >>
> >> >> I think I am reading changes to the build process in your
> >> suggestions. I do not really want to spend more of my time on this
> >> process. But if you want to do the work, that's fine with me.
> >> >>
> >> >> -Alex
> >> >>
> >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>>> wrote:
> >> >>
> >> >> What kind of horsepower is included in the free Azure account?
> >> >>
> >> >> The server I mentioned builds (considerably) faster than my own
> >> local machine. The ci server seems to build many times slower.
> >> >>
> >> >> One thing we can do to minimize running server time would be to
> >> transfer the artifacts to storage instead of keeping them on the
> server. On
> >> AWS, I’d probably use S3. Not sure what the similar service on
> Azure is
> >> called.
> >> >>
> >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> <aharui@adobe.com.INVALID
> >> <ma...@adobe.com.INVALID>> wrote:
> >> >>>
> >> >>> OK, that's pretty much how I understand Azure as well. The key
> thing
> >> is that "running" includes time where the CI server is not running
> any
> >> Jenkins jobs. The CI Server steps might take only a few hours of
> actual
> >> server time, but there is time where the RM is verifying artifacts
> locally
> >> so you'd be paying for that or the RM would have to keep shutting
> down and
> >> restarting.
> >> >>>
> >> >>> Seems like it would be cheaper/simpler to get the free MSDN
> account
> >> and leave it running.
> >> >>>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >>>
> >> >>> My experience is with AWS.
> >> >>>
> >> >>> I assume Microsoft has similar offerings, but I don’t have
> >> experience with Azure.
> >> >>>
> >> >>> AWS has on-demand EC2 instances which you pay for only the
> actual
> >> time that they are running.[1]
> >> >>>
> >> >>> Instances can be started and stopped via command line (or via
> the
> >> web interface) as long as you have valid credentials to do so.
> >> >>>
> >> >>> For example: an m5.4xlarge instance has 16 cores and costs
> about
> >> $1.5 per hour. On a machine like that, a full build would probably
> take
> >> less than 10 minutes. It’s probably possible to do a full release
> with only
> >> a few hours of server time.
> >> >>>
> >> >>> Leaving a server like that running all the time would get
> expensive,
> >> but if it’s just spun up for releases, you’d get very fast builds
> at a
> >> reasonable price.
> >> >>>
> >> >>> I’d be happy to pay $10-$50 (and possibly more) per release to
> make
> >> the release process painless for the RM.
> >> >>>
> >> >>> [1]
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> >><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C6c33510f76c540c71e7d08d7df7d20c8%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223600824819846&sdata=%2FGw0NHmn%2FI315grS977HijKy%2FDTIpyFqQblRS6Jca5M%3D&reserved=0
> >> >>>
> >> >>>
> >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>
> >> >>>> I'm not very experienced with spinning up servers. The CI
> server we
> >> are using is effectively free, based on a generous donation from
> Microsoft
> >> of MSDN accounts to ASF committers. So I leave it up 24/7, and
> share the
> >> RDP access on private@. I think any other ASF committer could do
> the
> >> same. IIRC, if that server actually is stopped, I have to use my
> personal
> >> (unshared) MSDN credentials to start it again. AIUI, if I
> actually paid
> >> for the server, it would cost me to leave it running even if it
> didn't run
> >> jobs between releases.
> >> >>>>
> >> >>>> Is that what you are basically saying? I think it might be
> best if
> >> another committer got a CI server going via the MS donation and
> could leave
> >> it up 24/7.
> >> >>>>
> >> >>>> -Alex
> >> >>>>
> >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
> >> >>>>
> >> >>>> I’m willing to do this.
> >> >>>>
> >> >>>> Considering that the release will be run infrequently, it
> should be
> >> doable to have a relatively powerful server that could be spun up on
> >> demand. This is something I have setup for my own releases.
> >> >>>>
> >> >>>> The only complication would be that each RM would need valid
> >> credentials to spin up the server.
> >> >>>>
> >> >>>> Harbs
> >> >>>>
> >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>>
> >> >>>>> A better solution, IMO, is for someone else to offer up a CI
> server
> >> only for release jobs.
> >>
> >>
>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
You wont have to share your MSDN credentials. You can add me as a user in
your Azure account. I should be able to access it.
I can't do it via RDP because cloning an image is done at the Azure level,
not at the VM level. Something along these lines:
https://devblogs.microsoft.com/cse/2018/02/15/copy-custom-vm-images-on-azure/
Thanks
Om
On Mon, Apr 13, 2020 at 12:24 AM Alex Harui <ah...@adobe.com.invalid>
wrote:
> I don't think I should be giving out my MSDN credentials. If you can
> install other shell capabilities or access the image via RDP, go for it.
> If there is some secure way to share the image let me know what it is. I
> don't know much about Azure.
>
> -Alex
>
> On 4/13/20, 12:02 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
>
> Related, as most (all?) of the instructions don’t require anything but
> a shell wouldn’t it be easier and faster to access the machine with ssh
> [1], rather than using remote desktop?
>
> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=sC9JtN12VWCQ7PgzeyWNpn8NlwO1jdDaHbdfuwVjwo0%3D&reserved=0
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 9:55 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Can’t you do that with remote desktop?
>
> ________________________________
> From: OmPrakash Muppirala <bi...@gmail.com>
> Sent: Monday, April 13, 2020 9:51:25 AM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> Alex,
>
> I believe this is your personal Azure subscription right? Any chance
> I can
> get access to it so I can try to copy the image out the machine and
> redeploy it somewhere else?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > I can help set this up on Azure. Give me some time to work out the
> > details?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
> >
> >> OK. Good to know.
> >>
> >> > On Apr 12, 2020, at 9:45 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >
> >> > FWIW, I just looked and the longest job in the release steps so
> far is
> >> 8 minutes. Most are under 2 minutes. There might be jobs later
> that take
> >> longer that we haven't run yet. IMO, the issue isn't speed of the
> machine,
> >> it is just that we are sharing the machine with longer jobs (1 hour
> for
> >> TourDeFlexMigration). And again, the machine will be idle for
> stretches of
> >> time while the RM verifies artifacts after each step.
> >> >
> >> > -Alex
> >> >
> >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >
> >> > Fair enough.
> >> >
> >> > I expect builds to be somewhere between 10 and 20 times faster
> on a
> >> powerful machine.
> >> >
> >> > Yeah. It’s probably going to be a bit of work changing the
> server,
> >> but probably worth it in the long run.
> >> >
> >> > I think I’ll try this when I do the next release unless Yishay
> wants
> >> to work with me on this for this release — but I’m not going to be
> able to
> >> help until after Passover (i.e. next week).
> >> >
> >> > Thanks,
> >> > Harbs
> >> >
> >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >>
> >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
> >> >>
> >> >> I think I am reading changes to the build process in your
> >> suggestions. I do not really want to spend more of my time on this
> >> process. But if you want to do the work, that's fine with me.
> >> >>
> >> >> -Alex
> >> >>
> >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>>> wrote:
> >> >>
> >> >> What kind of horsepower is included in the free Azure account?
> >> >>
> >> >> The server I mentioned builds (considerably) faster than my own
> >> local machine. The ci server seems to build many times slower.
> >> >>
> >> >> One thing we can do to minimize running server time would be to
> >> transfer the artifacts to storage instead of keeping them on the
> server. On
> >> AWS, I’d probably use S3. Not sure what the similar service on
> Azure is
> >> called.
> >> >>
> >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> <aharui@adobe.com.INVALID
> >> <ma...@adobe.com.INVALID>> wrote:
> >> >>>
> >> >>> OK, that's pretty much how I understand Azure as well. The key
> thing
> >> is that "running" includes time where the CI server is not running
> any
> >> Jenkins jobs. The CI Server steps might take only a few hours of
> actual
> >> server time, but there is time where the RM is verifying artifacts
> locally
> >> so you'd be paying for that or the RM would have to keep shutting
> down and
> >> restarting.
> >> >>>
> >> >>> Seems like it would be cheaper/simpler to get the free MSDN
> account
> >> and leave it running.
> >> >>>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >>>
> >> >>> My experience is with AWS.
> >> >>>
> >> >>> I assume Microsoft has similar offerings, but I don’t have
> >> experience with Azure.
> >> >>>
> >> >>> AWS has on-demand EC2 instances which you pay for only the
> actual
> >> time that they are running.[1]
> >> >>>
> >> >>> Instances can be started and stopped via command line (or via
> the
> >> web interface) as long as you have valid credentials to do so.
> >> >>>
> >> >>> For example: an m5.4xlarge instance has 16 cores and costs
> about
> >> $1.5 per hour. On a machine like that, a full build would probably
> take
> >> less than 10 minutes. It’s probably possible to do a full release
> with only
> >> a few hours of server time.
> >> >>>
> >> >>> Leaving a server like that running all the time would get
> expensive,
> >> but if it’s just spun up for releases, you’d get very fast builds
> at a
> >> reasonable price.
> >> >>>
> >> >>> I’d be happy to pay $10-$50 (and possibly more) per release to
> make
> >> the release process painless for the RM.
> >> >>>
> >> >>> [1]
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
> >> >><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
> >> >>>
> >> >>>
> >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>
> >> >>>> I'm not very experienced with spinning up servers. The CI
> server we
> >> are using is effectively free, based on a generous donation from
> Microsoft
> >> of MSDN accounts to ASF committers. So I leave it up 24/7, and
> share the
> >> RDP access on private@. I think any other ASF committer could do
> the
> >> same. IIRC, if that server actually is stopped, I have to use my
> personal
> >> (unshared) MSDN credentials to start it again. AIUI, if I
> actually paid
> >> for the server, it would cost me to leave it running even if it
> didn't run
> >> jobs between releases.
> >> >>>>
> >> >>>> Is that what you are basically saying? I think it might be
> best if
> >> another committer got a CI server going via the MS donation and
> could leave
> >> it up 24/7.
> >> >>>>
> >> >>>> -Alex
> >> >>>>
> >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
> >> >>>>
> >> >>>> I’m willing to do this.
> >> >>>>
> >> >>>> Considering that the release will be run infrequently, it
> should be
> >> doable to have a relatively powerful server that could be spun up on
> >> demand. This is something I have setup for my own releases.
> >> >>>>
> >> >>>> The only complication would be that each RM would need valid
> >> credentials to spin up the server.
> >> >>>>
> >> >>>> Harbs
> >> >>>>
> >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>>
> >> >>>>> A better solution, IMO, is for someone else to offer up a CI
> server
> >> only for release jobs.
> >>
> >>
>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
I don't think I should be giving out my MSDN credentials. If you can install other shell capabilities or access the image via RDP, go for it. If there is some secure way to share the image let me know what it is. I don't know much about Azure.
-Alex
On 4/13/20, 12:02 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
Related, as most (all?) of the instructions don’t require anything but a shell wouldn’t it be easier and faster to access the machine with ssh [1], rather than using remote desktop?
[1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=sC9JtN12VWCQ7PgzeyWNpn8NlwO1jdDaHbdfuwVjwo0%3D&reserved=0
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 9:55 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Can’t you do that with remote desktop?
________________________________
From: OmPrakash Muppirala <bi...@gmail.com>
Sent: Monday, April 13, 2020 9:51:25 AM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303726403&sdata=EyaZ2qgR4pX3JWE5YFr6Ze38L53aPT5VRNMW5pPpLxw%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd6686c50bc5a47593a2c08d7df78952a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223581303736397&sdata=DqPTaehUf%2BOiwMfu9jJ%2B6ftsInmiyYYccO6bRT%2BzYTs%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Sun, Apr 19, 2020 at 10:05 PM serkan <se...@likyateknoloji.com> wrote:
> It should be related with the shell which ant is executed in.
>
> It seems like you should set PATH for that shell.
>
Thanks for the reply!
I'm not sure how I would do that?
>
>
> 20.04.2020 07:36 tarihinde OmPrakash Muppirala yazdı:
>
> I'm a bit stumped here. The royale-compiler is failing with this error:
>
>
> BUILD FAILEDc:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed: java.io.IOException: Cannot run program "git" (in directory "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The system cannot find the file specified
> at java.lang.ProcessBuilder.start(Unknown Source)
>
> It is from this part of the jenkins.xml:
>
>
> <target name="closure-lib-download" description="Copies Closure
> Library from GitHub">
> <echo message="Be patient. This takes a few minutes..." />
> <exec executable="git" failifexecutionfails="true">
> <arg value="clone" />
> <arg value="https://github.com/google/closure-library" />
> <arg value="${closure.root}" />
> </exec>
> <echo>Cloned fresh copy of Google Closure Library</echo>
> </target>
>
> I am not sure how this executable call works without the full path.
>
> I checked the env variables, I do have both the git/bin and git/cmd
> directory in the PATH:
>
> [image: image.png]
>
> What am I missing?
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <bi...@gmail.com>
> wrote:
>
>> Update - I have successfully attached my VM as a slave agent of our
>> Jenkins instance.
>> I am going to pull the job - /royale-asjs_jsonly and tie it to my agent
>> so I can test it.
>>
>> It will fail for a sometime while I go set up my VM with all the
>> dependencies.
>>
>> Once we have the job successfully building on my VM, we can figure out
>> how to divide the load between the master and agent.
>>
>> Thanks,
>> Om
>>
>> On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <bi...@gmail.com>
>> wrote:
>>
>>> We could achieve the same by creating a new agent (separate vm) and
>>> attaching it as a slave to the current Jenkins server.
>>>
>>> Then we can use labels/tags to tie release jobs to one agent and non
>>> release jobs to another agent.
>>>
>>> That way we can maintain everything in one UI, one login while achieving
>>> the concurrent building capabilities we want.
>>>
>>> Jenkins is built for this kind of stuff and I think it would be best we
>>> followed this practice.
>>>
>>> Thanks,
>>> Om
>>>
>>> On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid>
>>> <ah...@adobe.com.invalid> wrote:
>>>
>>>> Om, I thought you were going to get the image from my VM and run it on
>>>> another VM. Then we'd remove all non-release jobs from your VM and all of
>>>> the release jobs from my VM. That won't solve the problem of how long it
>>>> takes for a commit to be built and tested, but will allow the RM to get a
>>>> release out without getting stuck behind the commit jobs. Is that
>>>> currently the plan?
>>>>
>>>> -Alex
>>>>
>>>> On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bi...@gmail.com>
>>>> wrote:
>>>>
>>>> Makes sense to me. I will set parallel executors back to 1.
>>>>
>>>> And start working on a new Jenkins instance.
>>>>
>>>> Thanks,
>>>> Om
>>>>
>>>>
>>>> On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>>>> <ah...@adobe.com.invalid> <ah...@adobe.com.invalid> wrote:
>>>>
>>>> > Are you saying that Java, Ant and Maven do not know how to
>>>> distribute work
>>>> > to different cores?
>>>> >
>>>> > To repeat my main concern: our Jenkins jobs often use shared
>>>> resources.
>>>> > If you want to take the time to fix that, feel free, but I do not
>>>> know how
>>>> > you are going to keep two jobs from both trying to launch Flash
>>>> Player
>>>> > Debugger at the same time and open the same socket to communicate
>>>> with it,
>>>> > or try to parse the flashlog.txt that they have both written to.
>>>> >
>>>> > The royale-asjs job will use the royale-compiler workspace to get
>>>> the
>>>> > compiler. If the compiler is building, the jars are not there
>>>> and the
>>>> > royale-asjs build fails.
>>>> >
>>>> > There is also only so much memory and some of our jobs use all of
>>>> it and
>>>> > I'm not sure if jobs slowed down due to paging memory and
>>>> writing/reading
>>>> > from disk, even if it is an SSD.
>>>> >
>>>> > I'm done for tonight, but that's what I was seeing last time I
>>>> tried to
>>>> > have both master and an agent running jobs in parallel.
>>>> >
>>>> > Thanks,
>>>> > -Alex
>>>> >
>>>> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>>>> wrote:
>>>> >
>>>> > A typical setup would be to have 0 executors on master and at
>>>> least n
>>>> > number of executors on each agent, where n = number of cpu
>>>> cores.
>>>> > I see that the current VM has 2 cores. So, I started with
>>>> setting the
>>>> > num
>>>> > executors on the current agent to 2.
>>>> >
>>>> > This should improve things quite a bit. If this doesn't
>>>> work, I will
>>>> > create a new VM and make it the slave agent of the current
>>>> Jenkins
>>>> > master.
>>>> >
>>>> >
>>>> > Thanks,
>>>> > Om
>>>> >
>>>> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>>>> <ah...@adobe.com.invalid> <ah...@adobe.com.invalid>
>>>> > wrote:
>>>> >
>>>> > > On your VM or mine? I don't think mine can handle it. I
>>>> used to
>>>> > run jobs
>>>> > > of master and agent and we got lots of failures and jobs
>>>> took
>>>> > forever. If
>>>> > > two jobs are trying to run tests with the shared Flash
>>>> Player
>>>> > Debugger, for
>>>> > > example, you won't get consistent results.
>>>> > >
>>>> > > -Alex
>>>> > >
>>>> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>>>> bigosmallm@gmail.com>
>>>> > wrote:
>>>> > >
>>>> > > I just realized that we have only one Agent (node)
>>>> listed under
>>>> > > Jenkins. I
>>>> > > am going to add at least one more node to start with.
>>>> > >
>>>> > > Thanks,
>>>> > > Om
>>>> > >
>>>> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>>>> > <ah...@adobe.com.invalid> <ah...@adobe.com.invalid>
>>>> > > wrote:
>>>> > >
>>>> > > > I think I followed the instructions and enabled SSH.
>>>> > > >
>>>> > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>>>> yishayjobs@hotmail.com>
>>>> > wrote:
>>>> > > >
>>>> > > > I haven’t gotten it to work. Could be ssh needs
>>>> to be
>>>> > enabled on
>>>> > > the
>>>> > > > VM [1]. This is nice to have but not essential. So
>>>> Alex, let
>>>> > me know
>>>> > > if you
>>>> > > > want to try that, otherwise I’ll suspend my efforts
>>>> on this.
>>>> > > >
>>>> > > > [1]
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
>>>> > > >
>>>> > > > From: Yishay Weiss<ma...@hotmail.com>
>>>> > > > Sent: Wednesday, April 15, 2020 5:09 PM
>>>> > > > To: dev@royale.apache.org<mailto:
>>>> dev@royale.apache.org>
>>>> > > > Subject: RE: Prioritize Release Jobs on CI
>>>> > > >
>>>> > > > I’d like to try and install an ssh server. Can
>>>> anyone
>>>> > think of a
>>>> > > > reason not to do that? I’m asking in terms of
>>>> security, and if
>>>> > there
>>>> > > might
>>>> > > > be a problem because it’s a VM.
>>>> > > >
>>>> > > > Thanks.
>>>> > > >
>>>> > > > From: Yishay Weiss<ma...@hotmail.com>
>>>> > > > Sent: Monday, April 13, 2020 10:02 AM
>>>> > > > To: dev@royale.apache.org<mailto:
>>>> dev@royale.apache.org>
>>>> > > > Subject: RE: Prioritize Release Jobs on CI
>>>> > > >
>>>> > > > Related, as most (all?) of the instructions don’t
>>>> require
>>>> > > anything but
>>>> > > > a shell wouldn’t it be easier and faster to access
>>>> the machine
>>>> > with
>>>> > > ssh
>>>> > > > [1], rather than using remote desktop?
>>>> > > >
>>>> > > > [1]
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
>>>> > > >
>>>> > > > From: Yishay Weiss<ma...@hotmail.com>
>>>> > > > Sent: Monday, April 13, 2020 9:55 AM
>>>> > > > To: dev@royale.apache.org<mailto:
>>>> dev@royale.apache.org>
>>>> > > > Subject: RE: Prioritize Release Jobs on CI
>>>> > > >
>>>> > > > Can’t you do that with remote desktop?
>>>> > > >
>>>> > > > ________________________________
>>>> > > > From: OmPrakash Muppirala <bi...@gmail.com>
>>>> > > > Sent: Monday, April 13, 2020 9:51:25 AM
>>>> > > > To: Apache Royale Development <
>>>> dev@royale.apache.org>
>>>> > > > Subject: Re: Prioritize Release Jobs on CI
>>>> > > >
>>>> > > > Alex,
>>>> > > >
>>>> > > > I believe this is your personal Azure
>>>> subscription right?
>>>> > Any
>>>> > > chance
>>>> > > > I can
>>>> > > > get access to it so I can try to copy the image
>>>> out the
>>>> > machine
>>>> > > and
>>>> > > > redeploy it somewhere else?
>>>> > > >
>>>> > > > Thanks,
>>>> > > > Om
>>>> > > >
>>>> > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash
>>>> Muppirala <
>>>> > > > bigosmallm@gmail.com>
>>>> > > > wrote:
>>>> > > >
>>>> > > > > I can help set this up on Azure. Give me some
>>>> time to
>>>> > work
>>>> > > out the
>>>> > > > > details?
>>>> > > > >
>>>> > > > > Thanks,
>>>> > > > > Om
>>>> > > > >
>>>> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
>>>> > harbs.lists@gmail.com>
>>>> > > wrote:
>>>> > > > >
>>>> > > > >> OK. Good to know.
>>>> > > > >>
>>>> > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
>>>> > > <aharui@adobe.com.INVALID
>>>> > > > >
>>>> > > > >> wrote:
>>>> > > > >> >
>>>> > > > >> > FWIW, I just looked and the longest job in
>>>> the release
>>>> > > steps so
>>>> > > > far is
>>>> > > > >> 8 minutes. Most are under 2 minutes. There
>>>> might be
>>>> > jobs
>>>> > > later
>>>> > > > that take
>>>> > > > >> longer that we haven't run yet. IMO, the
>>>> issue isn't
>>>> > speed
>>>> > > of the
>>>> > > > machine,
>>>> > > > >> it is just that we are sharing the machine
>>>> with longer
>>>> > jobs
>>>> > > (1 hour
>>>> > > > for
>>>> > > > >> TourDeFlexMigration). And again, the machine
>>>> will be
>>>> > idle for
>>>> > > > stretches of
>>>> > > > >> time while the RM verifies artifacts after
>>>> each step.
>>>> > > > >> >
>>>> > > > >> > -Alex
>>>> > > > >> >
>>>> > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>>>> harbs.lists@gmail.com
>>>> > > <mailto:
>>>> > > > >> harbs.lists@gmail.com>> wrote:
>>>> > > > >> >
>>>> > > > >> > Fair enough.
>>>> > > > >> >
>>>> > > > >> > I expect builds to be somewhere between
>>>> 10 and 20
>>>> > times
>>>> > > faster
>>>> > > > on a
>>>> > > > >> powerful machine.
>>>> > > > >> >
>>>> > > > >> > Yeah. It’s probably going to be a bit of
>>>> work
>>>> > changing
>>>> > > the
>>>> > > > server,
>>>> > > > >> but probably worth it in the long run.
>>>> > > > >> >
>>>> > > > >> > I think I’ll try this when I do the next
>>>> release
>>>> > unless
>>>> > > Yishay
>>>> > > > wants
>>>> > > > >> to work with me on this for this release — but
>>>> I’m not
>>>> > going
>>>> > > to be
>>>> > > > able to
>>>> > > > >> help until after Passover (i.e. next week).
>>>> > > > >> >
>>>> > > > >> > Thanks,
>>>> > > > >> > Harbs
>>>> > > > >> >
>>>> > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
>>>> > > <aharui@adobe.com.INVALID
>>>> > > > >
>>>> > > > >> wrote:
>>>> > > > >> >>
>>>> > > > >> >> The Azure portal says: Standard F2s_v2 (2
>>>> vcpus, 4
>>>> > GiB
>>>> > > memory)
>>>> > > > >> >>
>>>> > > > >> >> I think I am reading changes to the build
>>>> process in
>>>> > your
>>>> > > > >> suggestions. I do not really want to spend
>>>> more of my
>>>> > time
>>>> > > on this
>>>> > > > >> process. But if you want to do the work,
>>>> that's fine
>>>> > with me.
>>>> > > > >> >>
>>>> > > > >> >> -Alex
>>>> > > > >> >>
>>>> > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>>>> harbs.lists@gmail.com
>>>> > > <mailto:
>>>> > > > >> harbs.lists@gmail.com> <mailto:
>>>> harbs.lists@gmail.com
>>>> > <mailto:
>>>> > > > >> harbs.lists@gmail.com>>> wrote:
>>>> > > > >> >>
>>>> > > > >> >> What kind of horsepower is included in
>>>> the free
>>>> > Azure
>>>> > > account?
>>>> > > > >> >>
>>>> > > > >> >> The server I mentioned builds
>>>> (considerably)
>>>> > faster than
>>>> > > my own
>>>> > > > >> local machine. The ci server seems to build
>>>> many times
>>>> > slower.
>>>> > > > >> >>
>>>> > > > >> >> One thing we can do to minimize running
>>>> server time
>>>> > > would be to
>>>> > > > >> transfer the artifacts to storage instead of
>>>> keeping
>>>> > them on
>>>> > > the
>>>> > > > server. On
>>>> > > > >> AWS, I’d probably use S3. Not sure what the
>>>> similar
>>>> > service on
>>>> > > > Azure is
>>>> > > > >> called.
>>>> > > > >> >>
>>>> > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
>>>> > > > <aharui@adobe.com.INVALID
>>>> > > > >> <ma...@adobe.com.INVALID>> wrote:
>>>> > > > >> >>>
>>>> > > > >> >>> OK, that's pretty much how I understand
>>>> Azure as
>>>> > well.
>>>> > > The key
>>>> > > > thing
>>>> > > > >> is that "running" includes time where the CI
>>>> server is
>>>> > not
>>>> > > running
>>>> > > > any
>>>> > > > >> Jenkins jobs. The CI Server steps might take
>>>> only a few
>>>> > > hours of
>>>> > > > actual
>>>> > > > >> server time, but there is time where the RM is
>>>> verifying
>>>> > > artifacts
>>>> > > > locally
>>>> > > > >> so you'd be paying for that or the RM would
>>>> have to keep
>>>> > > shutting
>>>> > > > down and
>>>> > > > >> restarting.
>>>> > > > >> >>>
>>>> > > > >> >>> Seems like it would be cheaper/simpler to
>>>> get the
>>>> > free
>>>> > > MSDN
>>>> > > > account
>>>> > > > >> and leave it running.
>>>> > > > >> >>>
>>>> > > > >> >>> -Alex
>>>> > > > >> >>>
>>>> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>>>> > harbs.lists@gmail.com
>>>> > > <mailto:
>>>> > > > >> harbs.lists@gmail.com>> wrote:
>>>> > > > >> >>>
>>>> > > > >> >>> My experience is with AWS.
>>>> > > > >> >>>
>>>> > > > >> >>> I assume Microsoft has similar offerings,
>>>> but I
>>>> > don’t
>>>> > > have
>>>> > > > >> experience with Azure.
>>>> > > > >> >>>
>>>> > > > >> >>> AWS has on-demand EC2 instances which you
>>>> pay for
>>>> > only
>>>> > > the
>>>> > > > actual
>>>> > > > >> time that they are running.[1]
>>>> > > > >> >>>
>>>> > > > >> >>> Instances can be started and stopped via
>>>> command
>>>> > line
>>>> > > (or via
>>>> > > > the
>>>> > > > >> web interface) as long as you have valid
>>>> credentials to
>>>> > do so.
>>>> > > > >> >>>
>>>> > > > >> >>> For example: an m5.4xlarge instance has
>>>> 16 cores
>>>> > and
>>>> > > costs
>>>> > > > about
>>>> > > > >> $1.5 per hour. On a machine like that, a full
>>>> build
>>>> > would
>>>> > > probably
>>>> > > > take
>>>> > > > >> less than 10 minutes. It’s probably possible
>>>> to do a
>>>> > full
>>>> > > release
>>>> > > > with only
>>>> > > > >> a few hours of server time.
>>>> > > > >> >>>
>>>> > > > >> >>> Leaving a server like that running all
>>>> the time
>>>> > would get
>>>> > > > expensive,
>>>> > > > >> but if it’s just spun up for releases, you’d
>>>> get very
>>>> > fast
>>>> > > builds
>>>> > > > at a
>>>> > > > >> reasonable price.
>>>> > > > >> >>>
>>>> > > > >> >>> I’d be happy to pay $10-$50 (and possibly
>>>> more) per
>>>> > > release to
>>>> > > > make
>>>> > > > >> the release process painless for the RM.
>>>> > > > >> >>>
>>>> > > > >> >>> [1]
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>>> > > > >> <
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>>> > > > >> ><
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>>> > > > >> <
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>>> > > > >> >><
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>>> > > > >> <
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>>>> > > > >> ><
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>>>> > > > >> <
>>>> > > > >>
>>>> > > >
>>>> > >
>>>> >
>>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>>>> > > > >> >>>
>>>> > > > >> >>>
>>>> > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
>>>> > > > <ah...@adobe.com.INVALID> <ah...@adobe.com.INVALID>
>>>> > > > >> wrote:
>>>> > > > >> >>>>
>>>> > > > >> >>>> I'm not very experienced with spinning up
>>>> > servers. The
>>>> > > CI
>>>> > > > server we
>>>> > > > >> are using is effectively free, based on a
>>>> generous
>>>> > donation
>>>> > > from
>>>> > > > Microsoft
>>>> > > > >> of MSDN accounts to ASF committers. So I
>>>> leave it up
>>>> > 24/7,
>>>> > > and
>>>> > > > share the
>>>> > > > >> RDP access on private@. I think any other ASF
>>>> > committer
>>>> > > could do
>>>> > > > the
>>>> > > > >> same. IIRC, if that server actually is
>>>> stopped, I have
>>>> > to
>>>> > > use my
>>>> > > > personal
>>>> > > > >> (unshared) MSDN credentials to start it
>>>> again. AIUI,
>>>> > if I
>>>> > > > actually paid
>>>> > > > >> for the server, it would cost me to leave it
>>>> running
>>>> > even if
>>>> > > it
>>>> > > > didn't run
>>>> > > > >> jobs between releases.
>>>> > > > >> >>>>
>>>> > > > >> >>>> Is that what you are basically saying? I
>>>> think it
>>>> > might
>>>> > > be
>>>> > > > best if
>>>> > > > >> another committer got a CI server going via
>>>> the MS
>>>> > donation
>>>> > > and
>>>> > > > could leave
>>>> > > > >> it up 24/7.
>>>> > > > >> >>>>
>>>> > > > >> >>>> -Alex
>>>> > > > >> >>>>
>>>> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>>>> > harbs.lists@gmail.com>
>>>> > > wrote:
>>>> > > > >> >>>>
>>>> > > > >> >>>> I’m willing to do this.
>>>> > > > >> >>>>
>>>> > > > >> >>>> Considering that the release will be run
>>>> > infrequently, it
>>>> > > > should be
>>>> > > > >> doable to have a relatively powerful server
>>>> that could
>>>> > be
>>>> > > spun up on
>>>> > > > >> demand. This is something I have setup for my
>>>> own
>>>> > releases.
>>>> > > > >> >>>>
>>>> > > > >> >>>> The only complication would be that each
>>>> RM would
>>>> > need
>>>> > > valid
>>>> > > > >> credentials to spin up the server.
>>>> > > > >> >>>>
>>>> > > > >> >>>> Harbs
>>>> > > > >> >>>>
>>>> > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
>>>> > > > <ah...@adobe.com.INVALID> <ah...@adobe.com.INVALID>
>>>> > > > >> wrote:
>>>> > > > >> >>>>>
>>>> > > > >> >>>>> A better solution, IMO, is for someone
>>>> else to
>>>> > offer up
>>>> > > a CI
>>>> > > > server
>>>> > > > >> only for release jobs.
>>>> > > > >>
>>>> > > > >>
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > > >
>>>> > >
>>>> > >
>>>> > >
>>>> >
>>>> >
>>>> >
>>>>
>>>>
>>>>
>
Re: Prioritize Release Jobs on CI
Posted by serkan <se...@likyateknoloji.com>.
It should be related with the shell which ant is executed in.
It seems like you should set PATH for that shell.
20.04.2020 07:36 tarihinde OmPrakash Muppirala yazdı:
> I'm a bit stumped here. The royale-compiler is failing with this error:
>
> BUILD FAILED c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed: java.io.IOException: Cannot run program "git" (in directory "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The system cannot find the file specified
> at java.lang.ProcessBuilder.start(Unknown Source)
> It is from this part of the jenkins.xml:
>
>
> <target name="closure-lib-download" description="Copies Closure
> Library from GitHub">
> <echo message="Be patient. This takes a few minutes..." />
> <exec executable="git" failifexecutionfails="true">
> <arg value="clone" />
> <arg value="https://github.com/google/closure-library" />
> <arg value="${closure.root}" />
> </exec>
> <echo>Cloned fresh copy of Google Closure Library</echo>
> </target>
>
> I am not sure how this executable call works without the full path.
>
> I checked the env variables, I do have both the git/bin and git/cmd
> directory in the PATH:
>
> image.png
>
> What am I missing?
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala
> <bigosmallm@gmail.com <ma...@gmail.com>> wrote:
>
> Update - I have successfully attached my VM as a slave agent of
> our Jenkins instance.
> I am going to pull the job - /royale-asjs_jsonly and tie it to my
> agent so I can test it.
>
> It will fail for a sometime while I go set up my VM with all the
> dependencies.
>
> Once we have the job successfully building on my VM, we can figure
> out how to divide the load between the master and agent.
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala
> <bigosmallm@gmail.com <ma...@gmail.com>> wrote:
>
> We could achieve the same by creating a new agent (separate
> vm) and attaching it as a slave to the current Jenkins server.
>
> Then we can use labels/tags to tie release jobs to one agent
> and non release jobs to another agent.
>
> That way we can maintain everything in one UI, one login while
> achieving the concurrent building capabilities we want.
>
> Jenkins is built for this kind of stuff and I think it would
> be best we followed this practice.
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> <ah...@adobe.com.invalid> wrote:
>
> Om, I thought you were going to get the image from my VM
> and run it on another VM. Then we'd remove all
> non-release jobs from your VM and all of the release jobs
> from my VM. That won't solve the problem of how long it
> takes for a commit to be built and tested, but will allow
> the RM to get a release out without getting stuck behind
> the commit jobs. Is that currently the plan?
>
> -Alex
>
> On 4/18/20, 12:43 AM, "OmPrakash Muppirala"
> <bigosmallm@gmail.com <ma...@gmail.com>> wrote:
>
> Makes sense to me. I will set parallel executors back
> to 1.
>
> And start working on a new Jenkins instance.
>
> Thanks,
> Om
>
>
> On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> <ah...@adobe.com.invalid> wrote:
>
> > Are you saying that Java, Ant and Maven do not know
> how to distribute work
> > to different cores?
> >
> > To repeat my main concern: our Jenkins jobs often
> use shared resources.
> > If you want to take the time to fix that, feel free,
> but I do not know how
> > you are going to keep two jobs from both trying to
> launch Flash Player
> > Debugger at the same time and open the same socket
> to communicate with it,
> > or try to parse the flashlog.txt that they have both
> written to.
> >
> > The royale-asjs job will use the royale-compiler
> workspace to get the
> > compiler. If the compiler is building, the jars are
> not there and the
> > royale-asjs build fails.
> >
> > There is also only so much memory and some of our
> jobs use all of it and
> > I'm not sure if jobs slowed down due to paging
> memory and writing/reading
> > from disk, even if it is an SSD.
> >
> > I'm done for tonight, but that's what I was seeing
> last time I tried to
> > have both master and an agent running jobs in parallel.
> >
> > Thanks,
> > -Alex
> >
> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala"
> <bigosmallm@gmail.com <ma...@gmail.com>> wrote:
> >
> > A typical setup would be to have 0 executors on
> master and at least n
> > number of executors on each agent, where n =
> number of cpu cores.
> > I see that the current VM has 2 cores. So, I
> started with setting the
> > num
> > executors on the current agent to 2.
> >
> > This should improve things quite a bit. If this
> doesn't work, I will
> > create a new VM and make it the slave agent of
> the current Jenkins
> > master.
> >
> >
> > Thanks,
> > Om
> >
> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > On your VM or mine? I don't think mine can
> handle it. I used to
> > run jobs
> > > of master and agent and we got lots of
> failures and jobs took
> > forever. If
> > > two jobs are trying to run tests with the
> shared Flash Player
> > Debugger, for
> > > example, you won't get consistent results.
> > >
> > > -Alex
> > >
> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala"
> <bigosmallm@gmail.com <ma...@gmail.com>>
> > wrote:
> > >
> > > I just realized that we have only one
> Agent (node) listed under
> > > Jenkins. I
> > > am going to add at least one more node to
> start with.
> > >
> > > Thanks,
> > > Om
> > >
> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> > <ah...@adobe.com.invalid>
> > > wrote:
> > >
> > > > I think I followed the instructions and
> enabled SSH.
> > > >
> > > > On 4/16/20, 9:37 AM, "Yishay Weiss"
> <yishayjobs@hotmail.com <ma...@hotmail.com>>
> > wrote:
> > > >
> > > > I haven’t gotten it to work. Could
> be ssh needs to be
> > enabled on
> > > the
> > > > VM [1]. This is nice to have but not
> essential. So Alex, let
> > me know
> > > if you
> > > > want to try that, otherwise I’ll suspend
> my efforts on this.
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
> > > >
> > > > From: Yishay
> Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > > To: dev@royale.apache.org
> <ma...@royale.apache.org><mailto:dev@royale.apache.org
> <ma...@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs
> on CI
> > > >
> > > > I’d like to try and install an ssh
> server. Can anyone
> > think of a
> > > > reason not to do that? I’m asking in
> terms of security, and if
> > there
> > > might
> > > > be a problem because it’s a VM.
> > > >
> > > > Thanks.
> > > >
> > > > From: Yishay
> Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Monday, April 13, 2020 10:02 AM
> > > > To: dev@royale.apache.org
> <ma...@royale.apache.org><mailto:dev@royale.apache.org
> <ma...@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs
> on CI
> > > >
> > > > Related, as most (all?) of the
> instructions don’t require
> > > anything but
> > > > a shell wouldn’t it be easier and faster
> to access the machine
> > with
> > > ssh
> > > > [1], rather than using remote desktop?
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
> > > >
> > > > From: Yishay
> Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Monday, April 13, 2020 9:55 AM
> > > > To: dev@royale.apache.org
> <ma...@royale.apache.org><mailto:dev@royale.apache.org
> <ma...@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs
> on CI
> > > >
> > > > Can’t you do that with remote desktop?
> > > >
> > > > ________________________________
> > > > From: OmPrakash Muppirala
> <bigosmallm@gmail.com <ma...@gmail.com>>
> > > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > > To: Apache Royale Development
> <dev@royale.apache.org <ma...@royale.apache.org>>
> > > > Subject: Re: Prioritize Release Jobs
> on CI
> > > >
> > > > Alex,
> > > >
> > > > I believe this is your personal
> Azure subscription right?
> > Any
> > > chance
> > > > I can
> > > > get access to it so I can try to
> copy the image out the
> > machine
> > > and
> > > > redeploy it somewhere else?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020 at 6:18 PM
> OmPrakash Muppirala <
> > > > bigosmallm@gmail.com
> <ma...@gmail.com>>
> > > > wrote:
> > > >
> > > > > I can help set this up on Azure.
> Give me some time to
> > work
> > > out the
> > > > > details?
> > > > >
> > > > > Thanks,
> > > > > Om
> > > > >
> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> > harbs.lists@gmail.com <ma...@gmail.com>>
> > > wrote:
> > > > >
> > > > >> OK. Good to know.
> > > > >>
> > > > >> > On Apr 12, 2020, at 9:45 PM,
> Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >
> > > > >> > FWIW, I just looked and the
> longest job in the release
> > > steps so
> > > > far is
> > > > >> 8 minutes. Most are under 2
> minutes. There might be
> > jobs
> > > later
> > > > that take
> > > > >> longer that we haven't run yet.
> IMO, the issue isn't
> > speed
> > > of the
> > > > machine,
> > > > >> it is just that we are sharing
> the machine with longer
> > jobs
> > > (1 hour
> > > > for
> > > > >> TourDeFlexMigration). And again,
> the machine will be
> > idle for
> > > > stretches of
> > > > >> time while the RM verifies
> artifacts after each step.
> > > > >> >
> > > > >> > -Alex
> > > > >> >
> > > > >> > On 4/12/20, 11:32 AM, "Harbs"
> <harbs.lists@gmail.com <ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com
> <ma...@gmail.com>>> wrote:
> > > > >> >
> > > > >> > Fair enough.
> > > > >> >
> > > > >> > I expect builds to be
> somewhere between 10 and 20
> > times
> > > faster
> > > > on a
> > > > >> powerful machine.
> > > > >> >
> > > > >> > Yeah. It’s probably going to be
> a bit of work
> > changing
> > > the
> > > > server,
> > > > >> but probably worth it in the long
> run.
> > > > >> >
> > > > >> > I think I’ll try this when I
> do the next release
> > unless
> > > Yishay
> > > > wants
> > > > >> to work with me on this for this
> release — but I’m not
> > going
> > > to be
> > > > able to
> > > > >> help until after Passover (i.e.
> next week).
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Harbs
> > > > >> >
> > > > >> >> On Apr 12, 2020, at 9:22 PM,
> Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >>
> > > > >> >> The Azure portal says:
> Standard F2s_v2 (2 vcpus, 4
> > GiB
> > > memory)
> > > > >> >>
> > > > >> >> I think I am reading changes
> to the build process in
> > your
> > > > >> suggestions. I do not really
> want to spend more of my
> > time
> > > on this
> > > > >> process. But if you want to do
> the work, that's fine
> > with me.
> > > > >> >>
> > > > >> >> -Alex
> > > > >> >>
> > > > >> >> On 4/12/20, 10:57 AM, "Harbs"
> <harbs.lists@gmail.com <ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com
> <ma...@gmail.com>>
> <mailto:harbs.lists@gmail.com <ma...@gmail.com>
> > <mailto:
> > > > >> harbs.lists@gmail.com
> <ma...@gmail.com>>>> wrote:
> > > > >> >>
> > > > >> >> What kind of horsepower is
> included in the free
> > Azure
> > > account?
> > > > >> >>
> > > > >> >> The server I mentioned builds
> (considerably)
> > faster than
> > > my own
> > > > >> local machine. The ci server
> seems to build many times
> > slower.
> > > > >> >>
> > > > >> >> One thing we can do to
> minimize running server time
> > > would be to
> > > > >> transfer the artifacts to storage
> instead of keeping
> > them on
> > > the
> > > > server. On
> > > > >> AWS, I’d probably use S3. Not
> sure what the similar
> > service on
> > > > Azure is
> > > > >> called.
> > > > >> >>
> > > > >> >>> On Apr 12, 2020, at 8:26 PM,
> Alex Harui
> > > > <aharui@adobe.com.INVALID
> > > > >> <mailto:aharui@adobe.com.INVALID
> <ma...@adobe.com.INVALID>>> wrote:
> > > > >> >>>
> > > > >> >>> OK, that's pretty much how I
> understand Azure as
> > well.
> > > The key
> > > > thing
> > > > >> is that "running" includes time
> where the CI server is
> > not
> > > running
> > > > any
> > > > >> Jenkins jobs. The CI Server
> steps might take only a few
> > > hours of
> > > > actual
> > > > >> server time, but there is time
> where the RM is verifying
> > > artifacts
> > > > locally
> > > > >> so you'd be paying for that or
> the RM would have to keep
> > > shutting
> > > > down and
> > > > >> restarting.
> > > > >> >>>
> > > > >> >>> Seems like it would be
> cheaper/simpler to get the
> > free
> > > MSDN
> > > > account
> > > > >> and leave it running.
> > > > >> >>>
> > > > >> >>> -Alex
> > > > >> >>>
> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> > harbs.lists@gmail.com <ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com
> <ma...@gmail.com>>> wrote:
> > > > >> >>>
> > > > >> >>> My experience is with AWS.
> > > > >> >>>
> > > > >> >>> I assume Microsoft has
> similar offerings, but I
> > don’t
> > > have
> > > > >> experience with Azure.
> > > > >> >>>
> > > > >> >>> AWS has on-demand EC2
> instances which you pay for
> > only
> > > the
> > > > actual
> > > > >> time that they are running.[1]
> > > > >> >>>
> > > > >> >>> Instances can be started and
> stopped via command
> > line
> > > (or via
> > > > the
> > > > >> web interface) as long as you
> have valid credentials to
> > do so.
> > > > >> >>>
> > > > >> >>> For example: an m5.4xlarge
> instance has 16 cores
> > and
> > > costs
> > > > about
> > > > >> $1.5 per hour. On a machine like
> that, a full build
> > would
> > > probably
> > > > take
> > > > >> less than 10 minutes. It’s
> probably possible to do a
> > full
> > > release
> > > > with only
> > > > >> a few hours of server time.
> > > > >> >>>
> > > > >> >>> Leaving a server like that
> running all the time
> > would get
> > > > expensive,
> > > > >> but if it’s just spun up for
> releases, you’d get very
> > fast
> > > builds
> > > > at a
> > > > >> reasonable price.
> > > > >> >>>
> > > > >> >>> I’d be happy to pay $10-$50
> (and possibly more) per
> > > release to
> > > > make
> > > > >> the release process painless for
> the RM.
> > > > >> >>>
> > > > >> >>> [1]
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> >><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > > >> >>>
> > > > >> >>>
> > > > >> >>>> On Apr 12, 2020, at 7:45 PM,
> Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>
> > > > >> >>>> I'm not very experienced
> with spinning up
> > servers. The
> > > CI
> > > > server we
> > > > >> are using is effectively free,
> based on a generous
> > donation
> > > from
> > > > Microsoft
> > > > >> of MSDN accounts to ASF
> committers. So I leave it up
> > 24/7,
> > > and
> > > > share the
> > > > >> RDP access on private@. I think
> any other ASF
> > committer
> > > could do
> > > > the
> > > > >> same. IIRC, if that server
> actually is stopped, I have
> > to
> > > use my
> > > > personal
> > > > >> (unshared) MSDN credentials to
> start it again. AIUI,
> > if I
> > > > actually paid
> > > > >> for the server, it would cost me
> to leave it running
> > even if
> > > it
> > > > didn't run
> > > > >> jobs between releases.
> > > > >> >>>>
> > > > >> >>>> Is that what you are
> basically saying? I think it
> > might
> > > be
> > > > best if
> > > > >> another committer got a CI server
> going via the MS
> > donation
> > > and
> > > > could leave
> > > > >> it up 24/7.
> > > > >> >>>>
> > > > >> >>>> -Alex
> > > > >> >>>>
> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> > harbs.lists@gmail.com <ma...@gmail.com>>
> > > wrote:
> > > > >> >>>>
> > > > >> >>>> I’m willing to do this.
> > > > >> >>>>
> > > > >> >>>> Considering that the release
> will be run
> > infrequently, it
> > > > should be
> > > > >> doable to have a relatively
> powerful server that could
> > be
> > > spun up on
> > > > >> demand. This is something I have
> setup for my own
> > releases.
> > > > >> >>>>
> > > > >> >>>> The only complication would
> be that each RM would
> > need
> > > valid
> > > > >> credentials to spin up the server.
> > > > >> >>>>
> > > > >> >>>> Harbs
> > > > >> >>>>
> > > > >> >>>>> On Apr 12, 2020, at 7:10
> PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>>
> > > > >> >>>>> A better solution, IMO, is
> for someone else to
> > offer up
> > > a CI
> > > > server
> > > > >> only for release jobs.
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
On 4/19/20, 11:25 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Congratulations! But does that mean that JAVA_HOME is pointing at a JRE
> instead of a JDK? If you have other issues that might be a factor.
>
Yeah, I messed up initially by getting the JRE instead of JDK. I have
since corrected it. But for some reason Ant still thinks that JAVA_HOME is
the jre directory.
I don't know how to fix this, hence the hack :-|
If you want to dig deeper, one idea is to run a Jenkins Job with a batch file that dumps out PATH and JAVA_HOME. This post seems to imply that Ant may store info in .antrc and/or ant.conf files.
HTH,
-Alex
>
> HTH,
> -Alex
>
> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> I copied tools.jar from jdk/lib to the jre/lib. That seems to have
> fixed
> the issue.
> We now have a successful build of the royale-compiler on the new Agent
> machine!!
>
> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > Restart dint help. Although Serkan's reply made me look at how Ant
> was
> > getting invoked.
> >
> > I see this warning that tools.jar is missing:
> >
> > [royale-compiler] $ cmd.exe /C
> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
> %%ERRORLEVEL%%"
> >
> > Unable to locate tools.jar. Expected to find it in C:\Program
> Files\Java\jre1.8.0_251\lib\tools.jar
> >
> >
> > I am pretty sure this is related to this issue.
> >
> >
> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> > wrote:
> >
> >>
> >>
> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> <ah...@adobe.com.invalid>
> >> wrote:
> >>
> >>> Did you reboot your VM? Also, have you checked what user is
> running
> >>> Jenkins on your VM? I think that can sometimes be a problem. I
> might be
> >>> running Jenkins as the user.
> >>>
> >>>
> >> Agents don't require Jenkins to be running. I will give the
> rebooting of
> >> the VM a shot .
> >>
> >> Thanks,
> >> Om
> >>
> >>
> >>> -Alex
> >>>
> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >>> wrote:
> >>>
> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> <ah...@adobe.com.invalid>
> >>> wrote:
> >>>
> >>> > Should be here:
> >>> >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239796954&sdata=VBfhdjYkWvKLxPRasbxtkfkxJRGfGsyMf0w7EmaMQGY%3D&reserved=0
> >>>
> >>>
> >>> My git is located in the same exact location as master.
> >>> Moreover, the git call from the commandline executes fine.
> The git
> >>> call
> >>> from ant exec is what is failing.
> >>>
> >>>
> >>>
> >>> >
> >>> >
> >>> > HTH,
> >>> > -Alex
> >>> >
> >>> > From: OmPrakash Muppirala <bi...@gmail.com>
> >>> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >>> > To: Apache Royale Development <de...@royale.apache.org>
> >>> > Subject: Re: Prioritize Release Jobs on CI
> >>> >
> >>> > I'm a bit stumped here. The royale-compiler is failing with
> this
> >>> error:
> >>> >
> >>> >
> >>> > BUILD FAILED
> >>> >
> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute
> >>> failed:
> >>> > java.io.IOException: Cannot run program "git" (in directory
> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess
> error=2,
> >>> The system
> >>> > cannot find the file specified
> >>> >
> >>> > at java.lang.ProcessBuilder.start(Unknown Source)
> >>> >
> >>> >
> >>> > It is from this part of the jenkins.xml:
> >>> >
> >>> >
> >>> > <target name="closure-lib-download" description="Copies
> Closure
> >>> > Library from GitHub">
> >>> > <echo message="Be patient. This takes a few
> minutes..." />
> >>> > <exec executable="git" failifexecutionfails="true">
> >>> > <arg value="clone" />
> >>> > <arg value="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239796954&sdata=Sc9D%2BW9cNuAmNCNvjWLAfbwCNq2YAeZ8cElretfYAoc%3D&reserved=0
> >>> <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239796954&sdata=Sc9D%2BW9cNuAmNCNvjWLAfbwCNq2YAeZ8cElretfYAoc%3D&reserved=0
> >>> >"
> >>> > />
> >>> > <arg value="${closure.root}" />
> >>> > </exec>
> >>> > <echo>Cloned fresh copy of Google Closure
> Library</echo>
> >>> > </target>
> >>> >
> >>> > I am not sure how this executable call works without the
> full path.
> >>> >
> >>> > I checked the env variables, I do have both the git/bin and
> git/cmd
> >>> > directory in the PATH:
> >>> >
> >>> > [cid:ii_k97zkk9o0]
> >>> >
> >>> > What am I missing?
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> >
> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>> wrote:
> >>> > Update - I have successfully attached my VM as a slave agent
> of our
> >>> > Jenkins instance.
> >>> > I am going to pull the job - /royale-asjs_jsonly and tie it
> to my
> >>> agent so
> >>> > I can test it.
> >>> >
> >>> > It will fail for a sometime while I go set up my VM with all
> the
> >>> > dependencies.
> >>> >
> >>> > Once we have the job successfully building on my VM, we can
> figure
> >>> out how
> >>> > to divide the load between the master and agent.
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> >
> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>> wrote:
> >>> > We could achieve the same by creating a new agent (separate
> vm) and
> >>> > attaching it as a slave to the current Jenkins server.
> >>> >
> >>> > Then we can use labels/tags to tie release jobs to one agent
> and
> >>> non
> >>> > release jobs to another agent.
> >>> >
> >>> > That way we can maintain everything in one UI, one login
> while
> >>> achieving
> >>> > the concurrent building capabilities we want.
> >>> >
> >>> > Jenkins is built for this kind of stuff and I think it would
> be
> >>> best we
> >>> > followed this practice.
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> <ah...@adobe.com.invalid>
> >>> wrote:
> >>> > Om, I thought you were going to get the image from my VM and
> run
> >>> it on
> >>> > another VM. Then we'd remove all non-release jobs from your
> VM
> >>> and all of
> >>> > the release jobs from my VM. That won't solve the problem
> of how
> >>> long it
> >>> > takes for a commit to be built and tested, but will allow
> the RM
> >>> to get a
> >>> > release out without getting stuck behind the commit jobs.
> Is that
> >>> > currently the plan?
> >>> >
> >>> > -Alex
> >>> >
> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com
> >>> <mailto:
> >>> > bigosmallm@gmail.com>> wrote:
> >>> >
> >>> > Makes sense to me. I will set parallel executors back
> to 1.
> >>> >
> >>> > And start working on a new Jenkins instance.
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> >
> >>> >
> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >>> <ah...@adobe.com.invalid>
> >>> > wrote:
> >>> >
> >>> > > Are you saying that Java, Ant and Maven do not know
> how to
> >>> > distribute work
> >>> > > to different cores?
> >>> > >
> >>> > > To repeat my main concern: our Jenkins jobs often use
> shared
> >>> > resources.
> >>> > > If you want to take the time to fix that, feel free,
> but I
> >>> do not
> >>> > know how
> >>> > > you are going to keep two jobs from both trying to
> launch
> >>> Flash
> >>> > Player
> >>> > > Debugger at the same time and open the same socket to
> >>> communicate
> >>> > with it,
> >>> > > or try to parse the flashlog.txt that they have both
> written
> >>> to.
> >>> > >
> >>> > > The royale-asjs job will use the royale-compiler
> workspace
> >>> to get the
> >>> > > compiler. If the compiler is building, the jars are
> not
> >>> there and
> >>> > the
> >>> > > royale-asjs build fails.
> >>> > >
> >>> > > There is also only so much memory and some of our jobs
> use
> >>> all of it
> >>> > and
> >>> > > I'm not sure if jobs slowed down due to paging memory
> and
> >>> > writing/reading
> >>> > > from disk, even if it is an SSD.
> >>> > >
> >>> > > I'm done for tonight, but that's what I was seeing
> last time
> >>> I tried
> >>> > to
> >>> > > have both master and an agent running jobs in parallel.
> >>> > >
> >>> > > Thanks,
> >>> > > -Alex
> >>> > >
> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>> wrote:
> >>> > >
> >>> > > A typical setup would be to have 0 executors on
> master
> >>> and at
> >>> > least n
> >>> > > number of executors on each agent, where n =
> number of
> >>> cpu cores.
> >>> > > I see that the current VM has 2 cores. So, I
> started
> >>> with
> >>> > setting the
> >>> > > num
> >>> > > executors on the current agent to 2.
> >>> > >
> >>> > > This should improve things quite a bit. If this
> doesn't
> >>> work, I
> >>> > will
> >>> > > create a new VM and make it the slave agent of the
> >>> current
> >>> > Jenkins
> >>> > > master.
> >>> > >
> >>> > >
> >>> > > Thanks,
> >>> > > Om
> >>> > >
> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> >>> > <ah...@adobe.com.invalid>
> >>> > > wrote:
> >>> > >
> >>> > > > On your VM or mine? I don't think mine can
> handle
> >>> it. I used
> >>> > to
> >>> > > run jobs
> >>> > > > of master and agent and we got lots of failures
> and
> >>> jobs took
> >>> > > forever. If
> >>> > > > two jobs are trying to run tests with the shared
> Flash
> >>> Player
> >>> > > Debugger, for
> >>> > > > example, you won't get consistent results.
> >>> > > >
> >>> > > > -Alex
> >>> > > >
> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
> >>> > bigosmallm@gmail.com<ma...@gmail.com>>
> >>> > > wrote:
> >>> > > >
> >>> > > > I just realized that we have only one Agent
> (node)
> >>> listed
> >>> > under
> >>> > > > Jenkins. I
> >>> > > > am going to add at least one more node to
> start
> >>> with.
> >>> > > >
> >>> > > > Thanks,
> >>> > > > Om
> >>> > > >
> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> >>> > > <ah...@adobe.com.invalid>
> >>> > > > wrote:
> >>> > > >
> >>> > > > > I think I followed the instructions and
> enabled
> >>> SSH.
> >>> > > > >
> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
> >>> > yishayjobs@hotmail.com<ma...@hotmail.com>>
> >>> > > wrote:
> >>> > > > >
> >>> > > > > I haven’t gotten it to work. Could be
> ssh
> >>> needs to be
> >>> > > enabled on
> >>> > > > the
> >>> > > > > VM [1]. This is nice to have but not
> essential.
> >>> So Alex,
> >>> > let
> >>> > > me know
> >>> > > > if you
> >>> > > > > want to try that, otherwise I’ll suspend my
> >>> efforts on
> >>> > this.
> >>> > > > >
> >>> > > > > [1]
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239796954&sdata=Vn2Vmc7Uhxn7lMnUqHzY4lzR0EhXw0tOfKoBomlfYlQ%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=RzwACbMA1ioqcOMrALKf0OmhLXC16UhyWscF6IXGZlk%3D&reserved=0
> >>> > >
> >>> > > > >
> >>> > > > > From: Yishay Weiss<mailto:
> >>> yishayjobs@hotmail.com
> >>> > <ma...@hotmail.com>>
> >>> > > > > Sent: Wednesday, April 15, 2020 5:09 PM
> >>> > > > > To: dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org>>
> >>> > > > > Subject: RE: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > I’d like to try and install an ssh
> server.
> >>> Can anyone
> >>> > > think of a
> >>> > > > > reason not to do that? I’m asking in terms
> of
> >>> security,
> >>> > and if
> >>> > > there
> >>> > > > might
> >>> > > > > be a problem because it’s a VM.
> >>> > > > >
> >>> > > > > Thanks.
> >>> > > > >
> >>> > > > > From: Yishay Weiss<mailto:
> >>> yishayjobs@hotmail.com
> >>> > <ma...@hotmail.com>>
> >>> > > > > Sent: Monday, April 13, 2020 10:02 AM
> >>> > > > > To: dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org>>
> >>> > > > > Subject: RE: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > Related, as most (all?) of the
> instructions
> >>> don’t
> >>> > require
> >>> > > > anything but
> >>> > > > > a shell wouldn’t it be easier and faster to
> >>> access the
> >>> > machine
> >>> > > with
> >>> > > > ssh
> >>> > > > > [1], rather than using remote desktop?
> >>> > > > >
> >>> > > > > [1]
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=twNTFDLGdeM7%2BVnNozwE9lKXHMUaGNA8NnqFAiLEjQ4%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=twNTFDLGdeM7%2BVnNozwE9lKXHMUaGNA8NnqFAiLEjQ4%3D&reserved=0
> >>> > >
> >>> > > > >
> >>> > > > > From: Yishay Weiss<mailto:
> >>> yishayjobs@hotmail.com
> >>> > <ma...@hotmail.com>>
> >>> > > > > Sent: Monday, April 13, 2020 9:55 AM
> >>> > > > > To: dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org>>
> >>> > > > > Subject: RE: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > Can’t you do that with remote desktop?
> >>> > > > >
> >>> > > > > ________________________________
> >>> > > > > From: OmPrakash Muppirala <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>>
> >>> > > > > Sent: Monday, April 13, 2020 9:51:25 AM
> >>> > > > > To: Apache Royale Development <
> >>> dev@royale.apache.org
> >>> > <ma...@royale.apache.org>>
> >>> > > > > Subject: Re: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > Alex,
> >>> > > > >
> >>> > > > > I believe this is your personal Azure
> >>> subscription
> >>> > right?
> >>> > > Any
> >>> > > > chance
> >>> > > > > I can
> >>> > > > > get access to it so I can try to copy
> the
> >>> image out
> >>> > the
> >>> > > machine
> >>> > > > and
> >>> > > > > redeploy it somewhere else?
> >>> > > > >
> >>> > > > > Thanks,
> >>> > > > > Om
> >>> > > > >
> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM
> OmPrakash
> >>> Muppirala <
> >>> > > > > bigosmallm@gmail.com<mailto:
> bigosmallm@gmail.com
> >>> >>
> >>> > > > > wrote:
> >>> > > > >
> >>> > > > > > I can help set this up on Azure.
> Give me
> >>> some
> >>> > time to
> >>> > > work
> >>> > > > out the
> >>> > > > > > details?
> >>> > > > > >
> >>> > > > > > Thanks,
> >>> > > > > > Om
> >>> > > > > >
> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs
> <
> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
> >>> > > > wrote:
> >>> > > > > >
> >>> > > > > >> OK. Good to know.
> >>> > > > > >>
> >>> > > > > >> > On Apr 12, 2020, at 9:45 PM, Alex
> Harui
> >>> > > > <aharui@adobe.com.INVALID
> >>> > > > > >
> >>> > > > > >> wrote:
> >>> > > > > >> >
> >>> > > > > >> > FWIW, I just looked and the
> longest job
> >>> in the
> >>> > release
> >>> > > > steps so
> >>> > > > > far is
> >>> > > > > >> 8 minutes. Most are under 2
> minutes.
> >>> There
> >>> > might be
> >>> > > jobs
> >>> > > > later
> >>> > > > > that take
> >>> > > > > >> longer that we haven't run yet.
> IMO, the
> >>> issue
> >>> > isn't
> >>> > > speed
> >>> > > > of the
> >>> > > > > machine,
> >>> > > > > >> it is just that we are sharing the
> >>> machine with
> >>> > longer
> >>> > > jobs
> >>> > > > (1 hour
> >>> > > > > for
> >>> > > > > >> TourDeFlexMigration). And again,
> the
> >>> machine
> >>> > will be
> >>> > > idle for
> >>> > > > > stretches of
> >>> > > > > >> time while the RM verifies artifacts
> >>> after each
> >>> > step.
> >>> > > > > >> >
> >>> > > > > >> > -Alex
> >>> > > > > >> >
> >>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >>> > > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>>> wrote:
> >>> > > > > >> >
> >>> > > > > >> > Fair enough.
> >>> > > > > >> >
> >>> > > > > >> > I expect builds to be somewhere
> >>> between 10
> >>> > and 20
> >>> > > times
> >>> > > > faster
> >>> > > > > on a
> >>> > > > > >> powerful machine.
> >>> > > > > >> >
> >>> > > > > >> > Yeah. It’s probably going to
> be a
> >>> bit of work
> >>> > > changing
> >>> > > > the
> >>> > > > > server,
> >>> > > > > >> but probably worth it in the long
> run.
> >>> > > > > >> >
> >>> > > > > >> > I think I’ll try this when I
> do the
> >>> next
> >>> > release
> >>> > > unless
> >>> > > > Yishay
> >>> > > > > wants
> >>> > > > > >> to work with me on this for this
> release
> >>> — but
> >>> > I’m not
> >>> > > going
> >>> > > > to be
> >>> > > > > able to
> >>> > > > > >> help until after Passover (i.e. next
> >>> week).
> >>> > > > > >> >
> >>> > > > > >> > Thanks,
> >>> > > > > >> > Harbs
> >>> > > > > >> >
> >>> > > > > >> >> On Apr 12, 2020, at 9:22 PM,
> Alex Harui
> >>> > > > <aharui@adobe.com.INVALID
> >>> > > > > >
> >>> > > > > >> wrote:
> >>> > > > > >> >>
> >>> > > > > >> >> The Azure portal says: Standard
> F2s_v2
> >>> (2
> >>> > vcpus, 4
> >>> > > GiB
> >>> > > > memory)
> >>> > > > > >> >>
> >>> > > > > >> >> I think I am reading changes to
> the
> >>> build
> >>> > process in
> >>> > > your
> >>> > > > > >> suggestions. I do not really want
> to
> >>> spend more
> >>> > of my
> >>> > > time
> >>> > > > on this
> >>> > > > > >> process. But if you want to do the
> work,
> >>> that's
> >>> > fine
> >>> > > with me.
> >>> > > > > >> >>
> >>> > > > > >> >> -Alex
> >>> > > > > >> >>
> >>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >>> > > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com
> <mailto:
> >>> > harbs.lists@gmail.com>
> >>> > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>>>> wrote:
> >>> > > > > >> >>
> >>> > > > > >> >> What kind of horsepower is
> included
> >>> in the
> >>> > free
> >>> > > Azure
> >>> > > > account?
> >>> > > > > >> >>
> >>> > > > > >> >> The server I mentioned builds
> >>> (considerably)
> >>> > > faster than
> >>> > > > my own
> >>> > > > > >> local machine. The ci server seems
> to
> >>> build many
> >>> > times
> >>> > > slower.
> >>> > > > > >> >>
> >>> > > > > >> >> One thing we can do to minimize
> >>> running
> >>> > server time
> >>> > > > would be to
> >>> > > > > >> transfer the artifacts to storage
> instead
> >>> of
> >>> > keeping
> >>> > > them on
> >>> > > > the
> >>> > > > > server. On
> >>> > > > > >> AWS, I’d probably use S3. Not sure
> what
> >>> the
> >>> > similar
> >>> > > service on
> >>> > > > > Azure is
> >>> > > > > >> called.
> >>> > > > > >> >>
> >>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM,
> Alex
> >>> Harui
> >>> > > > > <aharui@adobe.com.INVALID
> >>> > > > > >> <mailto:aharui@adobe.com.INVALID
> <mailto:
> >>> > aharui@adobe.com.INVALID>>> wrote:
> >>> > > > > >> >>>
> >>> > > > > >> >>> OK, that's pretty much how I
> >>> understand Azure
> >>> > as
> >>> > > well.
> >>> > > > The key
> >>> > > > > thing
> >>> > > > > >> is that "running" includes time
> where the
> >>> CI
> >>> > server is
> >>> > > not
> >>> > > > running
> >>> > > > > any
> >>> > > > > >> Jenkins jobs. The CI Server steps
> might
> >>> take
> >>> > only a few
> >>> > > > hours of
> >>> > > > > actual
> >>> > > > > >> server time, but there is time
> where the
> >>> RM is
> >>> > verifying
> >>> > > > artifacts
> >>> > > > > locally
> >>> > > > > >> so you'd be paying for that or the
> RM
> >>> would have
> >>> > to keep
> >>> > > > shutting
> >>> > > > > down and
> >>> > > > > >> restarting.
> >>> > > > > >> >>>
> >>> > > > > >> >>> Seems like it would be
> >>> cheaper/simpler to get
> >>> > the
> >>> > > free
> >>> > > > MSDN
> >>> > > > > account
> >>> > > > > >> and leave it running.
> >>> > > > > >> >>>
> >>> > > > > >> >>> -Alex
> >>> > > > > >> >>>
> >>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> >>> > > harbs.lists@gmail.com<ma...@gmail.com>
> >>> > > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>>> wrote:
> >>> > > > > >> >>>
> >>> > > > > >> >>> My experience is with AWS.
> >>> > > > > >> >>>
> >>> > > > > >> >>> I assume Microsoft has similar
> >>> offerings,
> >>> > but I
> >>> > > don’t
> >>> > > > have
> >>> > > > > >> experience with Azure.
> >>> > > > > >> >>>
> >>> > > > > >> >>> AWS has on-demand EC2 instances
> >>> which you
> >>> > pay for
> >>> > > only
> >>> > > > the
> >>> > > > > actual
> >>> > > > > >> time that they are running.[1]
> >>> > > > > >> >>>
> >>> > > > > >> >>> Instances can be started and
> stopped
> >>> via
> >>> > command
> >>> > > line
> >>> > > > (or via
> >>> > > > > the
> >>> > > > > >> web interface) as long as you have
> valid
> >>> > credentials to
> >>> > > do so.
> >>> > > > > >> >>>
> >>> > > > > >> >>> For example: an m5.4xlarge
> instance
> >>> has 16
> >>> > cores
> >>> > > and
> >>> > > > costs
> >>> > > > > about
> >>> > > > > >> $1.5 per hour. On a machine like
> that, a
> >>> full
> >>> > build
> >>> > > would
> >>> > > > probably
> >>> > > > > take
> >>> > > > > >> less than 10 minutes. It’s probably
> >>> possible to
> >>> > do a
> >>> > > full
> >>> > > > release
> >>> > > > > with only
> >>> > > > > >> a few hours of server time.
> >>> > > > > >> >>>
> >>> > > > > >> >>> Leaving a server like that
> running
> >>> all the
> >>> > time
> >>> > > would get
> >>> > > > > expensive,
> >>> > > > > >> but if it’s just spun up for
> releases,
> >>> you’d get
> >>> > very
> >>> > > fast
> >>> > > > builds
> >>> > > > > at a
> >>> > > > > >> reasonable price.
> >>> > > > > >> >>>
> >>> > > > > >> >>> I’d be happy to pay $10-$50
> (and
> >>> possibly
> >>> > more) per
> >>> > > > release to
> >>> > > > > make
> >>> > > > > >> the release process painless for
> the RM.
> >>> > > > > >> >>>
> >>> > > > > >> >>> [1]
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > >
> >>> > > > > >> ><
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239806944&sdata=rgPi%2FDJRjgiuwnQtlh9I7GyPnl2ul4S13MqzUiZv23o%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > >
> >>> > > > > >> >><
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > >
> >>> > > > > >> ><
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C064142121e184b7a721f08d7e4f39a91%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229607239816937&sdata=OR5bL2ZdtT%2F44eMdGoM9QlBIj8vst1qaezMUy79iQUY%3D&reserved=0
> >>> > >
> >>> > > > > >> >>>
> >>> > > > > >> >>>
> >>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM,
> Alex
> >>> Harui
> >>> > > > > <ah...@adobe.com.INVALID>
> >>> > > > > >> wrote:
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> I'm not very experienced with
> >>> spinning up
> >>> > > servers. The
> >>> > > > CI
> >>> > > > > server we
> >>> > > > > >> are using is effectively free,
> based on a
> >>> generous
> >>> > > donation
> >>> > > > from
> >>> > > > > Microsoft
> >>> > > > > >> of MSDN accounts to ASF
> committers. So I
> >>> leave
> >>> > it up
> >>> > > 24/7,
> >>> > > > and
> >>> > > > > share the
> >>> > > > > >> RDP access on private@. I think
> any
> >>> other ASF
> >>> > > committer
> >>> > > > could do
> >>> > > > > the
> >>> > > > > >> same. IIRC, if that server
> actually is
> >>> stopped,
> >>> > I have
> >>> > > to
> >>> > > > use my
> >>> > > > > personal
> >>> > > > > >> (unshared) MSDN credentials to
> start it
> >>> again.
> >>> > AIUI,
> >>> > > if I
> >>> > > > > actually paid
> >>> > > > > >> for the server, it would cost me to
> leave
> >>> it
> >>> > running
> >>> > > even if
> >>> > > > it
> >>> > > > > didn't run
> >>> > > > > >> jobs between releases.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> Is that what you are basically
> >>> saying? I
> >>> > think it
> >>> > > might
> >>> > > > be
> >>> > > > > best if
> >>> > > > > >> another committer got a CI server
> going
> >>> via the MS
> >>> > > donation
> >>> > > > and
> >>> > > > > could leave
> >>> > > > > >> it up 24/7.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> -Alex
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
> >>> > > > wrote:
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> I’m willing to do this.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> Considering that the release
> will be
> >>> run
> >>> > > infrequently, it
> >>> > > > > should be
> >>> > > > > >> doable to have a relatively powerful
> >>> server that
> >>> > could
> >>> > > be
> >>> > > > spun up on
> >>> > > > > >> demand. This is something I have
> setup
> >>> for my own
> >>> > > releases.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> The only complication would be
> that
> >>> each RM
> >>> > would
> >>> > > need
> >>> > > > valid
> >>> > > > > >> credentials to spin up the server.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> Harbs
> >>> > > > > >> >>>>
> >>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM,
> Alex
> >>> Harui
> >>> > > > > <ah...@adobe.com.INVALID>
> >>> > > > > >> wrote:
> >>> > > > > >> >>>>>
> >>> > > > > >> >>>>> A better solution, IMO, is for
> >>> someone else
> >>> > to
> >>> > > offer up
> >>> > > > a CI
> >>> > > > > server
> >>> > > > > >> only for release jobs.
> >>> > > > > >>
> >>> > > > > >>
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > >
> >>> > > >
> >>> > > >
> >>> > >
> >>> > >
> >>> > >
> >>> >
> >>> >
> >>>
> >>>
> >>>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
I haven't paid much attention. Two builds ago was a successful build and the most recent failure didn't seem to involve the socket.
-Alex
On 4/20/20, 11:47 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
I see. I was waiting for the build to be fixed before moving it over. Or
have folks run into a dead-end trying to figure out what is wrong with
royale-asjs ?
On Mon, Apr 20, 2020 at 11:03 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Also, once royale-asjs completes, it is going to kick off lots of other
> jobs on agent 1 that will compete with the release jobs. Ideally, all
> non-release jobs would be moved over to the new agent VM.
>
> -Alex
>
> On 4/20/20, 10:55 PM, "Alex Harui" <ah...@adobe.com.INVALID> wrote:
>
> Yes, royale-asjs (which is currently building on agent1 and blocking
> the release job).
>
> -Alex
>
> On 4/20/20, 10:53 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> wrote:
>
> Update - royale-asjs_jsonly successfully build on my agent VM.
>
> Right now, we have 3 jobs running on this VM:
> 1. royale-asjs_jsonly
> 2. royale-compiler
> 3. royale-typedefs
>
> Are there any other jobs we need to move to the new agent?
>
> Yishay, can you please confirm that your release jobs are running
> without
> being hindered by CI jobs?
>
> Thanks,
> Om
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on
> my VM. If
> >> you are talking about your VM, you can compare console output
> from recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem.
> Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an
> example of shared
> >> > resources that I mentioned upthread. Royale-typedefs is
> going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a
> built of
> >> > royale-compiler in it. If royale-compiler fails to
> create all of
> >> its
> >> > binaries or is in the process of building them,
> royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449026230&sdata=K9lsnsCKyRdi5Gw%2B4T%2BzxSnr6hmapj29KU%2FwU33gwsQ%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful,
> but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls
> down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've
> never found
> >> enough
> >> > time and energy to try to make changes like that since
> most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com>
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD
> FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91:
> src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449026230&sdata=zeNP39Z1Z2NRcWLqW2jn42ZUL5qEQwm0nGuoXb3MoDM%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that
> JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that
> might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE
> instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still
> thinks that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the
> jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the
> royale-compiler on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash
> Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply
> made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file
> jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs
> main && exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find
> it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this
> issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash
> Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you
> checked what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can
> sometimes be a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be
> running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash
> Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex
> Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=lCELyaAFMXbD8%2B70P6shagFsXaBSEgmM35cY8RhwQAg%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact
> location as
> >> master.
> >> > >> >>> Moreover, the git call from the
> commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37
> PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs
> on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The
> royale-compiler is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run
> program "git"
> >> (in
> >> > directory
> >> > >> >>> >
> "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at
> java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the
> jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target
> name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient.
> This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=SnnPJaptGY2QhvsgrbyYVUt0HbHyXgBPd7KtZn9ZxOQ%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=SnnPJaptGY2QhvsgrbyYVUt0HbHyXgBPd7KtZn9ZxOQ%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg
> value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of
> Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable
> call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do
> have both the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM
> OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> wrote:
> >> > >> >>> > Update - I have successfully
> attached my VM as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I
> go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully
> building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the
> master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM
> OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> wrote:
> >> > >> >>> > We could achieve the same by
> creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the
> current Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie
> release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything
> in one UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities
> we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of
> stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex
> Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get
> the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all
> non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That
> won't solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and
> tested, but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck
> behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash
> Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set
> parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new
> Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM
> Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant
> and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern:
> our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time
> to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs
> from both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and
> open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the
> flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use
> the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is
> building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much
> memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed
> down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an
> SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but
> that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent
> running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM,
> "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be
> to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on
> each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM
> has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current
> agent to 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things
> quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make
> it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at
> 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I
> don't think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and
> we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to
> run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get
> consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM,
> "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that
> we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at
> least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020
> at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed
> the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37
> AM, "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t
> gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is
> nice to have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that,
> otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=BtfnnPxJ3f975%2FKlu0KP6cDIj1qxI9rwC3PccPh2bFY%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=BtfnnPxJ3f975%2FKlu0KP6cDIj1qxI9rwC3PccPh2bFY%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent:
> Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to
> try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do
> that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem
> because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday,
> April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as
> most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t
> it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than
> using remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=ICbqye3qv1n3xDhrj8f2SviCM6vVRdVPJlQdAMiyILE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=ICbqye3qv1n3xDhrj8f2SviCM6vVRdVPJlQdAMiyILE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday,
> April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do
> that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday,
> April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache
> Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this
> is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to
> it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it
> somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr
> 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > >
> bigosmallm@gmail.com<mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help
> set this up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr
> 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to
> know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr
> 12, 2020, at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I
> just looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes.
> Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that
> we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just
> that we are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while
> the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On
> 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair
> enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I
> expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful
> machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah.
> It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but
> probably worth it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I
> think I’ll try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work
> with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until
> after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr
> 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The
> Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think
> I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >>
> suggestions. I do not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process.
> But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On
> 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What
> kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The
> server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local
> machine. The ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One
> thing we can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d
> probably use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr
> 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > >
> <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK,
> that's pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that
> "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins
> jobs. The CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server
> time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be
> paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems
> like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave
> it running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On
> 4/12/20, 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My
> experience is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I
> assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience
> with Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that
> they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> Instances can be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web
> interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For
> example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per
> hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than
> 10 minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours
> of server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> Leaving a server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s
> just spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable
> price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be
> happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release
> process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=TbtCG%2Fq9kLcn0dw%2FJAFp1KaciZpZ7%2Bn7CMelw2d9a4g%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449036225&sdata=TbtCG%2Fq9kLcn0dw%2FJAFp1KaciZpZ7%2Bn7CMelw2d9a4g%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449046217&sdata=%2FSi3crzinIr6twLPAHmKLYjcOhJxLi9VCE6x30VzulA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449056213&sdata=f4Up4H6PY100QB0fIjxeeM1Qjq6z8X5MMsyckSNLdkA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449056213&sdata=f4Up4H6PY100QB0fIjxeeM1Qjq6z8X5MMsyckSNLdkA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449056213&sdata=f4Up4H6PY100QB0fIjxeeM1Qjq6z8X5MMsyckSNLdkA%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C1b5d286f4f29450ecd8a08d7e5bfd86c%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230484449056213&sdata=f4Up4H6PY100QB0fIjxeeM1Qjq6z8X5MMsyckSNLdkA%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr
> 12, 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > >
> <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm
> not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN
> accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access
> on private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same.
> IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared)
> MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the
> server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs
> between releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is
> that what you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another
> committer got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On
> 4/12/20, 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m
> willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>
> Considering that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to
> have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand.
> This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The
> only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials
> to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On
> Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > >
> <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A
> better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for
> release jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Mon, Apr 20, 2020 at 11:08 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I see. I was waiting for the build to be fixed before moving it over. Or
> have folks run into a dead-end trying to figure out what is wrong with
> royale-asjs ?
>
Hah! Never mind. Looks like royale-asjs is building fine now.
I will pick this one up now.
>
> On Mon, Apr 20, 2020 at 11:03 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> Also, once royale-asjs completes, it is going to kick off lots of other
>> jobs on agent 1 that will compete with the release jobs. Ideally, all
>> non-release jobs would be moved over to the new agent VM.
>>
>> -Alex
>>
>> On 4/20/20, 10:55 PM, "Alex Harui" <ah...@adobe.com.INVALID> wrote:
>>
>> Yes, royale-asjs (which is currently building on agent1 and blocking
>> the release job).
>>
>> -Alex
>>
>> On 4/20/20, 10:53 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> Update - royale-asjs_jsonly successfully build on my agent VM.
>>
>> Right now, we have 3 jobs running on this VM:
>> 1. royale-asjs_jsonly
>> 2. royale-compiler
>> 3. royale-typedefs
>>
>> Are there any other jobs we need to move to the new agent?
>>
>> Yishay, can you please confirm that your release jobs are running
>> without
>> being hindered by CI jobs?
>>
>> Thanks,
>> Om
>>
>> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> wrote:
>>
>> >
>> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui
>> <ah...@adobe.com.invalid>
>> > wrote:
>> >
>> >> I see compiler-jx/lib in the Workspace for royale-compiler on
>> my VM. If
>> >> you are talking about your VM, you can compare console output
>> from recent
>> >> successful builds on both VMs.
>> >>
>> >>
>> > I was talking about my VM.
>> > A rebuild of royale-compiler seems to have fixed that problem.
>> Now
>> > royale-typedefs passes as well!
>> >
>> > Next up royale-asjs_jsonly...
>> >
>> >
>> >> I'm done for tonight. Good luck,
>> >> -Alex
>> >>
>> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> >> wrote:
>> >>
>> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
>> <aharui@adobe.com.invalid
>> >> >
>> >> wrote:
>> >>
>> >> > Royale-compiler has to be built first. This is an
>> example of shared
>> >> > resources that I mentioned upthread. Royale-typedefs is
>> going to
>> >> look for
>> >> > a sibling workspace folder called royale-compiler with a
>> built of
>> >> > royale-compiler in it. If royale-compiler fails to
>> create all of
>> >> its
>> >> > binaries or is in the process of building them,
>> royale-typedefs
>> >> will report
>> >> > an error.
>> >> >
>> >>
>> >> Got it. I was just looking at the logic here:
>> >>
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126971265&sdata=QPt6lvVwPBgoVhmAg8%2B%2FeiBxjq9%2FHYLreIG2brTGfuE%3D&reserved=0
>> >>
>> >> Weird. The royale-compiler build says it was successful,
>> but I cant
>> >> find
>> >> the lib directory under
>> >> C:\jenkins\workspace\royale-compiler\compiler-jx
>> >>
>> >>
>> >>
>> >>
>> >> >
>> >> > What should probably happen is that royale-typedefs
>> pulls down the
>> >> > lastsuccessfulartifacts from royale-compiler, but I've
>> never found
>> >> enough
>> >> > time and energy to try to make changes like that since
>> most of us
>> >> do have
>> >> > all of the folders as siblings.
>> >> >
>> >> > HTH,
>> >> > -Alex
>> >> >
>> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> >> wrote:
>> >> >
>> >> > I am now getting this error on royale-typedefs build:
>> >> >
>> >> > BUILD
>> FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
>> >> The
>> >> > following error occurred while executing this line:
>> >> >
>> c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>> >> >
>> >> >
>> >>
>> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
>> >> > doesn't exist.
>> >> >
>> >> >
>> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
>> >> >
>> >> > Here is the full console output:
>> >> >
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=CgDdnMTfn3BVaF5eLt%2BX4rAX3gdpsb4MPT4jR97aLB8%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>> >> >
>> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala
>> <
>> >> > bigosmallm@gmail.com>
>> >> > wrote:
>> >> >
>> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
>> >> <aharui@adobe.com.invalid
>> >> > >
>> >> > > wrote:
>> >> > >
>> >> > >> Congratulations! But does that mean that
>> JAVA_HOME is
>> >> pointing at
>> >> > a JRE
>> >> > >> instead of a JDK? If you have other issues that
>> might be a
>> >> factor.
>> >> > >>
>> >> > >
>> >> > > Yeah, I messed up initially by getting the JRE
>> instead of
>> >> JDK. I
>> >> > have
>> >> > > since corrected it. But for some reason Ant still
>> thinks that
>> >> > JAVA_HOME is
>> >> > > the jre directory.
>> >> > > I don't know how to fix this, hence the hack :-|
>> >> > >
>> >> > >
>> >> > >
>> >> > >
>> >> > >>
>> >> > >> HTH,
>> >> > >> -Alex
>> >> > >>
>> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
>> >> bigosmallm@gmail.com>
>> >> > >> wrote:
>> >> > >>
>> >> > >> I copied tools.jar from jdk/lib to the
>> jre/lib. That
>> >> seems to
>> >> > have
>> >> > >> fixed
>> >> > >> the issue.
>> >> > >> We now have a successful build of the
>> royale-compiler on
>> >> the
>> >> > new Agent
>> >> > >> machine!!
>> >> > >>
>> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash
>> Muppirala <
>> >> > >> bigosmallm@gmail.com>
>> >> > >> wrote:
>> >> > >>
>> >> > >> > Restart dint help. Although Serkan's reply
>> made me
>> >> look at
>> >> > how Ant
>> >> > >> was
>> >> > >> > getting invoked.
>> >> > >> >
>> >> > >> > I see this warning that tools.jar is
>> missing:
>> >> > >> >
>> >> > >> > [royale-compiler] $ cmd.exe /C
>> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file
>> jenkins.xml
>> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs
>> main && exit
>> >> > >> %%ERRORLEVEL%%"
>> >> > >> >
>> >> > >> > Unable to locate tools.jar. Expected to
>> find it in
>> >> C:\Program
>> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
>> >> > >> >
>> >> > >> >
>> >> > >> > I am pretty sure this is related to this
>> issue.
>> >> > >> >
>> >> > >> >
>> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash
>> Muppirala <
>> >> > >> bigosmallm@gmail.com>
>> >> > >> > wrote:
>> >> > >> >
>> >> > >> >>
>> >> > >> >>
>> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> >> > >> <ah...@adobe.com.invalid>
>> >> > >> >> wrote:
>> >> > >> >>
>> >> > >> >>> Did you reboot your VM? Also, have you
>> checked what
>> >> user is
>> >> > >> running
>> >> > >> >>> Jenkins on your VM? I think that can
>> sometimes be a
>> >> > problem. I
>> >> > >> might be
>> >> > >> >>> running Jenkins as the user.
>> >> > >> >>>
>> >> > >> >>>
>> >> > >> >> Agents don't require Jenkins to be
>> running. I will
>> >> give the
>> >> > >> rebooting of
>> >> > >> >> the VM a shot .
>> >> > >> >>
>> >> > >> >> Thanks,
>> >> > >> >> Om
>> >> > >> >>
>> >> > >> >>
>> >> > >> >>> -Alex
>> >> > >> >>>
>> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash
>> Muppirala" <
>> >> > bigosmallm@gmail.com
>> >> > >> >
>> >> > >> >>> wrote:
>> >> > >> >>>
>> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex
>> Harui
>> >> > >> <ah...@adobe.com.invalid>
>> >> > >> >>> wrote:
>> >> > >> >>>
>> >> > >> >>> > Should be here:
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=wmUYQ8yANnUuo4i%2F7FXqjsPwQzd4bL%2Bh4gUoR3xa%2BIA%3D&reserved=0
>> >> > >> >>>
>> >> > >> >>>
>> >> > >> >>> My git is located in the same exact
>> location as
>> >> master.
>> >> > >> >>> Moreover, the git call from the
>> commandline
>> >> executes
>> >> > fine.
>> >> > >> The git
>> >> > >> >>> call
>> >> > >> >>> from ant exec is what is failing.
>> >> > >> >>>
>> >> > >> >>>
>> >> > >> >>>
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>> > HTH,
>> >> > >> >>> > -Alex
>> >> > >> >>> >
>> >> > >> >>> > From: OmPrakash Muppirala <
>> >> bigosmallm@gmail.com>
>> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
>> >> > dev@royale.apache.org>
>> >> > >> >>> > Date: Sunday, April 19, 2020 at
>> 9:37 PM
>> >> > >> >>> > To: Apache Royale Development <
>> >> dev@royale.apache.org>
>> >> > >> >>> > Subject: Re: Prioritize Release
>> Jobs on CI
>> >> > >> >>> >
>> >> > >> >>> > I'm a bit stumped here. The
>> royale-compiler is
>> >> > failing
>> >> > >> with this
>> >> > >> >>> error:
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>> > BUILD FAILED
>> >> > >> >>> >
>> >> > >> >>> >
>> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
>> >> > Execute
>> >> > >> >>> failed:
>> >> > >> >>> > java.io.IOException: Cannot run
>> program "git"
>> >> (in
>> >> > directory
>> >> > >> >>> >
>> "c:\jenkins\workspace\royale-compiler"):
>> >> CreateProcess
>> >> > >> error=2,
>> >> > >> >>> The system
>> >> > >> >>> > cannot find the file specified
>> >> > >> >>> >
>> >> > >> >>> > at
>> java.lang.ProcessBuilder.start(Unknown
>> >> Source)
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>> > It is from this part of the
>> jenkins.xml:
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>> > <target
>> name="closure-lib-download"
>> >> > description="Copies
>> >> > >> Closure
>> >> > >> >>> > Library from GitHub">
>> >> > >> >>> > <echo message="Be patient.
>> This takes
>> >> a few
>> >> > >> minutes..." />
>> >> > >> >>> > <exec executable="git"
>> >> > failifexecutionfails="true">
>> >> > >> >>> > <arg value="clone" />
>> >> > >> >>> > <arg value="
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=aaSDpyVpWdqmVar4s8SJuKUDYRzuhwQ8J6%2BZCcpO56c%3D&reserved=0
>> >> > >> >>> <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=aaSDpyVpWdqmVar4s8SJuKUDYRzuhwQ8J6%2BZCcpO56c%3D&reserved=0
>> >> > >> >>> >"
>> >> > >> >>> > />
>> >> > >> >>> > <arg
>> value="${closure.root}" />
>> >> > >> >>> > </exec>
>> >> > >> >>> > <echo>Cloned fresh copy of
>> Google
>> >> Closure
>> >> > >> Library</echo>
>> >> > >> >>> > </target>
>> >> > >> >>> >
>> >> > >> >>> > I am not sure how this executable
>> call works
>> >> without
>> >> > the
>> >> > >> full path.
>> >> > >> >>> >
>> >> > >> >>> > I checked the env variables, I do
>> have both the
>> >> > git/bin and
>> >> > >> git/cmd
>> >> > >> >>> > directory in the PATH:
>> >> > >> >>> >
>> >> > >> >>> > [cid:ii_k97zkk9o0]
>> >> > >> >>> >
>> >> > >> >>> > What am I missing?
>> >> > >> >>> >
>> >> > >> >>> > Thanks,
>> >> > >> >>> > Om
>> >> > >> >>> >
>> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM
>> OmPrakash
>> >> Muppirala <
>> >> > >> >>> bigosmallm@gmail.com
>> >> > >> >>> > <ma...@gmail.com>>
>> wrote:
>> >> > >> >>> > Update - I have successfully
>> attached my VM as
>> >> a slave
>> >> > >> agent of our
>> >> > >> >>> > Jenkins instance.
>> >> > >> >>> > I am going to pull the job -
>> >> /royale-asjs_jsonly and
>> >> > tie it
>> >> > >> to my
>> >> > >> >>> agent so
>> >> > >> >>> > I can test it.
>> >> > >> >>> >
>> >> > >> >>> > It will fail for a sometime while I
>> go set up
>> >> my VM
>> >> > with
>> >> > >> all the
>> >> > >> >>> > dependencies.
>> >> > >> >>> >
>> >> > >> >>> > Once we have the job successfully
>> building on
>> >> my VM,
>> >> > we can
>> >> > >> figure
>> >> > >> >>> out how
>> >> > >> >>> > to divide the load between the
>> master and
>> >> agent.
>> >> > >> >>> >
>> >> > >> >>> > Thanks,
>> >> > >> >>> > Om
>> >> > >> >>> >
>> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM
>> OmPrakash
>> >> Muppirala <
>> >> > >> >>> bigosmallm@gmail.com
>> >> > >> >>> > <ma...@gmail.com>>
>> wrote:
>> >> > >> >>> > We could achieve the same by
>> creating a new
>> >> agent
>> >> > (separate
>> >> > >> vm) and
>> >> > >> >>> > attaching it as a slave to the
>> current Jenkins
>> >> server.
>> >> > >> >>> >
>> >> > >> >>> > Then we can use labels/tags to tie
>> release
>> >> jobs to one
>> >> > >> agent and
>> >> > >> >>> non
>> >> > >> >>> > release jobs to another agent.
>> >> > >> >>> >
>> >> > >> >>> > That way we can maintain everything
>> in one UI,
>> >> one
>> >> > login
>> >> > >> while
>> >> > >> >>> achieving
>> >> > >> >>> > the concurrent building
>> capabilities we want.
>> >> > >> >>> >
>> >> > >> >>> > Jenkins is built for this kind of
>> stuff and I
>> >> think it
>> >> > >> would be
>> >> > >> >>> best we
>> >> > >> >>> > followed this practice.
>> >> > >> >>> >
>> >> > >> >>> > Thanks,
>> >> > >> >>> > Om
>> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex
>> Harui
>> >> > >> <ah...@adobe.com.invalid>
>> >> > >> >>> wrote:
>> >> > >> >>> > Om, I thought you were going to get
>> the image
>> >> from my
>> >> > VM
>> >> > >> and run
>> >> > >> >>> it on
>> >> > >> >>> > another VM. Then we'd remove all
>> non-release
>> >> jobs
>> >> > from
>> >> > >> your VM
>> >> > >> >>> and all of
>> >> > >> >>> > the release jobs from my VM. That
>> won't solve
>> >> the
>> >> > problem
>> >> > >> of how
>> >> > >> >>> long it
>> >> > >> >>> > takes for a commit to be built and
>> tested, but
>> >> will
>> >> > allow
>> >> > >> the RM
>> >> > >> >>> to get a
>> >> > >> >>> > release out without getting stuck
>> behind the
>> >> commit
>> >> > jobs.
>> >> > >> Is that
>> >> > >> >>> > currently the plan?
>> >> > >> >>> >
>> >> > >> >>> > -Alex
>> >> > >> >>> >
>> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash
>> Muppirala" <
>> >> > >> bigosmallm@gmail.com
>> >> > >> >>> <mailto:
>> >> > >> >>> > bigosmallm@gmail.com>> wrote:
>> >> > >> >>> >
>> >> > >> >>> > Makes sense to me. I will set
>> parallel
>> >> executors
>> >> > back
>> >> > >> to 1.
>> >> > >> >>> >
>> >> > >> >>> > And start working on a new
>> Jenkins
>> >> instance.
>> >> > >> >>> >
>> >> > >> >>> > Thanks,
>> >> > >> >>> > Om
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM
>> Alex Harui
>> >> > >> >>> <ah...@adobe.com.invalid>
>> >> > >> >>> > wrote:
>> >> > >> >>> >
>> >> > >> >>> > > Are you saying that Java, Ant
>> and Maven
>> >> do not
>> >> > know
>> >> > >> how to
>> >> > >> >>> > distribute work
>> >> > >> >>> > > to different cores?
>> >> > >> >>> > >
>> >> > >> >>> > > To repeat my main concern:
>> our Jenkins
>> >> jobs
>> >> > often
>> >> > >> use shared
>> >> > >> >>> > resources.
>> >> > >> >>> > > If you want to take the time
>> to fix
>> >> that, feel
>> >> > free,
>> >> > >> but I
>> >> > >> >>> do not
>> >> > >> >>> > know how
>> >> > >> >>> > > you are going to keep two
>> jobs from both
>> >> trying
>> >> > to
>> >> > >> launch
>> >> > >> >>> Flash
>> >> > >> >>> > Player
>> >> > >> >>> > > Debugger at the same time and
>> open the
>> >> same
>> >> > socket to
>> >> > >> >>> communicate
>> >> > >> >>> > with it,
>> >> > >> >>> > > or try to parse the
>> flashlog.txt that
>> >> they have
>> >> > both
>> >> > >> written
>> >> > >> >>> to.
>> >> > >> >>> > >
>> >> > >> >>> > > The royale-asjs job will use
>> the
>> >> royale-compiler
>> >> > >> workspace
>> >> > >> >>> to get the
>> >> > >> >>> > > compiler. If the compiler is
>> building,
>> >> the
>> >> > jars are
>> >> > >> not
>> >> > >> >>> there and
>> >> > >> >>> > the
>> >> > >> >>> > > royale-asjs build fails.
>> >> > >> >>> > >
>> >> > >> >>> > > There is also only so much
>> memory and
>> >> some of
>> >> > our
>> >> > >> jobs use
>> >> > >> >>> all of it
>> >> > >> >>> > and
>> >> > >> >>> > > I'm not sure if jobs slowed
>> down due to
>> >> paging
>> >> > memory
>> >> > >> and
>> >> > >> >>> > writing/reading
>> >> > >> >>> > > from disk, even if it is an
>> SSD.
>> >> > >> >>> > >
>> >> > >> >>> > > I'm done for tonight, but
>> that's what I
>> >> was
>> >> > seeing
>> >> > >> last time
>> >> > >> >>> I tried
>> >> > >> >>> > to
>> >> > >> >>> > > have both master and an agent
>> running
>> >> jobs in
>> >> > >> parallel.
>> >> > >> >>> > >
>> >> > >> >>> > > Thanks,
>> >> > >> >>> > > -Alex
>> >> > >> >>> > >
>> >> > >> >>> > > On 4/17/20, 11:52 PM,
>> "OmPrakash
>> >> Muppirala" <
>> >> > >> >>> bigosmallm@gmail.com
>> >> > >> >>> > <ma...@gmail.com>>
>> wrote:
>> >> > >> >>> > >
>> >> > >> >>> > > A typical setup would be
>> to have 0
>> >> > executors on
>> >> > >> master
>> >> > >> >>> and at
>> >> > >> >>> > least n
>> >> > >> >>> > > number of executors on
>> each agent,
>> >> where n =
>> >> > >> number of
>> >> > >> >>> cpu cores.
>> >> > >> >>> > > I see that the current VM
>> has 2
>> >> cores. So,
>> >> > I
>> >> > >> started
>> >> > >> >>> with
>> >> > >> >>> > setting the
>> >> > >> >>> > > num
>> >> > >> >>> > > executors on the current
>> agent to 2.
>> >> > >> >>> > >
>> >> > >> >>> > > This should improve
>> things quite a
>> >> bit. If
>> >> > this
>> >> > >> doesn't
>> >> > >> >>> work, I
>> >> > >> >>> > will
>> >> > >> >>> > > create a new VM and make
>> it the
>> >> slave agent
>> >> > of the
>> >> > >> >>> current
>> >> > >> >>> > Jenkins
>> >> > >> >>> > > master.
>> >> > >> >>> > >
>> >> > >> >>> > >
>> >> > >> >>> > > Thanks,
>> >> > >> >>> > > Om
>> >> > >> >>> > >
>> >> > >> >>> > > On Fri, Apr 17, 2020 at
>> 11:31 PM
>> >> Alex Harui
>> >> > >> >>> > <ah...@adobe.com.invalid>
>> >> > >> >>> > > wrote:
>> >> > >> >>> > >
>> >> > >> >>> > > > On your VM or mine? I
>> don't think
>> >> mine
>> >> > can
>> >> > >> handle
>> >> > >> >>> it. I used
>> >> > >> >>> > to
>> >> > >> >>> > > run jobs
>> >> > >> >>> > > > of master and agent and
>> we got
>> >> lots of
>> >> > failures
>> >> > >> and
>> >> > >> >>> jobs took
>> >> > >> >>> > > forever. If
>> >> > >> >>> > > > two jobs are trying to
>> run tests
>> >> with the
>> >> > >> shared Flash
>> >> > >> >>> Player
>> >> > >> >>> > > Debugger, for
>> >> > >> >>> > > > example, you won't get
>> consistent
>> >> results.
>> >> > >> >>> > > >
>> >> > >> >>> > > > -Alex
>> >> > >> >>> > > >
>> >> > >> >>> > > > On 4/17/20, 11:23 PM,
>> "OmPrakash
>> >> > Muppirala" <
>> >> > >> >>> > bigosmallm@gmail.com<mailto:
>> >> bigosmallm@gmail.com>>
>> >> > >> >>> > > wrote:
>> >> > >> >>> > > >
>> >> > >> >>> > > > I just realized
>> that we have
>> >> only one
>> >> > Agent
>> >> > >> (node)
>> >> > >> >>> listed
>> >> > >> >>> > under
>> >> > >> >>> > > > Jenkins. I
>> >> > >> >>> > > > am going to add at
>> least one
>> >> more
>> >> > node to
>> >> > >> start
>> >> > >> >>> with.
>> >> > >> >>> > > >
>> >> > >> >>> > > > Thanks,
>> >> > >> >>> > > > Om
>> >> > >> >>> > > >
>> >> > >> >>> > > > On Thu, Apr 16,
>> 2020 at 9:58
>> >> AM Alex
>> >> > Harui
>> >> > >> >>> > > <ah...@adobe.com.invalid>
>> >> > >> >>> > > > wrote:
>> >> > >> >>> > > >
>> >> > >> >>> > > > > I think I
>> followed the
>> >> instructions
>> >> > and
>> >> > >> enabled
>> >> > >> >>> SSH.
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > On 4/16/20, 9:37
>> AM, "Yishay
>> >> Weiss"
>> >> > <
>> >> > >> >>> > yishayjobs@hotmail.com<mailto:
>> >> yishayjobs@hotmail.com
>> >> > >>
>> >> > >> >>> > > wrote:
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > I haven’t
>> gotten it to
>> >> work.
>> >> > Could be
>> >> > >> ssh
>> >> > >> >>> needs to be
>> >> > >> >>> > > enabled on
>> >> > >> >>> > > > the
>> >> > >> >>> > > > > VM [1]. This is
>> nice to have
>> >> but not
>> >> > >> essential.
>> >> > >> >>> So Alex,
>> >> > >> >>> > let
>> >> > >> >>> > > me know
>> >> > >> >>> > > > if you
>> >> > >> >>> > > > > want to try that,
>> otherwise
>> >> I’ll
>> >> > suspend
>> >> > >> my
>> >> > >> >>> efforts on
>> >> > >> >>> > this.
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > [1]
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=jSJ2d3k5CINKvWLZBZtymV641%2Fx%2BXnMnvLnThs74%2F%2Bo%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=jSJ2d3k5CINKvWLZBZtymV641%2Fx%2BXnMnvLnThs74%2F%2Bo%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > From: Yishay
>> >> Weiss<mailto:
>> >> > >> >>> yishayjobs@hotmail.com
>> >> > >> >>> > <ma...@hotmail.com>>
>> >> > >> >>> > > > > Sent:
>> Wednesday, April
>> >> 15, 2020
>> >> > 5:09
>> >> > >> PM
>> >> > >> >>> > > > > To:
>> >> dev@royale.apache.org
>> >> > <mailto:
>> >> > >> >>> > dev@royale.apache.org><mailto:
>> >> dev@royale.apache.org
>> >> > <mailto:
>> >> > >> >>> > dev@royale.apache.org>>
>> >> > >> >>> > > > > Subject: RE:
>> Prioritize
>> >> Release
>> >> > Jobs
>> >> > >> on CI
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > I’d like to
>> try and
>> >> install an
>> >> > ssh
>> >> > >> server.
>> >> > >> >>> Can anyone
>> >> > >> >>> > > think of a
>> >> > >> >>> > > > > reason not to do
>> that? I’m
>> >> asking in
>> >> > >> terms of
>> >> > >> >>> security,
>> >> > >> >>> > and if
>> >> > >> >>> > > there
>> >> > >> >>> > > > might
>> >> > >> >>> > > > > be a problem
>> because it’s a
>> >> VM.
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > Thanks.
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > From: Yishay
>> >> Weiss<mailto:
>> >> > >> >>> yishayjobs@hotmail.com
>> >> > >> >>> > <ma...@hotmail.com>>
>> >> > >> >>> > > > > Sent: Monday,
>> April 13,
>> >> 2020
>> >> > 10:02 AM
>> >> > >> >>> > > > > To:
>> >> dev@royale.apache.org
>> >> > <mailto:
>> >> > >> >>> > dev@royale.apache.org><mailto:
>> >> dev@royale.apache.org
>> >> > <mailto:
>> >> > >> >>> > dev@royale.apache.org>>
>> >> > >> >>> > > > > Subject: RE:
>> Prioritize
>> >> Release
>> >> > Jobs
>> >> > >> on CI
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > Related, as
>> most (all?)
>> >> of the
>> >> > >> instructions
>> >> > >> >>> don’t
>> >> > >> >>> > require
>> >> > >> >>> > > > anything but
>> >> > >> >>> > > > > a shell wouldn’t
>> it be
>> >> easier and
>> >> > faster
>> >> > >> to
>> >> > >> >>> access the
>> >> > >> >>> > machine
>> >> > >> >>> > > with
>> >> > >> >>> > > > ssh
>> >> > >> >>> > > > > [1], rather than
>> using remote
>> >> > desktop?
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > [1]
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=q31IZr4su8m1osIy5KdPVmA8ZZ88UWmfJ0qNl%2B%2B%2F63o%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=Pwl5XmRxqfdJi%2F5elh6A2hgNZTX2JFnandVf7TVtMzc%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > From: Yishay
>> >> Weiss<mailto:
>> >> > >> >>> yishayjobs@hotmail.com
>> >> > >> >>> > <ma...@hotmail.com>>
>> >> > >> >>> > > > > Sent: Monday,
>> April 13,
>> >> 2020
>> >> > 9:55 AM
>> >> > >> >>> > > > > To:
>> >> dev@royale.apache.org
>> >> > <mailto:
>> >> > >> >>> > dev@royale.apache.org><mailto:
>> >> dev@royale.apache.org
>> >> > <mailto:
>> >> > >> >>> > dev@royale.apache.org>>
>> >> > >> >>> > > > > Subject: RE:
>> Prioritize
>> >> Release
>> >> > Jobs
>> >> > >> on CI
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > Can’t you do
>> that with
>> >> remote
>> >> > desktop?
>> >> > >> >>> > > > >
>> >> > >> >>> > > > >
>> >> ________________________________
>> >> > >> >>> > > > > From:
>> OmPrakash
>> >> Muppirala <
>> >> > >> >>> bigosmallm@gmail.com
>> >> > >> >>> > <ma...@gmail.com>>
>> >> > >> >>> > > > > Sent: Monday,
>> April 13,
>> >> 2020
>> >> > 9:51:25
>> >> > >> AM
>> >> > >> >>> > > > > To: Apache
>> Royale
>> >> Development <
>> >> > >> >>> dev@royale.apache.org
>> >> > >> >>> > <ma...@royale.apache.org>>
>> >> > >> >>> > > > > Subject: Re:
>> Prioritize
>> >> Release
>> >> > Jobs
>> >> > >> on CI
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > Alex,
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > I believe
>> this is your
>> >> personal
>> >> > Azure
>> >> > >> >>> subscription
>> >> > >> >>> > right?
>> >> > >> >>> > > Any
>> >> > >> >>> > > > chance
>> >> > >> >>> > > > > I can
>> >> > >> >>> > > > > get access to
>> it so I
>> >> can try
>> >> > to copy
>> >> > >> the
>> >> > >> >>> image out
>> >> > >> >>> > the
>> >> > >> >>> > > machine
>> >> > >> >>> > > > and
>> >> > >> >>> > > > > redeploy it
>> somewhere
>> >> else?
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > Thanks,
>> >> > >> >>> > > > > Om
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > On Sun, Apr
>> 12, 2020 at
>> >> 6:18 PM
>> >> > >> OmPrakash
>> >> > >> >>> Muppirala <
>> >> > >> >>> > > > >
>> bigosmallm@gmail.com<mailto:
>> >> > >> bigosmallm@gmail.com
>> >> > >> >>> >>
>> >> > >> >>> > > > > wrote:
>> >> > >> >>> > > > >
>> >> > >> >>> > > > > > I can help
>> set this up
>> >> on
>> >> > Azure.
>> >> > >> Give me
>> >> > >> >>> some
>> >> > >> >>> > time to
>> >> > >> >>> > > work
>> >> > >> >>> > > > out the
>> >> > >> >>> > > > > > details?
>> >> > >> >>> > > > > >
>> >> > >> >>> > > > > > Thanks,
>> >> > >> >>> > > > > > Om
>> >> > >> >>> > > > > >
>> >> > >> >>> > > > > > On Sun, Apr
>> 12, 2020,
>> >> 11:49 AM
>> >> > >> Harbs <
>> >> > >> >>> > > harbs.lists@gmail.com<mailto:
>> >> > harbs.lists@gmail.com>>
>> >> > >> >>> > > > wrote:
>> >> > >> >>> > > > > >
>> >> > >> >>> > > > > >> OK. Good
>> to know.
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > > >> > On Apr
>> 12, 2020, at
>> >> 9:45
>> >> > PM,
>> >> > >> Alex Harui
>> >> > >> >>> > > >
>> <aharui@adobe.com.INVALID
>> >> > >> >>> > > > > >
>> >> > >> >>> > > > > >> wrote:
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > FWIW, I
>> just looked
>> >> and the
>> >> > >> longest job
>> >> > >> >>> in the
>> >> > >> >>> > release
>> >> > >> >>> > > > steps so
>> >> > >> >>> > > > > far is
>> >> > >> >>> > > > > >> 8
>> minutes. Most are
>> >> under 2
>> >> > >> minutes.
>> >> > >> >>> There
>> >> > >> >>> > might be
>> >> > >> >>> > > jobs
>> >> > >> >>> > > > later
>> >> > >> >>> > > > > that take
>> >> > >> >>> > > > > >> longer
>> that we
>> >> haven't run
>> >> > yet.
>> >> > >> IMO, the
>> >> > >> >>> issue
>> >> > >> >>> > isn't
>> >> > >> >>> > > speed
>> >> > >> >>> > > > of the
>> >> > >> >>> > > > > machine,
>> >> > >> >>> > > > > >> it is just
>> that we are
>> >> > sharing the
>> >> > >> >>> machine with
>> >> > >> >>> > longer
>> >> > >> >>> > > jobs
>> >> > >> >>> > > > (1 hour
>> >> > >> >>> > > > > for
>> >> > >> >>> > > > > >>
>> >> TourDeFlexMigration). And
>> >> > again,
>> >> > >> the
>> >> > >> >>> machine
>> >> > >> >>> > will be
>> >> > >> >>> > > idle for
>> >> > >> >>> > > > > stretches of
>> >> > >> >>> > > > > >> time while
>> the RM
>> >> verifies
>> >> > >> artifacts
>> >> > >> >>> after each
>> >> > >> >>> > step.
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > -Alex
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > On
>> 4/12/20, 11:32
>> >> AM,
>> >> > "Harbs" <
>> >> > >> >>> > harbs.lists@gmail.com<mailto:
>> >> harbs.lists@gmail.com>
>> >> > >> >>> > > > <mailto:
>> >> > >> >>> > > > > >>
>> harbs.lists@gmail.com
>> >> > <mailto:
>> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > Fair
>> enough.
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > I
>> expect builds
>> >> to be
>> >> > >> somewhere
>> >> > >> >>> between 10
>> >> > >> >>> > and 20
>> >> > >> >>> > > times
>> >> > >> >>> > > > faster
>> >> > >> >>> > > > > on a
>> >> > >> >>> > > > > >> powerful
>> machine.
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > Yeah.
>> It’s
>> >> probably
>> >> > going to
>> >> > >> be a
>> >> > >> >>> bit of work
>> >> > >> >>> > > changing
>> >> > >> >>> > > > the
>> >> > >> >>> > > > > server,
>> >> > >> >>> > > > > >> but
>> probably worth it
>> >> in the
>> >> > long
>> >> > >> run.
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> > I
>> think I’ll try
>> >> this
>> >> > when I
>> >> > >> do the
>> >> > >> >>> next
>> >> > >> >>> > release
>> >> > >> >>> > > unless
>> >> > >> >>> > > > Yishay
>> >> > >> >>> > > > > wants
>> >> > >> >>> > > > > >> to work
>> with me on
>> >> this for
>> >> > this
>> >> > >> release
>> >> > >> >>> — but
>> >> > >> >>> > I’m not
>> >> > >> >>> > > going
>> >> > >> >>> > > > to be
>> >> > >> >>> > > > > able to
>> >> > >> >>> > > > > >> help until
>> after
>> >> Passover
>> >> > (i.e.
>> >> > >> next
>> >> > >> >>> week).
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> >
>> Thanks,
>> >> > >> >>> > > > > >> > Harbs
>> >> > >> >>> > > > > >> >
>> >> > >> >>> > > > > >> >> On Apr
>> 12, 2020,
>> >> at 9:22
>> >> > PM,
>> >> > >> Alex Harui
>> >> > >> >>> > > >
>> <aharui@adobe.com.INVALID
>> >> > >> >>> > > > > >
>> >> > >> >>> > > > > >> wrote:
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> The
>> Azure portal
>> >> says:
>> >> > Standard
>> >> > >> F2s_v2
>> >> > >> >>> (2
>> >> > >> >>> > vcpus, 4
>> >> > >> >>> > > GiB
>> >> > >> >>> > > > memory)
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> I think
>> I am
>> >> reading
>> >> > changes to
>> >> > >> the
>> >> > >> >>> build
>> >> > >> >>> > process in
>> >> > >> >>> > > your
>> >> > >> >>> > > > > >>
>> suggestions. I do not
>> >> > really want
>> >> > >> to
>> >> > >> >>> spend more
>> >> > >> >>> > of my
>> >> > >> >>> > > time
>> >> > >> >>> > > > on this
>> >> > >> >>> > > > > >> process.
>> But if you
>> >> want to
>> >> > do
>> >> > >> the work,
>> >> > >> >>> that's
>> >> > >> >>> > fine
>> >> > >> >>> > > with me.
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> -Alex
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> On
>> 4/12/20, 10:57
>> >> AM,
>> >> > "Harbs" <
>> >> > >> >>> > harbs.lists@gmail.com<mailto:
>> >> harbs.lists@gmail.com>
>> >> > >> >>> > > > <mailto:
>> >> > >> >>> > > > > >>
>> harbs.lists@gmail.com
>> >> > <mailto:
>> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
>> >> harbs.lists@gmail.com
>> >> > >> <mailto:
>> >> > >> >>> > harbs.lists@gmail.com>
>> >> > >> >>> > > <mailto:
>> >> > >> >>> > > > > >>
>> harbs.lists@gmail.com
>> >> > <mailto:
>> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> What
>> kind of
>> >> horsepower
>> >> > is
>> >> > >> included
>> >> > >> >>> in the
>> >> > >> >>> > free
>> >> > >> >>> > > Azure
>> >> > >> >>> > > > account?
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> The
>> server I
>> >> mentioned
>> >> > builds
>> >> > >> >>> (considerably)
>> >> > >> >>> > > faster than
>> >> > >> >>> > > > my own
>> >> > >> >>> > > > > >> local
>> machine. The ci
>> >> server
>> >> > seems
>> >> > >> to
>> >> > >> >>> build many
>> >> > >> >>> > times
>> >> > >> >>> > > slower.
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >> One
>> thing we can
>> >> do to
>> >> > >> minimize
>> >> > >> >>> running
>> >> > >> >>> > server time
>> >> > >> >>> > > > would be to
>> >> > >> >>> > > > > >> transfer
>> the
>> >> artifacts to
>> >> > storage
>> >> > >> instead
>> >> > >> >>> of
>> >> > >> >>> > keeping
>> >> > >> >>> > > them on
>> >> > >> >>> > > > the
>> >> > >> >>> > > > > server. On
>> >> > >> >>> > > > > >> AWS, I’d
>> probably use
>> >> S3.
>> >> > Not sure
>> >> > >> what
>> >> > >> >>> the
>> >> > >> >>> > similar
>> >> > >> >>> > > service on
>> >> > >> >>> > > > > Azure is
>> >> > >> >>> > > > > >> called.
>> >> > >> >>> > > > > >> >>
>> >> > >> >>> > > > > >> >>> On Apr
>> 12, 2020,
>> >> at 8:26
>> >> > PM,
>> >> > >> Alex
>> >> > >> >>> Harui
>> >> > >> >>> > > > >
>> <aharui@adobe.com.INVALID
>> >> > >> >>> > > > > >> <mailto:
>> >> > aharui@adobe.com.INVALID
>> >> > >> <mailto:
>> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> OK,
>> that's pretty
>> >> much
>> >> > how I
>> >> > >> >>> understand Azure
>> >> > >> >>> > as
>> >> > >> >>> > > well.
>> >> > >> >>> > > > The key
>> >> > >> >>> > > > > thing
>> >> > >> >>> > > > > >> is that
>> "running"
>> >> includes
>> >> > time
>> >> > >> where the
>> >> > >> >>> CI
>> >> > >> >>> > server is
>> >> > >> >>> > > not
>> >> > >> >>> > > > running
>> >> > >> >>> > > > > any
>> >> > >> >>> > > > > >> Jenkins
>> jobs. The CI
>> >> Server
>> >> > steps
>> >> > >> might
>> >> > >> >>> take
>> >> > >> >>> > only a few
>> >> > >> >>> > > > hours of
>> >> > >> >>> > > > > actual
>> >> > >> >>> > > > > >> server
>> time, but
>> >> there is
>> >> > time
>> >> > >> where the
>> >> > >> >>> RM is
>> >> > >> >>> > verifying
>> >> > >> >>> > > > artifacts
>> >> > >> >>> > > > > locally
>> >> > >> >>> > > > > >> so you'd
>> be paying
>> >> for that
>> >> > or the
>> >> > >> RM
>> >> > >> >>> would have
>> >> > >> >>> > to keep
>> >> > >> >>> > > > shutting
>> >> > >> >>> > > > > down and
>> >> > >> >>> > > > > >> restarting.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> Seems
>> like it
>> >> would be
>> >> > >> >>> cheaper/simpler to get
>> >> > >> >>> > the
>> >> > >> >>> > > free
>> >> > >> >>> > > > MSDN
>> >> > >> >>> > > > > account
>> >> > >> >>> > > > > >> and leave
>> it running.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> -Alex
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> On
>> 4/12/20, 10:15
>> >> AM,
>> >> > "Harbs" <
>> >> > >> >>> > > harbs.lists@gmail.com<mailto:
>> >> > harbs.lists@gmail.com>
>> >> > >> >>> > > > <mailto:
>> >> > >> >>> > > > > >>
>> harbs.lists@gmail.com
>> >> > <mailto:
>> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> My
>> experience is
>> >> with
>> >> > AWS.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> I
>> assume
>> >> Microsoft has
>> >> > similar
>> >> > >> >>> offerings,
>> >> > >> >>> > but I
>> >> > >> >>> > > don’t
>> >> > >> >>> > > > have
>> >> > >> >>> > > > > >> experience
>> with Azure.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> AWS
>> has
>> >> on-demand EC2
>> >> > >> instances
>> >> > >> >>> which you
>> >> > >> >>> > pay for
>> >> > >> >>> > > only
>> >> > >> >>> > > > the
>> >> > >> >>> > > > > actual
>> >> > >> >>> > > > > >> time that
>> they are
>> >> > running.[1]
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>>
>> Instances can be
>> >> > started and
>> >> > >> stopped
>> >> > >> >>> via
>> >> > >> >>> > command
>> >> > >> >>> > > line
>> >> > >> >>> > > > (or via
>> >> > >> >>> > > > > the
>> >> > >> >>> > > > > >> web
>> interface) as
>> >> long as
>> >> > you have
>> >> > >> valid
>> >> > >> >>> > credentials to
>> >> > >> >>> > > do so.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> For
>> example: an
>> >> > m5.4xlarge
>> >> > >> instance
>> >> > >> >>> has 16
>> >> > >> >>> > cores
>> >> > >> >>> > > and
>> >> > >> >>> > > > costs
>> >> > >> >>> > > > > about
>> >> > >> >>> > > > > >> $1.5 per
>> hour. On a
>> >> machine
>> >> > like
>> >> > >> that, a
>> >> > >> >>> full
>> >> > >> >>> > build
>> >> > >> >>> > > would
>> >> > >> >>> > > > probably
>> >> > >> >>> > > > > take
>> >> > >> >>> > > > > >> less than
>> 10 minutes.
>> >> It’s
>> >> > probably
>> >> > >> >>> possible to
>> >> > >> >>> > do a
>> >> > >> >>> > > full
>> >> > >> >>> > > > release
>> >> > >> >>> > > > > with only
>> >> > >> >>> > > > > >> a few
>> hours of server
>> >> time.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>>
>> Leaving a server
>> >> like
>> >> > that
>> >> > >> running
>> >> > >> >>> all the
>> >> > >> >>> > time
>> >> > >> >>> > > would get
>> >> > >> >>> > > > > expensive,
>> >> > >> >>> > > > > >> but if
>> it’s just spun
>> >> up for
>> >> > >> releases,
>> >> > >> >>> you’d get
>> >> > >> >>> > very
>> >> > >> >>> > > fast
>> >> > >> >>> > > > builds
>> >> > >> >>> > > > > at a
>> >> > >> >>> > > > > >> reasonable
>> price.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> I’d
>> be happy to
>> >> pay
>> >> > $10-$50
>> >> > >> (and
>> >> > >> >>> possibly
>> >> > >> >>> > more) per
>> >> > >> >>> > > > release to
>> >> > >> >>> > > > > make
>> >> > >> >>> > > > > >> the
>> release process
>> >> painless
>> >> > for
>> >> > >> the RM.
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>> [1]
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> <
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> ><
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> <
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> >><
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> <
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> ><
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> <
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > <
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >>
>> >> >
>> >>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> >> > >> >>> > >
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>>
>> >> > >> >>> > > > > >> >>>> On
>> Apr 12, 2020,
>> >> at
>> >> > 7:45 PM,
>> >> > >> Alex
>> >> > >> >>> Harui
>> >> > >> >>> > > > >
>> <ah...@adobe.com.INVALID>
>> >> > >> >>> > > > > >> wrote:
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> I'm
>> not very
>> >> > experienced with
>> >> > >> >>> spinning up
>> >> > >> >>> > > servers. The
>> >> > >> >>> > > > CI
>> >> > >> >>> > > > > server we
>> >> > >> >>> > > > > >> are using
>> is
>> >> effectively
>> >> > free,
>> >> > >> based on a
>> >> > >> >>> generous
>> >> > >> >>> > > donation
>> >> > >> >>> > > > from
>> >> > >> >>> > > > > Microsoft
>> >> > >> >>> > > > > >> of MSDN
>> accounts to
>> >> ASF
>> >> > >> committers. So I
>> >> > >> >>> leave
>> >> > >> >>> > it up
>> >> > >> >>> > > 24/7,
>> >> > >> >>> > > > and
>> >> > >> >>> > > > > share the
>> >> > >> >>> > > > > >> RDP access
>> on private@.
>> >> I
>> >> > think
>> >> > >> any
>> >> > >> >>> other ASF
>> >> > >> >>> > > committer
>> >> > >> >>> > > > could do
>> >> > >> >>> > > > > the
>> >> > >> >>> > > > > >> same.
>> IIRC, if that
>> >> server
>> >> > >> actually is
>> >> > >> >>> stopped,
>> >> > >> >>> > I have
>> >> > >> >>> > > to
>> >> > >> >>> > > > use my
>> >> > >> >>> > > > > personal
>> >> > >> >>> > > > > >> (unshared)
>> MSDN
>> >> credentials
>> >> > to
>> >> > >> start it
>> >> > >> >>> again.
>> >> > >> >>> > AIUI,
>> >> > >> >>> > > if I
>> >> > >> >>> > > > > actually paid
>> >> > >> >>> > > > > >> for the
>> server, it
>> >> would
>> >> > cost me
>> >> > >> to leave
>> >> > >> >>> it
>> >> > >> >>> > running
>> >> > >> >>> > > even if
>> >> > >> >>> > > > it
>> >> > >> >>> > > > > didn't run
>> >> > >> >>> > > > > >> jobs
>> between releases.
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> Is
>> that what you
>> >> are
>> >> > basically
>> >> > >> >>> saying? I
>> >> > >> >>> > think it
>> >> > >> >>> > > might
>> >> > >> >>> > > > be
>> >> > >> >>> > > > > best if
>> >> > >> >>> > > > > >> another
>> committer got
>> >> a CI
>> >> > server
>> >> > >> going
>> >> > >> >>> via the MS
>> >> > >> >>> > > donation
>> >> > >> >>> > > > and
>> >> > >> >>> > > > > could leave
>> >> > >> >>> > > > > >> it up 24/7.
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> -Alex
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> On
>> 4/12/20, 9:28
>> >> AM,
>> >> > "Harbs" <
>> >> > >> >>> > > harbs.lists@gmail.com<mailto:
>> >> > harbs.lists@gmail.com>>
>> >> > >> >>> > > > wrote:
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> I’m
>> willing to
>> >> do this.
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>>
>> Considering that
>> >> the
>> >> > release
>> >> > >> will be
>> >> > >> >>> run
>> >> > >> >>> > > infrequently, it
>> >> > >> >>> > > > > should be
>> >> > >> >>> > > > > >> doable to
>> have a
>> >> relatively
>> >> > >> powerful
>> >> > >> >>> server that
>> >> > >> >>> > could
>> >> > >> >>> > > be
>> >> > >> >>> > > > spun up on
>> >> > >> >>> > > > > >> demand.
>> This is
>> >> something I
>> >> > have
>> >> > >> setup
>> >> > >> >>> for my own
>> >> > >> >>> > > releases.
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> The
>> only
>> >> complication
>> >> > would
>> >> > >> be that
>> >> > >> >>> each RM
>> >> > >> >>> > would
>> >> > >> >>> > > need
>> >> > >> >>> > > > valid
>> >> > >> >>> > > > > >>
>> credentials to spin
>> >> up the
>> >> > server.
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>> Harbs
>> >> > >> >>> > > > > >> >>>>
>> >> > >> >>> > > > > >> >>>>> On
>> Apr 12,
>> >> 2020, at
>> >> > 7:10 PM,
>> >> > >> Alex
>> >> > >> >>> Harui
>> >> > >> >>> > > > >
>> <ah...@adobe.com.INVALID>
>> >> > >> >>> > > > > >> wrote:
>> >> > >> >>> > > > > >> >>>>>
>> >> > >> >>> > > > > >> >>>>> A
>> better
>> >> solution,
>> >> > IMO, is
>> >> > >> for
>> >> > >> >>> someone else
>> >> > >> >>> > to
>> >> > >> >>> > > offer up
>> >> > >> >>> > > > a CI
>> >> > >> >>> > > > > server
>> >> > >> >>> > > > > >> only for
>> release jobs.
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > > >>
>> >> > >> >>> > > > >
>> >> > >> >>> > > > >
>> >> > >> >>> > > > >
>> >> > >> >>> > > > >
>> >> > >> >>> > > >
>> >> > >> >>> > > >
>> >> > >> >>> > > >
>> >> > >> >>> > >
>> >> > >> >>> > >
>> >> > >> >>> > >
>> >> > >> >>> >
>> >> > >> >>> >
>> >> > >> >>>
>> >> > >> >>>
>> >> > >> >>>
>> >> > >>
>> >> > >>
>> >> > >>
>> >> >
>> >> >
>> >> >
>> >>
>> >>
>> >>
>>
>>
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
I see. I was waiting for the build to be fixed before moving it over. Or
have folks run into a dead-end trying to figure out what is wrong with
royale-asjs ?
On Mon, Apr 20, 2020 at 11:03 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Also, once royale-asjs completes, it is going to kick off lots of other
> jobs on agent 1 that will compete with the release jobs. Ideally, all
> non-release jobs would be moved over to the new agent VM.
>
> -Alex
>
> On 4/20/20, 10:55 PM, "Alex Harui" <ah...@adobe.com.INVALID> wrote:
>
> Yes, royale-asjs (which is currently building on agent1 and blocking
> the release job).
>
> -Alex
>
> On 4/20/20, 10:53 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> wrote:
>
> Update - royale-asjs_jsonly successfully build on my agent VM.
>
> Right now, we have 3 jobs running on this VM:
> 1. royale-asjs_jsonly
> 2. royale-compiler
> 3. royale-typedefs
>
> Are there any other jobs we need to move to the new agent?
>
> Yishay, can you please confirm that your release jobs are running
> without
> being hindered by CI jobs?
>
> Thanks,
> Om
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on
> my VM. If
> >> you are talking about your VM, you can compare console output
> from recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem.
> Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an
> example of shared
> >> > resources that I mentioned upthread. Royale-typedefs is
> going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a
> built of
> >> > royale-compiler in it. If royale-compiler fails to
> create all of
> >> its
> >> > binaries or is in the process of building them,
> royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126971265&sdata=QPt6lvVwPBgoVhmAg8%2B%2FeiBxjq9%2FHYLreIG2brTGfuE%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful,
> but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls
> down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've
> never found
> >> enough
> >> > time and energy to try to make changes like that since
> most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com>
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD
> FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91:
> src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=CgDdnMTfn3BVaF5eLt%2BX4rAX3gdpsb4MPT4jR97aLB8%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that
> JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that
> might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE
> instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still
> thinks that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the
> jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the
> royale-compiler on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash
> Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply
> made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file
> jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs
> main && exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find
> it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this
> issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash
> Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you
> checked what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can
> sometimes be a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be
> running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash
> Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex
> Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=wmUYQ8yANnUuo4i%2F7FXqjsPwQzd4bL%2Bh4gUoR3xa%2BIA%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact
> location as
> >> master.
> >> > >> >>> Moreover, the git call from the
> commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37
> PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs
> on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The
> royale-compiler is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run
> program "git"
> >> (in
> >> > directory
> >> > >> >>> >
> "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at
> java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the
> jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target
> name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient.
> This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=aaSDpyVpWdqmVar4s8SJuKUDYRzuhwQ8J6%2BZCcpO56c%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=aaSDpyVpWdqmVar4s8SJuKUDYRzuhwQ8J6%2BZCcpO56c%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg
> value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of
> Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable
> call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do
> have both the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM
> OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> wrote:
> >> > >> >>> > Update - I have successfully
> attached my VM as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I
> go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully
> building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the
> master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM
> OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> wrote:
> >> > >> >>> > We could achieve the same by
> creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the
> current Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie
> release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything
> in one UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities
> we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of
> stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex
> Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get
> the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all
> non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That
> won't solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and
> tested, but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck
> behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash
> Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set
> parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new
> Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM
> Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant
> and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern:
> our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time
> to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs
> from both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and
> open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the
> flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use
> the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is
> building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much
> memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed
> down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an
> SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but
> that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent
> running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM,
> "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be
> to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on
> each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM
> has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current
> agent to 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things
> quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make
> it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at
> 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I
> don't think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and
> we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to
> run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get
> consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM,
> "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that
> we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at
> least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020
> at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed
> the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37
> AM, "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t
> gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is
> nice to have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that,
> otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=jSJ2d3k5CINKvWLZBZtymV641%2Fx%2BXnMnvLnThs74%2F%2Bo%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=jSJ2d3k5CINKvWLZBZtymV641%2Fx%2BXnMnvLnThs74%2F%2Bo%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent:
> Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to
> try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do
> that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem
> because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday,
> April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as
> most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t
> it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than
> using remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=q31IZr4su8m1osIy5KdPVmA8ZZ88UWmfJ0qNl%2B%2B%2F63o%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=Pwl5XmRxqfdJi%2F5elh6A2hgNZTX2JFnandVf7TVtMzc%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday,
> April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do
> that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday,
> April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache
> Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re:
> Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this
> is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to
> it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it
> somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr
> 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > >
> bigosmallm@gmail.com<mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help
> set this up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr
> 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to
> know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr
> 12, 2020, at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I
> just looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes.
> Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that
> we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just
> that we are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while
> the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On
> 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair
> enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I
> expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful
> machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah.
> It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but
> probably worth it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I
> think I’ll try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work
> with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until
> after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr
> 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The
> Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think
> I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >>
> suggestions. I do not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process.
> But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On
> 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What
> kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The
> server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local
> machine. The ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One
> thing we can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d
> probably use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr
> 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > >
> <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK,
> that's pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that
> "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins
> jobs. The CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server
> time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be
> paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems
> like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave
> it running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On
> 4/12/20, 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My
> experience is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I
> assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience
> with Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that
> they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> Instances can be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web
> interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For
> example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per
> hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than
> 10 minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours
> of server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> Leaving a server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s
> just spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable
> price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be
> happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release
> process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr
> 12, 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > >
> <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm
> not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN
> accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access
> on private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same.
> IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared)
> MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the
> server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs
> between releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is
> that what you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another
> committer got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On
> 4/12/20, 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m
> willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>
> Considering that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to
> have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand.
> This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The
> only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials
> to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On
> Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > >
> <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A
> better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for
> release jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Also, once royale-asjs completes, it is going to kick off lots of other jobs on agent 1 that will compete with the release jobs. Ideally, all non-release jobs would be moved over to the new agent VM.
-Alex
On 4/20/20, 10:55 PM, "Alex Harui" <ah...@adobe.com.INVALID> wrote:
Yes, royale-asjs (which is currently building on agent1 and blocking the release job).
-Alex
On 4/20/20, 10:53 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
Update - royale-asjs_jsonly successfully build on my agent VM.
Right now, we have 3 jobs running on this VM:
1. royale-asjs_jsonly
2. royale-compiler
3. royale-typedefs
Are there any other jobs we need to move to the new agent?
Yishay, can you please confirm that your release jobs are running without
being hindered by CI jobs?
Thanks,
Om
On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bi...@gmail.com>
wrote:
>
> On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
>> you are talking about your VM, you can compare console output from recent
>> successful builds on both VMs.
>>
>>
> I was talking about my VM.
> A rebuild of royale-compiler seems to have fixed that problem. Now
> royale-typedefs passes as well!
>
> Next up royale-asjs_jsonly...
>
>
>> I'm done for tonight. Good luck,
>> -Alex
>>
>> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <aharui@adobe.com.invalid
>> >
>> wrote:
>>
>> > Royale-compiler has to be built first. This is an example of shared
>> > resources that I mentioned upthread. Royale-typedefs is going to
>> look for
>> > a sibling workspace folder called royale-compiler with a built of
>> > royale-compiler in it. If royale-compiler fails to create all of
>> its
>> > binaries or is in the process of building them, royale-typedefs
>> will report
>> > an error.
>> >
>>
>> Got it. I was just looking at the logic here:
>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126971265&sdata=QPt6lvVwPBgoVhmAg8%2B%2FeiBxjq9%2FHYLreIG2brTGfuE%3D&reserved=0
>>
>> Weird. The royale-compiler build says it was successful, but I cant
>> find
>> the lib directory under
>> C:\jenkins\workspace\royale-compiler\compiler-jx
>>
>>
>>
>>
>> >
>> > What should probably happen is that royale-typedefs pulls down the
>> > lastsuccessfulartifacts from royale-compiler, but I've never found
>> enough
>> > time and energy to try to make changes like that since most of us
>> do have
>> > all of the folders as siblings.
>> >
>> > HTH,
>> > -Alex
>> >
>> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>> >
>> > I am now getting this error on royale-typedefs build:
>> >
>> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
>> The
>> > following error occurred while executing this line:
>> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>> >
>> >
>> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
>> > doesn't exist.
>> >
>> >
>> > Where does the ROYALE_TRANSPILER_HOME var come from?
>> >
>> > Here is the full console output:
>> >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=CgDdnMTfn3BVaF5eLt%2BX4rAX3gdpsb4MPT4jR97aLB8%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>> >
>> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
>> > bigosmallm@gmail.com>
>> > wrote:
>> >
>> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
>> <aharui@adobe.com.invalid
>> > >
>> > > wrote:
>> > >
>> > >> Congratulations! But does that mean that JAVA_HOME is
>> pointing at
>> > a JRE
>> > >> instead of a JDK? If you have other issues that might be a
>> factor.
>> > >>
>> > >
>> > > Yeah, I messed up initially by getting the JRE instead of
>> JDK. I
>> > have
>> > > since corrected it. But for some reason Ant still thinks that
>> > JAVA_HOME is
>> > > the jre directory.
>> > > I don't know how to fix this, hence the hack :-|
>> > >
>> > >
>> > >
>> > >
>> > >>
>> > >> HTH,
>> > >> -Alex
>> > >>
>> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> I copied tools.jar from jdk/lib to the jre/lib. That
>> seems to
>> > have
>> > >> fixed
>> > >> the issue.
>> > >> We now have a successful build of the royale-compiler on
>> the
>> > new Agent
>> > >> machine!!
>> > >>
>> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > Restart dint help. Although Serkan's reply made me
>> look at
>> > how Ant
>> > >> was
>> > >> > getting invoked.
>> > >> >
>> > >> > I see this warning that tools.jar is missing:
>> > >> >
>> > >> > [royale-compiler] $ cmd.exe /C
>> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
>> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
>> > >> %%ERRORLEVEL%%"
>> > >> >
>> > >> > Unable to locate tools.jar. Expected to find it in
>> C:\Program
>> > >> Files\Java\jre1.8.0_251\lib\tools.jar
>> > >> >
>> > >> >
>> > >> > I am pretty sure this is related to this issue.
>> > >> >
>> > >> >
>> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> > wrote:
>> > >> >
>> > >> >>
>> > >> >>
>> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >> wrote:
>> > >> >>
>> > >> >>> Did you reboot your VM? Also, have you checked what
>> user is
>> > >> running
>> > >> >>> Jenkins on your VM? I think that can sometimes be a
>> > problem. I
>> > >> might be
>> > >> >>> running Jenkins as the user.
>> > >> >>>
>> > >> >>>
>> > >> >> Agents don't require Jenkins to be running. I will
>> give the
>> > >> rebooting of
>> > >> >> the VM a shot .
>> > >> >>
>> > >> >> Thanks,
>> > >> >> Om
>> > >> >>
>> > >> >>
>> > >> >>> -Alex
>> > >> >>>
>> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
>> > bigosmallm@gmail.com
>> > >> >
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> > Should be here:
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=wmUYQ8yANnUuo4i%2F7FXqjsPwQzd4bL%2Bh4gUoR3xa%2BIA%3D&reserved=0
>> > >> >>>
>> > >> >>>
>> > >> >>> My git is located in the same exact location as
>> master.
>> > >> >>> Moreover, the git call from the commandline
>> executes
>> > fine.
>> > >> The git
>> > >> >>> call
>> > >> >>> from ant exec is what is failing.
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > HTH,
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > From: OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> > >> >>> > Reply-To: "dev@royale.apache.org" <
>> > dev@royale.apache.org>
>> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> > >> >>> > To: Apache Royale Development <
>> dev@royale.apache.org>
>> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
>> > >> >>> >
>> > >> >>> > I'm a bit stumped here. The royale-compiler is
>> > failing
>> > >> with this
>> > >> >>> error:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > BUILD FAILED
>> > >> >>> >
>> > >> >>> >
>> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
>> > Execute
>> > >> >>> failed:
>> > >> >>> > java.io.IOException: Cannot run program "git"
>> (in
>> > directory
>> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
>> CreateProcess
>> > >> error=2,
>> > >> >>> The system
>> > >> >>> > cannot find the file specified
>> > >> >>> >
>> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
>> Source)
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > It is from this part of the jenkins.xml:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > <target name="closure-lib-download"
>> > description="Copies
>> > >> Closure
>> > >> >>> > Library from GitHub">
>> > >> >>> > <echo message="Be patient. This takes
>> a few
>> > >> minutes..." />
>> > >> >>> > <exec executable="git"
>> > failifexecutionfails="true">
>> > >> >>> > <arg value="clone" />
>> > >> >>> > <arg value="
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=aaSDpyVpWdqmVar4s8SJuKUDYRzuhwQ8J6%2BZCcpO56c%3D&reserved=0
>> > >> >>> <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=aaSDpyVpWdqmVar4s8SJuKUDYRzuhwQ8J6%2BZCcpO56c%3D&reserved=0
>> > >> >>> >"
>> > >> >>> > />
>> > >> >>> > <arg value="${closure.root}" />
>> > >> >>> > </exec>
>> > >> >>> > <echo>Cloned fresh copy of Google
>> Closure
>> > >> Library</echo>
>> > >> >>> > </target>
>> > >> >>> >
>> > >> >>> > I am not sure how this executable call works
>> without
>> > the
>> > >> full path.
>> > >> >>> >
>> > >> >>> > I checked the env variables, I do have both the
>> > git/bin and
>> > >> git/cmd
>> > >> >>> > directory in the PATH:
>> > >> >>> >
>> > >> >>> > [cid:ii_k97zkk9o0]
>> > >> >>> >
>> > >> >>> > What am I missing?
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > Update - I have successfully attached my VM as
>> a slave
>> > >> agent of our
>> > >> >>> > Jenkins instance.
>> > >> >>> > I am going to pull the job -
>> /royale-asjs_jsonly and
>> > tie it
>> > >> to my
>> > >> >>> agent so
>> > >> >>> > I can test it.
>> > >> >>> >
>> > >> >>> > It will fail for a sometime while I go set up
>> my VM
>> > with
>> > >> all the
>> > >> >>> > dependencies.
>> > >> >>> >
>> > >> >>> > Once we have the job successfully building on
>> my VM,
>> > we can
>> > >> figure
>> > >> >>> out how
>> > >> >>> > to divide the load between the master and
>> agent.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > We could achieve the same by creating a new
>> agent
>> > (separate
>> > >> vm) and
>> > >> >>> > attaching it as a slave to the current Jenkins
>> server.
>> > >> >>> >
>> > >> >>> > Then we can use labels/tags to tie release
>> jobs to one
>> > >> agent and
>> > >> >>> non
>> > >> >>> > release jobs to another agent.
>> > >> >>> >
>> > >> >>> > That way we can maintain everything in one UI,
>> one
>> > login
>> > >> while
>> > >> >>> achieving
>> > >> >>> > the concurrent building capabilities we want.
>> > >> >>> >
>> > >> >>> > Jenkins is built for this kind of stuff and I
>> think it
>> > >> would be
>> > >> >>> best we
>> > >> >>> > followed this practice.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>> > Om, I thought you were going to get the image
>> from my
>> > VM
>> > >> and run
>> > >> >>> it on
>> > >> >>> > another VM. Then we'd remove all non-release
>> jobs
>> > from
>> > >> your VM
>> > >> >>> and all of
>> > >> >>> > the release jobs from my VM. That won't solve
>> the
>> > problem
>> > >> of how
>> > >> >>> long it
>> > >> >>> > takes for a commit to be built and tested, but
>> will
>> > allow
>> > >> the RM
>> > >> >>> to get a
>> > >> >>> > release out without getting stuck behind the
>> commit
>> > jobs.
>> > >> Is that
>> > >> >>> > currently the plan?
>> > >> >>> >
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
>> > >> bigosmallm@gmail.com
>> > >> >>> <mailto:
>> > >> >>> > bigosmallm@gmail.com>> wrote:
>> > >> >>> >
>> > >> >>> > Makes sense to me. I will set parallel
>> executors
>> > back
>> > >> to 1.
>> > >> >>> >
>> > >> >>> > And start working on a new Jenkins
>> instance.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> > >> >>> <ah...@adobe.com.invalid>
>> > >> >>> > wrote:
>> > >> >>> >
>> > >> >>> > > Are you saying that Java, Ant and Maven
>> do not
>> > know
>> > >> how to
>> > >> >>> > distribute work
>> > >> >>> > > to different cores?
>> > >> >>> > >
>> > >> >>> > > To repeat my main concern: our Jenkins
>> jobs
>> > often
>> > >> use shared
>> > >> >>> > resources.
>> > >> >>> > > If you want to take the time to fix
>> that, feel
>> > free,
>> > >> but I
>> > >> >>> do not
>> > >> >>> > know how
>> > >> >>> > > you are going to keep two jobs from both
>> trying
>> > to
>> > >> launch
>> > >> >>> Flash
>> > >> >>> > Player
>> > >> >>> > > Debugger at the same time and open the
>> same
>> > socket to
>> > >> >>> communicate
>> > >> >>> > with it,
>> > >> >>> > > or try to parse the flashlog.txt that
>> they have
>> > both
>> > >> written
>> > >> >>> to.
>> > >> >>> > >
>> > >> >>> > > The royale-asjs job will use the
>> royale-compiler
>> > >> workspace
>> > >> >>> to get the
>> > >> >>> > > compiler. If the compiler is building,
>> the
>> > jars are
>> > >> not
>> > >> >>> there and
>> > >> >>> > the
>> > >> >>> > > royale-asjs build fails.
>> > >> >>> > >
>> > >> >>> > > There is also only so much memory and
>> some of
>> > our
>> > >> jobs use
>> > >> >>> all of it
>> > >> >>> > and
>> > >> >>> > > I'm not sure if jobs slowed down due to
>> paging
>> > memory
>> > >> and
>> > >> >>> > writing/reading
>> > >> >>> > > from disk, even if it is an SSD.
>> > >> >>> > >
>> > >> >>> > > I'm done for tonight, but that's what I
>> was
>> > seeing
>> > >> last time
>> > >> >>> I tried
>> > >> >>> > to
>> > >> >>> > > have both master and an agent running
>> jobs in
>> > >> parallel.
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > -Alex
>> > >> >>> > >
>> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
>> Muppirala" <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > >
>> > >> >>> > > A typical setup would be to have 0
>> > executors on
>> > >> master
>> > >> >>> and at
>> > >> >>> > least n
>> > >> >>> > > number of executors on each agent,
>> where n =
>> > >> number of
>> > >> >>> cpu cores.
>> > >> >>> > > I see that the current VM has 2
>> cores. So,
>> > I
>> > >> started
>> > >> >>> with
>> > >> >>> > setting the
>> > >> >>> > > num
>> > >> >>> > > executors on the current agent to 2.
>> > >> >>> > >
>> > >> >>> > > This should improve things quite a
>> bit. If
>> > this
>> > >> doesn't
>> > >> >>> work, I
>> > >> >>> > will
>> > >> >>> > > create a new VM and make it the
>> slave agent
>> > of the
>> > >> >>> current
>> > >> >>> > Jenkins
>> > >> >>> > > master.
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > Om
>> > >> >>> > >
>> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
>> Alex Harui
>> > >> >>> > <ah...@adobe.com.invalid>
>> > >> >>> > > wrote:
>> > >> >>> > >
>> > >> >>> > > > On your VM or mine? I don't think
>> mine
>> > can
>> > >> handle
>> > >> >>> it. I used
>> > >> >>> > to
>> > >> >>> > > run jobs
>> > >> >>> > > > of master and agent and we got
>> lots of
>> > failures
>> > >> and
>> > >> >>> jobs took
>> > >> >>> > > forever. If
>> > >> >>> > > > two jobs are trying to run tests
>> with the
>> > >> shared Flash
>> > >> >>> Player
>> > >> >>> > > Debugger, for
>> > >> >>> > > > example, you won't get consistent
>> results.
>> > >> >>> > > >
>> > >> >>> > > > -Alex
>> > >> >>> > > >
>> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
>> > Muppirala" <
>> > >> >>> > bigosmallm@gmail.com<mailto:
>> bigosmallm@gmail.com>>
>> > >> >>> > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > I just realized that we have
>> only one
>> > Agent
>> > >> (node)
>> > >> >>> listed
>> > >> >>> > under
>> > >> >>> > > > Jenkins. I
>> > >> >>> > > > am going to add at least one
>> more
>> > node to
>> > >> start
>> > >> >>> with.
>> > >> >>> > > >
>> > >> >>> > > > Thanks,
>> > >> >>> > > > Om
>> > >> >>> > > >
>> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
>> AM Alex
>> > Harui
>> > >> >>> > > <ah...@adobe.com.invalid>
>> > >> >>> > > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > > I think I followed the
>> instructions
>> > and
>> > >> enabled
>> > >> >>> SSH.
>> > >> >>> > > > >
>> > >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay
>> Weiss"
>> > <
>> > >> >>> > yishayjobs@hotmail.com<mailto:
>> yishayjobs@hotmail.com
>> > >>
>> > >> >>> > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > I haven’t gotten it to
>> work.
>> > Could be
>> > >> ssh
>> > >> >>> needs to be
>> > >> >>> > > enabled on
>> > >> >>> > > > the
>> > >> >>> > > > > VM [1]. This is nice to have
>> but not
>> > >> essential.
>> > >> >>> So Alex,
>> > >> >>> > let
>> > >> >>> > > me know
>> > >> >>> > > > if you
>> > >> >>> > > > > want to try that, otherwise
>> I’ll
>> > suspend
>> > >> my
>> > >> >>> efforts on
>> > >> >>> > this.
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=jSJ2d3k5CINKvWLZBZtymV641%2Fx%2BXnMnvLnThs74%2F%2Bo%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=jSJ2d3k5CINKvWLZBZtymV641%2Fx%2BXnMnvLnThs74%2F%2Bo%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Wednesday, April
>> 15, 2020
>> > 5:09
>> > >> PM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > I’d like to try and
>> install an
>> > ssh
>> > >> server.
>> > >> >>> Can anyone
>> > >> >>> > > think of a
>> > >> >>> > > > > reason not to do that? I’m
>> asking in
>> > >> terms of
>> > >> >>> security,
>> > >> >>> > and if
>> > >> >>> > > there
>> > >> >>> > > > might
>> > >> >>> > > > > be a problem because it’s a
>> VM.
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks.
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 10:02 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Related, as most (all?)
>> of the
>> > >> instructions
>> > >> >>> don’t
>> > >> >>> > require
>> > >> >>> > > > anything but
>> > >> >>> > > > > a shell wouldn’t it be
>> easier and
>> > faster
>> > >> to
>> > >> >>> access the
>> > >> >>> > machine
>> > >> >>> > > with
>> > >> >>> > > > ssh
>> > >> >>> > > > > [1], rather than using remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126981256&sdata=q31IZr4su8m1osIy5KdPVmA8ZZ88UWmfJ0qNl%2B%2B%2F63o%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=Pwl5XmRxqfdJi%2F5elh6A2hgNZTX2JFnandVf7TVtMzc%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:55 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Can’t you do that with
>> remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > >
>> ________________________________
>> > >> >>> > > > > From: OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:51:25
>> > >> AM
>> > >> >>> > > > > To: Apache Royale
>> Development <
>> > >> >>> dev@royale.apache.org
>> > >> >>> > <ma...@royale.apache.org>>
>> > >> >>> > > > > Subject: Re: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Alex,
>> > >> >>> > > > >
>> > >> >>> > > > > I believe this is your
>> personal
>> > Azure
>> > >> >>> subscription
>> > >> >>> > right?
>> > >> >>> > > Any
>> > >> >>> > > > chance
>> > >> >>> > > > > I can
>> > >> >>> > > > > get access to it so I
>> can try
>> > to copy
>> > >> the
>> > >> >>> image out
>> > >> >>> > the
>> > >> >>> > > machine
>> > >> >>> > > > and
>> > >> >>> > > > > redeploy it somewhere
>> else?
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks,
>> > >> >>> > > > > Om
>> > >> >>> > > > >
>> > >> >>> > > > > On Sun, Apr 12, 2020 at
>> 6:18 PM
>> > >> OmPrakash
>> > >> >>> Muppirala <
>> > >> >>> > > > > bigosmallm@gmail.com<mailto:
>> > >> bigosmallm@gmail.com
>> > >> >>> >>
>> > >> >>> > > > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > > I can help set this up
>> on
>> > Azure.
>> > >> Give me
>> > >> >>> some
>> > >> >>> > time to
>> > >> >>> > > work
>> > >> >>> > > > out the
>> > >> >>> > > > > > details?
>> > >> >>> > > > > >
>> > >> >>> > > > > > Thanks,
>> > >> >>> > > > > > Om
>> > >> >>> > > > > >
>> > >> >>> > > > > > On Sun, Apr 12, 2020,
>> 11:49 AM
>> > >> Harbs <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >
>> > >> >>> > > > > >> OK. Good to know.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >> > On Apr 12, 2020, at
>> 9:45
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > FWIW, I just looked
>> and the
>> > >> longest job
>> > >> >>> in the
>> > >> >>> > release
>> > >> >>> > > > steps so
>> > >> >>> > > > > far is
>> > >> >>> > > > > >> 8 minutes. Most are
>> under 2
>> > >> minutes.
>> > >> >>> There
>> > >> >>> > might be
>> > >> >>> > > jobs
>> > >> >>> > > > later
>> > >> >>> > > > > that take
>> > >> >>> > > > > >> longer that we
>> haven't run
>> > yet.
>> > >> IMO, the
>> > >> >>> issue
>> > >> >>> > isn't
>> > >> >>> > > speed
>> > >> >>> > > > of the
>> > >> >>> > > > > machine,
>> > >> >>> > > > > >> it is just that we are
>> > sharing the
>> > >> >>> machine with
>> > >> >>> > longer
>> > >> >>> > > jobs
>> > >> >>> > > > (1 hour
>> > >> >>> > > > > for
>> > >> >>> > > > > >>
>> TourDeFlexMigration). And
>> > again,
>> > >> the
>> > >> >>> machine
>> > >> >>> > will be
>> > >> >>> > > idle for
>> > >> >>> > > > > stretches of
>> > >> >>> > > > > >> time while the RM
>> verifies
>> > >> artifacts
>> > >> >>> after each
>> > >> >>> > step.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > -Alex
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > On 4/12/20, 11:32
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Fair enough.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I expect builds
>> to be
>> > >> somewhere
>> > >> >>> between 10
>> > >> >>> > and 20
>> > >> >>> > > times
>> > >> >>> > > > faster
>> > >> >>> > > > > on a
>> > >> >>> > > > > >> powerful machine.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Yeah. It’s
>> probably
>> > going to
>> > >> be a
>> > >> >>> bit of work
>> > >> >>> > > changing
>> > >> >>> > > > the
>> > >> >>> > > > > server,
>> > >> >>> > > > > >> but probably worth it
>> in the
>> > long
>> > >> run.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I think I’ll try
>> this
>> > when I
>> > >> do the
>> > >> >>> next
>> > >> >>> > release
>> > >> >>> > > unless
>> > >> >>> > > > Yishay
>> > >> >>> > > > > wants
>> > >> >>> > > > > >> to work with me on
>> this for
>> > this
>> > >> release
>> > >> >>> — but
>> > >> >>> > I’m not
>> > >> >>> > > going
>> > >> >>> > > > to be
>> > >> >>> > > > > able to
>> > >> >>> > > > > >> help until after
>> Passover
>> > (i.e.
>> > >> next
>> > >> >>> week).
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Thanks,
>> > >> >>> > > > > >> > Harbs
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> >> On Apr 12, 2020,
>> at 9:22
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The Azure portal
>> says:
>> > Standard
>> > >> F2s_v2
>> > >> >>> (2
>> > >> >>> > vcpus, 4
>> > >> >>> > > GiB
>> > >> >>> > > > memory)
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> I think I am
>> reading
>> > changes to
>> > >> the
>> > >> >>> build
>> > >> >>> > process in
>> > >> >>> > > your
>> > >> >>> > > > > >> suggestions. I do not
>> > really want
>> > >> to
>> > >> >>> spend more
>> > >> >>> > of my
>> > >> >>> > > time
>> > >> >>> > > > on this
>> > >> >>> > > > > >> process. But if you
>> want to
>> > do
>> > >> the work,
>> > >> >>> that's
>> > >> >>> > fine
>> > >> >>> > > with me.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> -Alex
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> On 4/12/20, 10:57
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>> <mailto:
>> harbs.lists@gmail.com
>> > >> <mailto:
>> > >> >>> > harbs.lists@gmail.com>
>> > >> >>> > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>>> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> What kind of
>> horsepower
>> > is
>> > >> included
>> > >> >>> in the
>> > >> >>> > free
>> > >> >>> > > Azure
>> > >> >>> > > > account?
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The server I
>> mentioned
>> > builds
>> > >> >>> (considerably)
>> > >> >>> > > faster than
>> > >> >>> > > > my own
>> > >> >>> > > > > >> local machine. The ci
>> server
>> > seems
>> > >> to
>> > >> >>> build many
>> > >> >>> > times
>> > >> >>> > > slower.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> One thing we can
>> do to
>> > >> minimize
>> > >> >>> running
>> > >> >>> > server time
>> > >> >>> > > > would be to
>> > >> >>> > > > > >> transfer the
>> artifacts to
>> > storage
>> > >> instead
>> > >> >>> of
>> > >> >>> > keeping
>> > >> >>> > > them on
>> > >> >>> > > > the
>> > >> >>> > > > > server. On
>> > >> >>> > > > > >> AWS, I’d probably use
>> S3.
>> > Not sure
>> > >> what
>> > >> >>> the
>> > >> >>> > similar
>> > >> >>> > > service on
>> > >> >>> > > > > Azure is
>> > >> >>> > > > > >> called.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >>> On Apr 12, 2020,
>> at 8:26
>> > PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >> <mailto:
>> > aharui@adobe.com.INVALID
>> > >> <mailto:
>> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> OK, that's pretty
>> much
>> > how I
>> > >> >>> understand Azure
>> > >> >>> > as
>> > >> >>> > > well.
>> > >> >>> > > > The key
>> > >> >>> > > > > thing
>> > >> >>> > > > > >> is that "running"
>> includes
>> > time
>> > >> where the
>> > >> >>> CI
>> > >> >>> > server is
>> > >> >>> > > not
>> > >> >>> > > > running
>> > >> >>> > > > > any
>> > >> >>> > > > > >> Jenkins jobs. The CI
>> Server
>> > steps
>> > >> might
>> > >> >>> take
>> > >> >>> > only a few
>> > >> >>> > > > hours of
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> server time, but
>> there is
>> > time
>> > >> where the
>> > >> >>> RM is
>> > >> >>> > verifying
>> > >> >>> > > > artifacts
>> > >> >>> > > > > locally
>> > >> >>> > > > > >> so you'd be paying
>> for that
>> > or the
>> > >> RM
>> > >> >>> would have
>> > >> >>> > to keep
>> > >> >>> > > > shutting
>> > >> >>> > > > > down and
>> > >> >>> > > > > >> restarting.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Seems like it
>> would be
>> > >> >>> cheaper/simpler to get
>> > >> >>> > the
>> > >> >>> > > free
>> > >> >>> > > > MSDN
>> > >> >>> > > > > account
>> > >> >>> > > > > >> and leave it running.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> -Alex
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> On 4/12/20, 10:15
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> My experience is
>> with
>> > AWS.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I assume
>> Microsoft has
>> > similar
>> > >> >>> offerings,
>> > >> >>> > but I
>> > >> >>> > > don’t
>> > >> >>> > > > have
>> > >> >>> > > > > >> experience with Azure.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> AWS has
>> on-demand EC2
>> > >> instances
>> > >> >>> which you
>> > >> >>> > pay for
>> > >> >>> > > only
>> > >> >>> > > > the
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> time that they are
>> > running.[1]
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Instances can be
>> > started and
>> > >> stopped
>> > >> >>> via
>> > >> >>> > command
>> > >> >>> > > line
>> > >> >>> > > > (or via
>> > >> >>> > > > > the
>> > >> >>> > > > > >> web interface) as
>> long as
>> > you have
>> > >> valid
>> > >> >>> > credentials to
>> > >> >>> > > do so.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> For example: an
>> > m5.4xlarge
>> > >> instance
>> > >> >>> has 16
>> > >> >>> > cores
>> > >> >>> > > and
>> > >> >>> > > > costs
>> > >> >>> > > > > about
>> > >> >>> > > > > >> $1.5 per hour. On a
>> machine
>> > like
>> > >> that, a
>> > >> >>> full
>> > >> >>> > build
>> > >> >>> > > would
>> > >> >>> > > > probably
>> > >> >>> > > > > take
>> > >> >>> > > > > >> less than 10 minutes.
>> It’s
>> > probably
>> > >> >>> possible to
>> > >> >>> > do a
>> > >> >>> > > full
>> > >> >>> > > > release
>> > >> >>> > > > > with only
>> > >> >>> > > > > >> a few hours of server
>> time.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Leaving a server
>> like
>> > that
>> > >> running
>> > >> >>> all the
>> > >> >>> > time
>> > >> >>> > > would get
>> > >> >>> > > > > expensive,
>> > >> >>> > > > > >> but if it’s just spun
>> up for
>> > >> releases,
>> > >> >>> you’d get
>> > >> >>> > very
>> > >> >>> > > fast
>> > >> >>> > > > builds
>> > >> >>> > > > > at a
>> > >> >>> > > > > >> reasonable price.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I’d be happy to
>> pay
>> > $10-$50
>> > >> (and
>> > >> >>> possibly
>> > >> >>> > more) per
>> > >> >>> > > > release to
>> > >> >>> > > > > make
>> > >> >>> > > > > >> the release process
>> painless
>> > for
>> > >> the RM.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> [1]
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453126991254&sdata=I6nnsWWwkkVZqrXV0Lpgz3civxZk8GfKFr%2BIlBYQ7AE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca60134b4e7dc40ba25bb08d7e5b88d70%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230453127001247&sdata=yxGhuT%2F%2BFMzF%2FMWf6g3chkVMaRKaWLZtcOXfUKXJxNo%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>> On Apr 12, 2020,
>> at
>> > 7:45 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I'm not very
>> > experienced with
>> > >> >>> spinning up
>> > >> >>> > > servers. The
>> > >> >>> > > > CI
>> > >> >>> > > > > server we
>> > >> >>> > > > > >> are using is
>> effectively
>> > free,
>> > >> based on a
>> > >> >>> generous
>> > >> >>> > > donation
>> > >> >>> > > > from
>> > >> >>> > > > > Microsoft
>> > >> >>> > > > > >> of MSDN accounts to
>> ASF
>> > >> committers. So I
>> > >> >>> leave
>> > >> >>> > it up
>> > >> >>> > > 24/7,
>> > >> >>> > > > and
>> > >> >>> > > > > share the
>> > >> >>> > > > > >> RDP access on private@.
>> I
>> > think
>> > >> any
>> > >> >>> other ASF
>> > >> >>> > > committer
>> > >> >>> > > > could do
>> > >> >>> > > > > the
>> > >> >>> > > > > >> same. IIRC, if that
>> server
>> > >> actually is
>> > >> >>> stopped,
>> > >> >>> > I have
>> > >> >>> > > to
>> > >> >>> > > > use my
>> > >> >>> > > > > personal
>> > >> >>> > > > > >> (unshared) MSDN
>> credentials
>> > to
>> > >> start it
>> > >> >>> again.
>> > >> >>> > AIUI,
>> > >> >>> > > if I
>> > >> >>> > > > > actually paid
>> > >> >>> > > > > >> for the server, it
>> would
>> > cost me
>> > >> to leave
>> > >> >>> it
>> > >> >>> > running
>> > >> >>> > > even if
>> > >> >>> > > > it
>> > >> >>> > > > > didn't run
>> > >> >>> > > > > >> jobs between releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Is that what you
>> are
>> > basically
>> > >> >>> saying? I
>> > >> >>> > think it
>> > >> >>> > > might
>> > >> >>> > > > be
>> > >> >>> > > > > best if
>> > >> >>> > > > > >> another committer got
>> a CI
>> > server
>> > >> going
>> > >> >>> via the MS
>> > >> >>> > > donation
>> > >> >>> > > > and
>> > >> >>> > > > > could leave
>> > >> >>> > > > > >> it up 24/7.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> -Alex
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> On 4/12/20, 9:28
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I’m willing to
>> do this.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Considering that
>> the
>> > release
>> > >> will be
>> > >> >>> run
>> > >> >>> > > infrequently, it
>> > >> >>> > > > > should be
>> > >> >>> > > > > >> doable to have a
>> relatively
>> > >> powerful
>> > >> >>> server that
>> > >> >>> > could
>> > >> >>> > > be
>> > >> >>> > > > spun up on
>> > >> >>> > > > > >> demand. This is
>> something I
>> > have
>> > >> setup
>> > >> >>> for my own
>> > >> >>> > > releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> The only
>> complication
>> > would
>> > >> be that
>> > >> >>> each RM
>> > >> >>> > would
>> > >> >>> > > need
>> > >> >>> > > > valid
>> > >> >>> > > > > >> credentials to spin
>> up the
>> > server.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Harbs
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>>> On Apr 12,
>> 2020, at
>> > 7:10 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>>
>> > >> >>> > > > > >> >>>>> A better
>> solution,
>> > IMO, is
>> > >> for
>> > >> >>> someone else
>> > >> >>> > to
>> > >> >>> > > offer up
>> > >> >>> > > > a CI
>> > >> >>> > > > > server
>> > >> >>> > > > > >> only for release jobs.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >>
>> > >>
>> > >>
>> >
>> >
>> >
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Yes, royale-asjs (which is currently building on agent1 and blocking the release job).
-Alex
On 4/20/20, 10:53 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
Update - royale-asjs_jsonly successfully build on my agent VM.
Right now, we have 3 jobs running on this VM:
1. royale-asjs_jsonly
2. royale-compiler
3. royale-typedefs
Are there any other jobs we need to move to the new agent?
Yishay, can you please confirm that your release jobs are running without
being hindered by CI jobs?
Thanks,
Om
On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bi...@gmail.com>
wrote:
>
> On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
>> you are talking about your VM, you can compare console output from recent
>> successful builds on both VMs.
>>
>>
> I was talking about my VM.
> A rebuild of royale-compiler seems to have fixed that problem. Now
> royale-typedefs passes as well!
>
> Next up royale-asjs_jsonly...
>
>
>> I'm done for tonight. Good luck,
>> -Alex
>>
>> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <aharui@adobe.com.invalid
>> >
>> wrote:
>>
>> > Royale-compiler has to be built first. This is an example of shared
>> > resources that I mentioned upthread. Royale-typedefs is going to
>> look for
>> > a sibling workspace folder called royale-compiler with a built of
>> > royale-compiler in it. If royale-compiler fails to create all of
>> its
>> > binaries or is in the process of building them, royale-typedefs
>> will report
>> > an error.
>> >
>>
>> Got it. I was just looking at the logic here:
>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301088702&sdata=cejYyk7K6vlgMF0Y7lX%2FCvIIPUU1f74AmDiMqI7gTMg%3D&reserved=0
>>
>> Weird. The royale-compiler build says it was successful, but I cant
>> find
>> the lib directory under
>> C:\jenkins\workspace\royale-compiler\compiler-jx
>>
>>
>>
>>
>> >
>> > What should probably happen is that royale-typedefs pulls down the
>> > lastsuccessfulartifacts from royale-compiler, but I've never found
>> enough
>> > time and energy to try to make changes like that since most of us
>> do have
>> > all of the folders as siblings.
>> >
>> > HTH,
>> > -Alex
>> >
>> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>> >
>> > I am now getting this error on royale-typedefs build:
>> >
>> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
>> The
>> > following error occurred while executing this line:
>> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>> >
>> >
>> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
>> > doesn't exist.
>> >
>> >
>> > Where does the ROYALE_TRANSPILER_HOME var come from?
>> >
>> > Here is the full console output:
>> >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=AlDWUpxRr7ZWXevbiDrlfG9DlTCHJ2uVWi8hcx3%2BbBE%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>> >
>> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
>> > bigosmallm@gmail.com>
>> > wrote:
>> >
>> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
>> <aharui@adobe.com.invalid
>> > >
>> > > wrote:
>> > >
>> > >> Congratulations! But does that mean that JAVA_HOME is
>> pointing at
>> > a JRE
>> > >> instead of a JDK? If you have other issues that might be a
>> factor.
>> > >>
>> > >
>> > > Yeah, I messed up initially by getting the JRE instead of
>> JDK. I
>> > have
>> > > since corrected it. But for some reason Ant still thinks that
>> > JAVA_HOME is
>> > > the jre directory.
>> > > I don't know how to fix this, hence the hack :-|
>> > >
>> > >
>> > >
>> > >
>> > >>
>> > >> HTH,
>> > >> -Alex
>> > >>
>> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> I copied tools.jar from jdk/lib to the jre/lib. That
>> seems to
>> > have
>> > >> fixed
>> > >> the issue.
>> > >> We now have a successful build of the royale-compiler on
>> the
>> > new Agent
>> > >> machine!!
>> > >>
>> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > Restart dint help. Although Serkan's reply made me
>> look at
>> > how Ant
>> > >> was
>> > >> > getting invoked.
>> > >> >
>> > >> > I see this warning that tools.jar is missing:
>> > >> >
>> > >> > [royale-compiler] $ cmd.exe /C
>> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
>> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
>> > >> %%ERRORLEVEL%%"
>> > >> >
>> > >> > Unable to locate tools.jar. Expected to find it in
>> C:\Program
>> > >> Files\Java\jre1.8.0_251\lib\tools.jar
>> > >> >
>> > >> >
>> > >> > I am pretty sure this is related to this issue.
>> > >> >
>> > >> >
>> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> > wrote:
>> > >> >
>> > >> >>
>> > >> >>
>> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >> wrote:
>> > >> >>
>> > >> >>> Did you reboot your VM? Also, have you checked what
>> user is
>> > >> running
>> > >> >>> Jenkins on your VM? I think that can sometimes be a
>> > problem. I
>> > >> might be
>> > >> >>> running Jenkins as the user.
>> > >> >>>
>> > >> >>>
>> > >> >> Agents don't require Jenkins to be running. I will
>> give the
>> > >> rebooting of
>> > >> >> the VM a shot .
>> > >> >>
>> > >> >> Thanks,
>> > >> >> Om
>> > >> >>
>> > >> >>
>> > >> >>> -Alex
>> > >> >>>
>> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
>> > bigosmallm@gmail.com
>> > >> >
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> > Should be here:
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=o1%2Bk25frntzGTmW63ZgcLvy%2FDeJblzfAbUIkpZcgL8k%3D&reserved=0
>> > >> >>>
>> > >> >>>
>> > >> >>> My git is located in the same exact location as
>> master.
>> > >> >>> Moreover, the git call from the commandline
>> executes
>> > fine.
>> > >> The git
>> > >> >>> call
>> > >> >>> from ant exec is what is failing.
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > HTH,
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > From: OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> > >> >>> > Reply-To: "dev@royale.apache.org" <
>> > dev@royale.apache.org>
>> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> > >> >>> > To: Apache Royale Development <
>> dev@royale.apache.org>
>> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
>> > >> >>> >
>> > >> >>> > I'm a bit stumped here. The royale-compiler is
>> > failing
>> > >> with this
>> > >> >>> error:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > BUILD FAILED
>> > >> >>> >
>> > >> >>> >
>> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
>> > Execute
>> > >> >>> failed:
>> > >> >>> > java.io.IOException: Cannot run program "git"
>> (in
>> > directory
>> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
>> CreateProcess
>> > >> error=2,
>> > >> >>> The system
>> > >> >>> > cannot find the file specified
>> > >> >>> >
>> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
>> Source)
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > It is from this part of the jenkins.xml:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > <target name="closure-lib-download"
>> > description="Copies
>> > >> Closure
>> > >> >>> > Library from GitHub">
>> > >> >>> > <echo message="Be patient. This takes
>> a few
>> > >> minutes..." />
>> > >> >>> > <exec executable="git"
>> > failifexecutionfails="true">
>> > >> >>> > <arg value="clone" />
>> > >> >>> > <arg value="
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=q7ER0yACIqI4z4RKVMS%2F1w6KY8Z9SXaLmzdn87VAdho%3D&reserved=0
>> > >> >>> <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=q7ER0yACIqI4z4RKVMS%2F1w6KY8Z9SXaLmzdn87VAdho%3D&reserved=0
>> > >> >>> >"
>> > >> >>> > />
>> > >> >>> > <arg value="${closure.root}" />
>> > >> >>> > </exec>
>> > >> >>> > <echo>Cloned fresh copy of Google
>> Closure
>> > >> Library</echo>
>> > >> >>> > </target>
>> > >> >>> >
>> > >> >>> > I am not sure how this executable call works
>> without
>> > the
>> > >> full path.
>> > >> >>> >
>> > >> >>> > I checked the env variables, I do have both the
>> > git/bin and
>> > >> git/cmd
>> > >> >>> > directory in the PATH:
>> > >> >>> >
>> > >> >>> > [cid:ii_k97zkk9o0]
>> > >> >>> >
>> > >> >>> > What am I missing?
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > Update - I have successfully attached my VM as
>> a slave
>> > >> agent of our
>> > >> >>> > Jenkins instance.
>> > >> >>> > I am going to pull the job -
>> /royale-asjs_jsonly and
>> > tie it
>> > >> to my
>> > >> >>> agent so
>> > >> >>> > I can test it.
>> > >> >>> >
>> > >> >>> > It will fail for a sometime while I go set up
>> my VM
>> > with
>> > >> all the
>> > >> >>> > dependencies.
>> > >> >>> >
>> > >> >>> > Once we have the job successfully building on
>> my VM,
>> > we can
>> > >> figure
>> > >> >>> out how
>> > >> >>> > to divide the load between the master and
>> agent.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > We could achieve the same by creating a new
>> agent
>> > (separate
>> > >> vm) and
>> > >> >>> > attaching it as a slave to the current Jenkins
>> server.
>> > >> >>> >
>> > >> >>> > Then we can use labels/tags to tie release
>> jobs to one
>> > >> agent and
>> > >> >>> non
>> > >> >>> > release jobs to another agent.
>> > >> >>> >
>> > >> >>> > That way we can maintain everything in one UI,
>> one
>> > login
>> > >> while
>> > >> >>> achieving
>> > >> >>> > the concurrent building capabilities we want.
>> > >> >>> >
>> > >> >>> > Jenkins is built for this kind of stuff and I
>> think it
>> > >> would be
>> > >> >>> best we
>> > >> >>> > followed this practice.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>> > Om, I thought you were going to get the image
>> from my
>> > VM
>> > >> and run
>> > >> >>> it on
>> > >> >>> > another VM. Then we'd remove all non-release
>> jobs
>> > from
>> > >> your VM
>> > >> >>> and all of
>> > >> >>> > the release jobs from my VM. That won't solve
>> the
>> > problem
>> > >> of how
>> > >> >>> long it
>> > >> >>> > takes for a commit to be built and tested, but
>> will
>> > allow
>> > >> the RM
>> > >> >>> to get a
>> > >> >>> > release out without getting stuck behind the
>> commit
>> > jobs.
>> > >> Is that
>> > >> >>> > currently the plan?
>> > >> >>> >
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
>> > >> bigosmallm@gmail.com
>> > >> >>> <mailto:
>> > >> >>> > bigosmallm@gmail.com>> wrote:
>> > >> >>> >
>> > >> >>> > Makes sense to me. I will set parallel
>> executors
>> > back
>> > >> to 1.
>> > >> >>> >
>> > >> >>> > And start working on a new Jenkins
>> instance.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> > >> >>> <ah...@adobe.com.invalid>
>> > >> >>> > wrote:
>> > >> >>> >
>> > >> >>> > > Are you saying that Java, Ant and Maven
>> do not
>> > know
>> > >> how to
>> > >> >>> > distribute work
>> > >> >>> > > to different cores?
>> > >> >>> > >
>> > >> >>> > > To repeat my main concern: our Jenkins
>> jobs
>> > often
>> > >> use shared
>> > >> >>> > resources.
>> > >> >>> > > If you want to take the time to fix
>> that, feel
>> > free,
>> > >> but I
>> > >> >>> do not
>> > >> >>> > know how
>> > >> >>> > > you are going to keep two jobs from both
>> trying
>> > to
>> > >> launch
>> > >> >>> Flash
>> > >> >>> > Player
>> > >> >>> > > Debugger at the same time and open the
>> same
>> > socket to
>> > >> >>> communicate
>> > >> >>> > with it,
>> > >> >>> > > or try to parse the flashlog.txt that
>> they have
>> > both
>> > >> written
>> > >> >>> to.
>> > >> >>> > >
>> > >> >>> > > The royale-asjs job will use the
>> royale-compiler
>> > >> workspace
>> > >> >>> to get the
>> > >> >>> > > compiler. If the compiler is building,
>> the
>> > jars are
>> > >> not
>> > >> >>> there and
>> > >> >>> > the
>> > >> >>> > > royale-asjs build fails.
>> > >> >>> > >
>> > >> >>> > > There is also only so much memory and
>> some of
>> > our
>> > >> jobs use
>> > >> >>> all of it
>> > >> >>> > and
>> > >> >>> > > I'm not sure if jobs slowed down due to
>> paging
>> > memory
>> > >> and
>> > >> >>> > writing/reading
>> > >> >>> > > from disk, even if it is an SSD.
>> > >> >>> > >
>> > >> >>> > > I'm done for tonight, but that's what I
>> was
>> > seeing
>> > >> last time
>> > >> >>> I tried
>> > >> >>> > to
>> > >> >>> > > have both master and an agent running
>> jobs in
>> > >> parallel.
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > -Alex
>> > >> >>> > >
>> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
>> Muppirala" <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > >
>> > >> >>> > > A typical setup would be to have 0
>> > executors on
>> > >> master
>> > >> >>> and at
>> > >> >>> > least n
>> > >> >>> > > number of executors on each agent,
>> where n =
>> > >> number of
>> > >> >>> cpu cores.
>> > >> >>> > > I see that the current VM has 2
>> cores. So,
>> > I
>> > >> started
>> > >> >>> with
>> > >> >>> > setting the
>> > >> >>> > > num
>> > >> >>> > > executors on the current agent to 2.
>> > >> >>> > >
>> > >> >>> > > This should improve things quite a
>> bit. If
>> > this
>> > >> doesn't
>> > >> >>> work, I
>> > >> >>> > will
>> > >> >>> > > create a new VM and make it the
>> slave agent
>> > of the
>> > >> >>> current
>> > >> >>> > Jenkins
>> > >> >>> > > master.
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > Om
>> > >> >>> > >
>> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
>> Alex Harui
>> > >> >>> > <ah...@adobe.com.invalid>
>> > >> >>> > > wrote:
>> > >> >>> > >
>> > >> >>> > > > On your VM or mine? I don't think
>> mine
>> > can
>> > >> handle
>> > >> >>> it. I used
>> > >> >>> > to
>> > >> >>> > > run jobs
>> > >> >>> > > > of master and agent and we got
>> lots of
>> > failures
>> > >> and
>> > >> >>> jobs took
>> > >> >>> > > forever. If
>> > >> >>> > > > two jobs are trying to run tests
>> with the
>> > >> shared Flash
>> > >> >>> Player
>> > >> >>> > > Debugger, for
>> > >> >>> > > > example, you won't get consistent
>> results.
>> > >> >>> > > >
>> > >> >>> > > > -Alex
>> > >> >>> > > >
>> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
>> > Muppirala" <
>> > >> >>> > bigosmallm@gmail.com<mailto:
>> bigosmallm@gmail.com>>
>> > >> >>> > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > I just realized that we have
>> only one
>> > Agent
>> > >> (node)
>> > >> >>> listed
>> > >> >>> > under
>> > >> >>> > > > Jenkins. I
>> > >> >>> > > > am going to add at least one
>> more
>> > node to
>> > >> start
>> > >> >>> with.
>> > >> >>> > > >
>> > >> >>> > > > Thanks,
>> > >> >>> > > > Om
>> > >> >>> > > >
>> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
>> AM Alex
>> > Harui
>> > >> >>> > > <ah...@adobe.com.invalid>
>> > >> >>> > > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > > I think I followed the
>> instructions
>> > and
>> > >> enabled
>> > >> >>> SSH.
>> > >> >>> > > > >
>> > >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay
>> Weiss"
>> > <
>> > >> >>> > yishayjobs@hotmail.com<mailto:
>> yishayjobs@hotmail.com
>> > >>
>> > >> >>> > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > I haven’t gotten it to
>> work.
>> > Could be
>> > >> ssh
>> > >> >>> needs to be
>> > >> >>> > > enabled on
>> > >> >>> > > > the
>> > >> >>> > > > > VM [1]. This is nice to have
>> but not
>> > >> essential.
>> > >> >>> So Alex,
>> > >> >>> > let
>> > >> >>> > > me know
>> > >> >>> > > > if you
>> > >> >>> > > > > want to try that, otherwise
>> I’ll
>> > suspend
>> > >> my
>> > >> >>> efforts on
>> > >> >>> > this.
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=RINI5%2B%2F1EL9KwL17fNGskCzHbtgEmxmw0%2F4lSTyttBM%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=RINI5%2B%2F1EL9KwL17fNGskCzHbtgEmxmw0%2F4lSTyttBM%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Wednesday, April
>> 15, 2020
>> > 5:09
>> > >> PM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > I’d like to try and
>> install an
>> > ssh
>> > >> server.
>> > >> >>> Can anyone
>> > >> >>> > > think of a
>> > >> >>> > > > > reason not to do that? I’m
>> asking in
>> > >> terms of
>> > >> >>> security,
>> > >> >>> > and if
>> > >> >>> > > there
>> > >> >>> > > > might
>> > >> >>> > > > > be a problem because it’s a
>> VM.
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks.
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 10:02 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Related, as most (all?)
>> of the
>> > >> instructions
>> > >> >>> don’t
>> > >> >>> > require
>> > >> >>> > > > anything but
>> > >> >>> > > > > a shell wouldn’t it be
>> easier and
>> > faster
>> > >> to
>> > >> >>> access the
>> > >> >>> > machine
>> > >> >>> > > with
>> > >> >>> > > > ssh
>> > >> >>> > > > > [1], rather than using remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=kd%2BwXuAMTNQkHNsT0zdhvONNuh5lpZV8ihrhuUcd84k%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=kd%2BwXuAMTNQkHNsT0zdhvONNuh5lpZV8ihrhuUcd84k%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:55 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Can’t you do that with
>> remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > >
>> ________________________________
>> > >> >>> > > > > From: OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:51:25
>> > >> AM
>> > >> >>> > > > > To: Apache Royale
>> Development <
>> > >> >>> dev@royale.apache.org
>> > >> >>> > <ma...@royale.apache.org>>
>> > >> >>> > > > > Subject: Re: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Alex,
>> > >> >>> > > > >
>> > >> >>> > > > > I believe this is your
>> personal
>> > Azure
>> > >> >>> subscription
>> > >> >>> > right?
>> > >> >>> > > Any
>> > >> >>> > > > chance
>> > >> >>> > > > > I can
>> > >> >>> > > > > get access to it so I
>> can try
>> > to copy
>> > >> the
>> > >> >>> image out
>> > >> >>> > the
>> > >> >>> > > machine
>> > >> >>> > > > and
>> > >> >>> > > > > redeploy it somewhere
>> else?
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks,
>> > >> >>> > > > > Om
>> > >> >>> > > > >
>> > >> >>> > > > > On Sun, Apr 12, 2020 at
>> 6:18 PM
>> > >> OmPrakash
>> > >> >>> Muppirala <
>> > >> >>> > > > > bigosmallm@gmail.com<mailto:
>> > >> bigosmallm@gmail.com
>> > >> >>> >>
>> > >> >>> > > > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > > I can help set this up
>> on
>> > Azure.
>> > >> Give me
>> > >> >>> some
>> > >> >>> > time to
>> > >> >>> > > work
>> > >> >>> > > > out the
>> > >> >>> > > > > > details?
>> > >> >>> > > > > >
>> > >> >>> > > > > > Thanks,
>> > >> >>> > > > > > Om
>> > >> >>> > > > > >
>> > >> >>> > > > > > On Sun, Apr 12, 2020,
>> 11:49 AM
>> > >> Harbs <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >
>> > >> >>> > > > > >> OK. Good to know.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >> > On Apr 12, 2020, at
>> 9:45
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > FWIW, I just looked
>> and the
>> > >> longest job
>> > >> >>> in the
>> > >> >>> > release
>> > >> >>> > > > steps so
>> > >> >>> > > > > far is
>> > >> >>> > > > > >> 8 minutes. Most are
>> under 2
>> > >> minutes.
>> > >> >>> There
>> > >> >>> > might be
>> > >> >>> > > jobs
>> > >> >>> > > > later
>> > >> >>> > > > > that take
>> > >> >>> > > > > >> longer that we
>> haven't run
>> > yet.
>> > >> IMO, the
>> > >> >>> issue
>> > >> >>> > isn't
>> > >> >>> > > speed
>> > >> >>> > > > of the
>> > >> >>> > > > > machine,
>> > >> >>> > > > > >> it is just that we are
>> > sharing the
>> > >> >>> machine with
>> > >> >>> > longer
>> > >> >>> > > jobs
>> > >> >>> > > > (1 hour
>> > >> >>> > > > > for
>> > >> >>> > > > > >>
>> TourDeFlexMigration). And
>> > again,
>> > >> the
>> > >> >>> machine
>> > >> >>> > will be
>> > >> >>> > > idle for
>> > >> >>> > > > > stretches of
>> > >> >>> > > > > >> time while the RM
>> verifies
>> > >> artifacts
>> > >> >>> after each
>> > >> >>> > step.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > -Alex
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > On 4/12/20, 11:32
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Fair enough.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I expect builds
>> to be
>> > >> somewhere
>> > >> >>> between 10
>> > >> >>> > and 20
>> > >> >>> > > times
>> > >> >>> > > > faster
>> > >> >>> > > > > on a
>> > >> >>> > > > > >> powerful machine.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Yeah. It’s
>> probably
>> > going to
>> > >> be a
>> > >> >>> bit of work
>> > >> >>> > > changing
>> > >> >>> > > > the
>> > >> >>> > > > > server,
>> > >> >>> > > > > >> but probably worth it
>> in the
>> > long
>> > >> run.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I think I’ll try
>> this
>> > when I
>> > >> do the
>> > >> >>> next
>> > >> >>> > release
>> > >> >>> > > unless
>> > >> >>> > > > Yishay
>> > >> >>> > > > > wants
>> > >> >>> > > > > >> to work with me on
>> this for
>> > this
>> > >> release
>> > >> >>> — but
>> > >> >>> > I’m not
>> > >> >>> > > going
>> > >> >>> > > > to be
>> > >> >>> > > > > able to
>> > >> >>> > > > > >> help until after
>> Passover
>> > (i.e.
>> > >> next
>> > >> >>> week).
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Thanks,
>> > >> >>> > > > > >> > Harbs
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> >> On Apr 12, 2020,
>> at 9:22
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The Azure portal
>> says:
>> > Standard
>> > >> F2s_v2
>> > >> >>> (2
>> > >> >>> > vcpus, 4
>> > >> >>> > > GiB
>> > >> >>> > > > memory)
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> I think I am
>> reading
>> > changes to
>> > >> the
>> > >> >>> build
>> > >> >>> > process in
>> > >> >>> > > your
>> > >> >>> > > > > >> suggestions. I do not
>> > really want
>> > >> to
>> > >> >>> spend more
>> > >> >>> > of my
>> > >> >>> > > time
>> > >> >>> > > > on this
>> > >> >>> > > > > >> process. But if you
>> want to
>> > do
>> > >> the work,
>> > >> >>> that's
>> > >> >>> > fine
>> > >> >>> > > with me.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> -Alex
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> On 4/12/20, 10:57
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>> <mailto:
>> harbs.lists@gmail.com
>> > >> <mailto:
>> > >> >>> > harbs.lists@gmail.com>
>> > >> >>> > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>>> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> What kind of
>> horsepower
>> > is
>> > >> included
>> > >> >>> in the
>> > >> >>> > free
>> > >> >>> > > Azure
>> > >> >>> > > > account?
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The server I
>> mentioned
>> > builds
>> > >> >>> (considerably)
>> > >> >>> > > faster than
>> > >> >>> > > > my own
>> > >> >>> > > > > >> local machine. The ci
>> server
>> > seems
>> > >> to
>> > >> >>> build many
>> > >> >>> > times
>> > >> >>> > > slower.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> One thing we can
>> do to
>> > >> minimize
>> > >> >>> running
>> > >> >>> > server time
>> > >> >>> > > > would be to
>> > >> >>> > > > > >> transfer the
>> artifacts to
>> > storage
>> > >> instead
>> > >> >>> of
>> > >> >>> > keeping
>> > >> >>> > > them on
>> > >> >>> > > > the
>> > >> >>> > > > > server. On
>> > >> >>> > > > > >> AWS, I’d probably use
>> S3.
>> > Not sure
>> > >> what
>> > >> >>> the
>> > >> >>> > similar
>> > >> >>> > > service on
>> > >> >>> > > > > Azure is
>> > >> >>> > > > > >> called.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >>> On Apr 12, 2020,
>> at 8:26
>> > PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >> <mailto:
>> > aharui@adobe.com.INVALID
>> > >> <mailto:
>> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> OK, that's pretty
>> much
>> > how I
>> > >> >>> understand Azure
>> > >> >>> > as
>> > >> >>> > > well.
>> > >> >>> > > > The key
>> > >> >>> > > > > thing
>> > >> >>> > > > > >> is that "running"
>> includes
>> > time
>> > >> where the
>> > >> >>> CI
>> > >> >>> > server is
>> > >> >>> > > not
>> > >> >>> > > > running
>> > >> >>> > > > > any
>> > >> >>> > > > > >> Jenkins jobs. The CI
>> Server
>> > steps
>> > >> might
>> > >> >>> take
>> > >> >>> > only a few
>> > >> >>> > > > hours of
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> server time, but
>> there is
>> > time
>> > >> where the
>> > >> >>> RM is
>> > >> >>> > verifying
>> > >> >>> > > > artifacts
>> > >> >>> > > > > locally
>> > >> >>> > > > > >> so you'd be paying
>> for that
>> > or the
>> > >> RM
>> > >> >>> would have
>> > >> >>> > to keep
>> > >> >>> > > > shutting
>> > >> >>> > > > > down and
>> > >> >>> > > > > >> restarting.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Seems like it
>> would be
>> > >> >>> cheaper/simpler to get
>> > >> >>> > the
>> > >> >>> > > free
>> > >> >>> > > > MSDN
>> > >> >>> > > > > account
>> > >> >>> > > > > >> and leave it running.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> -Alex
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> On 4/12/20, 10:15
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> My experience is
>> with
>> > AWS.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I assume
>> Microsoft has
>> > similar
>> > >> >>> offerings,
>> > >> >>> > but I
>> > >> >>> > > don’t
>> > >> >>> > > > have
>> > >> >>> > > > > >> experience with Azure.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> AWS has
>> on-demand EC2
>> > >> instances
>> > >> >>> which you
>> > >> >>> > pay for
>> > >> >>> > > only
>> > >> >>> > > > the
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> time that they are
>> > running.[1]
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Instances can be
>> > started and
>> > >> stopped
>> > >> >>> via
>> > >> >>> > command
>> > >> >>> > > line
>> > >> >>> > > > (or via
>> > >> >>> > > > > the
>> > >> >>> > > > > >> web interface) as
>> long as
>> > you have
>> > >> valid
>> > >> >>> > credentials to
>> > >> >>> > > do so.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> For example: an
>> > m5.4xlarge
>> > >> instance
>> > >> >>> has 16
>> > >> >>> > cores
>> > >> >>> > > and
>> > >> >>> > > > costs
>> > >> >>> > > > > about
>> > >> >>> > > > > >> $1.5 per hour. On a
>> machine
>> > like
>> > >> that, a
>> > >> >>> full
>> > >> >>> > build
>> > >> >>> > > would
>> > >> >>> > > > probably
>> > >> >>> > > > > take
>> > >> >>> > > > > >> less than 10 minutes.
>> It’s
>> > probably
>> > >> >>> possible to
>> > >> >>> > do a
>> > >> >>> > > full
>> > >> >>> > > > release
>> > >> >>> > > > > with only
>> > >> >>> > > > > >> a few hours of server
>> time.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Leaving a server
>> like
>> > that
>> > >> running
>> > >> >>> all the
>> > >> >>> > time
>> > >> >>> > > would get
>> > >> >>> > > > > expensive,
>> > >> >>> > > > > >> but if it’s just spun
>> up for
>> > >> releases,
>> > >> >>> you’d get
>> > >> >>> > very
>> > >> >>> > > fast
>> > >> >>> > > > builds
>> > >> >>> > > > > at a
>> > >> >>> > > > > >> reasonable price.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I’d be happy to
>> pay
>> > $10-$50
>> > >> (and
>> > >> >>> possibly
>> > >> >>> > more) per
>> > >> >>> > > > release to
>> > >> >>> > > > > make
>> > >> >>> > > > > >> the release process
>> painless
>> > for
>> > >> the RM.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> [1]
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301098700&sdata=SLcO9S6C75t3GjOhvgvUtoJ%2B7ycA4A%2B6YKfbxDAgMVs%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301108695&sdata=sznghIMwQbFksNmF2ejuNRA2tBVMPpDKHOF6%2Bn63IB8%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301118685&sdata=ytGpO%2FhcKYiuEKrCV4whwhm%2BmVzvqvnlLHDlRkusnXE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301118685&sdata=ytGpO%2FhcKYiuEKrCV4whwhm%2BmVzvqvnlLHDlRkusnXE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301118685&sdata=ytGpO%2FhcKYiuEKrCV4whwhm%2BmVzvqvnlLHDlRkusnXE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301118685&sdata=ytGpO%2FhcKYiuEKrCV4whwhm%2BmVzvqvnlLHDlRkusnXE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301118685&sdata=ytGpO%2FhcKYiuEKrCV4whwhm%2BmVzvqvnlLHDlRkusnXE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C4ef14652baf546d77e8908d7e5b85c0b%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637230452301118685&sdata=ytGpO%2FhcKYiuEKrCV4whwhm%2BmVzvqvnlLHDlRkusnXE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>> On Apr 12, 2020,
>> at
>> > 7:45 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I'm not very
>> > experienced with
>> > >> >>> spinning up
>> > >> >>> > > servers. The
>> > >> >>> > > > CI
>> > >> >>> > > > > server we
>> > >> >>> > > > > >> are using is
>> effectively
>> > free,
>> > >> based on a
>> > >> >>> generous
>> > >> >>> > > donation
>> > >> >>> > > > from
>> > >> >>> > > > > Microsoft
>> > >> >>> > > > > >> of MSDN accounts to
>> ASF
>> > >> committers. So I
>> > >> >>> leave
>> > >> >>> > it up
>> > >> >>> > > 24/7,
>> > >> >>> > > > and
>> > >> >>> > > > > share the
>> > >> >>> > > > > >> RDP access on private@.
>> I
>> > think
>> > >> any
>> > >> >>> other ASF
>> > >> >>> > > committer
>> > >> >>> > > > could do
>> > >> >>> > > > > the
>> > >> >>> > > > > >> same. IIRC, if that
>> server
>> > >> actually is
>> > >> >>> stopped,
>> > >> >>> > I have
>> > >> >>> > > to
>> > >> >>> > > > use my
>> > >> >>> > > > > personal
>> > >> >>> > > > > >> (unshared) MSDN
>> credentials
>> > to
>> > >> start it
>> > >> >>> again.
>> > >> >>> > AIUI,
>> > >> >>> > > if I
>> > >> >>> > > > > actually paid
>> > >> >>> > > > > >> for the server, it
>> would
>> > cost me
>> > >> to leave
>> > >> >>> it
>> > >> >>> > running
>> > >> >>> > > even if
>> > >> >>> > > > it
>> > >> >>> > > > > didn't run
>> > >> >>> > > > > >> jobs between releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Is that what you
>> are
>> > basically
>> > >> >>> saying? I
>> > >> >>> > think it
>> > >> >>> > > might
>> > >> >>> > > > be
>> > >> >>> > > > > best if
>> > >> >>> > > > > >> another committer got
>> a CI
>> > server
>> > >> going
>> > >> >>> via the MS
>> > >> >>> > > donation
>> > >> >>> > > > and
>> > >> >>> > > > > could leave
>> > >> >>> > > > > >> it up 24/7.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> -Alex
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> On 4/12/20, 9:28
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I’m willing to
>> do this.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Considering that
>> the
>> > release
>> > >> will be
>> > >> >>> run
>> > >> >>> > > infrequently, it
>> > >> >>> > > > > should be
>> > >> >>> > > > > >> doable to have a
>> relatively
>> > >> powerful
>> > >> >>> server that
>> > >> >>> > could
>> > >> >>> > > be
>> > >> >>> > > > spun up on
>> > >> >>> > > > > >> demand. This is
>> something I
>> > have
>> > >> setup
>> > >> >>> for my own
>> > >> >>> > > releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> The only
>> complication
>> > would
>> > >> be that
>> > >> >>> each RM
>> > >> >>> > would
>> > >> >>> > > need
>> > >> >>> > > > valid
>> > >> >>> > > > > >> credentials to spin
>> up the
>> > server.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Harbs
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>>> On Apr 12,
>> 2020, at
>> > 7:10 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>>
>> > >> >>> > > > > >> >>>>> A better
>> solution,
>> > IMO, is
>> > >> for
>> > >> >>> someone else
>> > >> >>> > to
>> > >> >>> > > offer up
>> > >> >>> > > > a CI
>> > >> >>> > > > > server
>> > >> >>> > > > > >> only for release jobs.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >>
>> > >>
>> > >>
>> >
>> >
>> >
>>
>>
>>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
I don’t see any jobs configured to run on agent2. Not sure what I’m missing.
From: Yishay Weiss<ma...@hotmail.com>
Sent: Saturday, May 2, 2020 1:43 PM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Step 12 was blocked on agent1 by TDF. Is it supposed to be configured to run on 2?
From: OmPrakash Muppirala<ma...@gmail.com>
Sent: Wednesday, April 22, 2020 2:47 AM
To: Apache Royale Development<ma...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
On Tue, Apr 21, 2020 at 10:16 AM Yishay Weiss <yi...@hotmail.com>
wrote:
>
> >Yishay, can you please confirm that your release jobs are running without
> >being hindered by CI jobs?
>
> So far so good. Also, connection to CI server is much faster now, I’m
> assuming it’s because of the extra agent. Thanks for this.
>
That's good to know. Thanks for the confirmation!
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bigosmallm@gmail.com
> >
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
> >> you are talking about your VM, you can compare console output from
> recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem. Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an example of
> shared
> >> > resources that I mentioned upthread. Royale-typedefs is going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a built of
> >> > royale-compiler in it. If royale-compiler fails to create all of
> >> its
> >> > binaries or is in the process of building them, royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful, but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've never found
> >> enough
> >> > time and energy to try to make changes like that since most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> >
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still thinks
> that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the royale-compiler
> on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main &&
> exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala
> <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you checked
> what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can sometimes be
> a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact location as
> >> master.
> >> > >> >>> Moreover, the git call from the commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The royale-compiler
> is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run program "git"
> >> (in
> >> > directory
> >> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient. This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do have both
> the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > Update - I have successfully attached my VM
> as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > We could achieve the same by creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the current
> Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything in one
> UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That won't
> solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and tested,
> but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern: our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs from
> both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current agent to
> 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I don't
> think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37 AM,
> "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is nice to
> have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that, otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than using
> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > > bigosmallm@gmail.com
> <mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help set this
> up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr 12, 2020,
> at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I just
> looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes. Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just that we
> are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah. It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but probably worth
> it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I think I’ll
> try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >> suggestions. I do
> not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process. But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local machine. The
> ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One thing we
> can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d probably
> use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK, that's
> pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins jobs. The
> CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave it
> running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On 4/12/20,
> 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My experience
> is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience with
> Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Instances can
> be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than 10
> minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours of
> server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Leaving a
> server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s just
> spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr 12,
> 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access on
> private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same. IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared) MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs between
> releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is that what
> you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another committer
> got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On 4/12/20,
> 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Considering
> that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand. This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for release
> jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
Piotr, ignore this for now, looks like email.txt is empty.
From: Yishay Weiss<ma...@hotmail.com>
Sent: Saturday, May 2, 2020 2:19 PM
To: dev@royale.apache.org<ma...@royale.apache.org>; Piotr Zarzycki<ma...@gmail.com>
Subject: RE: Prioritize Release Jobs on CI
Success email for step 12 was sent to dev but I’m not seeing it. I wonder if Jenkins mails are being filtered out. @Piotr Zarzycki<ma...@gmail.com>, could this be related to your correspondence with infra on Jenkins?
From: Yishay Weiss<ma...@hotmail.com>
Sent: Saturday, May 2, 2020 1:43 PM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Step 12 was blocked on agent1 by TDF. Is it supposed to be configured to run on 2?
From: OmPrakash Muppirala<ma...@gmail.com>
Sent: Wednesday, April 22, 2020 2:47 AM
To: Apache Royale Development<ma...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
On Tue, Apr 21, 2020 at 10:16 AM Yishay Weiss <yi...@hotmail.com>
wrote:
>
> >Yishay, can you please confirm that your release jobs are running without
> >being hindered by CI jobs?
>
> So far so good. Also, connection to CI server is much faster now, I’m
> assuming it’s because of the extra agent. Thanks for this.
>
That's good to know. Thanks for the confirmation!
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bigosmallm@gmail.com
> >
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
> >> you are talking about your VM, you can compare console output from
> recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem. Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an example of
> shared
> >> > resources that I mentioned upthread. Royale-typedefs is going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a built of
> >> > royale-compiler in it. If royale-compiler fails to create all of
> >> its
> >> > binaries or is in the process of building them, royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful, but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've never found
> >> enough
> >> > time and energy to try to make changes like that since most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> >
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still thinks
> that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the royale-compiler
> on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main &&
> exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala
> <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you checked
> what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can sometimes be
> a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact location as
> >> master.
> >> > >> >>> Moreover, the git call from the commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The royale-compiler
> is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run program "git"
> >> (in
> >> > directory
> >> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient. This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do have both
> the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > Update - I have successfully attached my VM
> as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > We could achieve the same by creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the current
> Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything in one
> UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That won't
> solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and tested,
> but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern: our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs from
> both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current agent to
> 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I don't
> think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37 AM,
> "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is nice to
> have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that, otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than using
> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > > bigosmallm@gmail.com
> <mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help set this
> up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr 12, 2020,
> at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I just
> looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes. Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just that we
> are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah. It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but probably worth
> it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I think I’ll
> try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >> suggestions. I do
> not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process. But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local machine. The
> ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One thing we
> can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d probably
> use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK, that's
> pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins jobs. The
> CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave it
> running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On 4/12/20,
> 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My experience
> is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience with
> Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Instances can
> be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than 10
> minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours of
> server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Leaving a
> server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s just
> spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr 12,
> 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access on
> private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same. IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared) MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs between
> releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is that what
> you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another committer
> got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On 4/12/20,
> 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Considering
> that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand. This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for release
> jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
Success email for step 12 was sent to dev but I’m not seeing it. I wonder if Jenkins mails are being filtered out. @Piotr Zarzycki<ma...@gmail.com>, could this be related to your correspondence with infra on Jenkins?
From: Yishay Weiss<ma...@hotmail.com>
Sent: Saturday, May 2, 2020 1:43 PM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Step 12 was blocked on agent1 by TDF. Is it supposed to be configured to run on 2?
From: OmPrakash Muppirala<ma...@gmail.com>
Sent: Wednesday, April 22, 2020 2:47 AM
To: Apache Royale Development<ma...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
On Tue, Apr 21, 2020 at 10:16 AM Yishay Weiss <yi...@hotmail.com>
wrote:
>
> >Yishay, can you please confirm that your release jobs are running without
> >being hindered by CI jobs?
>
> So far so good. Also, connection to CI server is much faster now, I’m
> assuming it’s because of the extra agent. Thanks for this.
>
That's good to know. Thanks for the confirmation!
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bigosmallm@gmail.com
> >
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
> >> you are talking about your VM, you can compare console output from
> recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem. Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an example of
> shared
> >> > resources that I mentioned upthread. Royale-typedefs is going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a built of
> >> > royale-compiler in it. If royale-compiler fails to create all of
> >> its
> >> > binaries or is in the process of building them, royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful, but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've never found
> >> enough
> >> > time and energy to try to make changes like that since most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> >
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still thinks
> that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the royale-compiler
> on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main &&
> exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala
> <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you checked
> what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can sometimes be
> a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact location as
> >> master.
> >> > >> >>> Moreover, the git call from the commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The royale-compiler
> is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run program "git"
> >> (in
> >> > directory
> >> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient. This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do have both
> the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > Update - I have successfully attached my VM
> as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > We could achieve the same by creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the current
> Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything in one
> UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That won't
> solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and tested,
> but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern: our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs from
> both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current agent to
> 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I don't
> think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37 AM,
> "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is nice to
> have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that, otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than using
> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > > bigosmallm@gmail.com
> <mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help set this
> up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr 12, 2020,
> at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I just
> looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes. Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just that we
> are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah. It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but probably worth
> it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I think I’ll
> try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >> suggestions. I do
> not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process. But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local machine. The
> ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One thing we
> can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d probably
> use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK, that's
> pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins jobs. The
> CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave it
> running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On 4/12/20,
> 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My experience
> is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience with
> Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Instances can
> be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than 10
> minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours of
> server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Leaving a
> server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s just
> spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr 12,
> 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access on
> private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same. IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared) MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs between
> releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is that what
> you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another committer
> got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On 4/12/20,
> 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Considering
> that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand. This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for release
> jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
Step 12 was blocked on agent1 by TDF. Is it supposed to be configured to run on 2?
From: OmPrakash Muppirala<ma...@gmail.com>
Sent: Wednesday, April 22, 2020 2:47 AM
To: Apache Royale Development<ma...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
On Tue, Apr 21, 2020 at 10:16 AM Yishay Weiss <yi...@hotmail.com>
wrote:
>
> >Yishay, can you please confirm that your release jobs are running without
> >being hindered by CI jobs?
>
> So far so good. Also, connection to CI server is much faster now, I’m
> assuming it’s because of the extra agent. Thanks for this.
>
That's good to know. Thanks for the confirmation!
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bigosmallm@gmail.com
> >
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
> >> you are talking about your VM, you can compare console output from
> recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem. Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an example of
> shared
> >> > resources that I mentioned upthread. Royale-typedefs is going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a built of
> >> > royale-compiler in it. If royale-compiler fails to create all of
> >> its
> >> > binaries or is in the process of building them, royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful, but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've never found
> >> enough
> >> > time and energy to try to make changes like that since most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> >
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still thinks
> that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the royale-compiler
> on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main &&
> exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala
> <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you checked
> what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can sometimes be
> a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact location as
> >> master.
> >> > >> >>> Moreover, the git call from the commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The royale-compiler
> is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run program "git"
> >> (in
> >> > directory
> >> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient. This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do have both
> the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > Update - I have successfully attached my VM
> as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > We could achieve the same by creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the current
> Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything in one
> UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That won't
> solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and tested,
> but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern: our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs from
> both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current agent to
> 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I don't
> think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37 AM,
> "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is nice to
> have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that, otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than using
> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > > bigosmallm@gmail.com
> <mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help set this
> up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr 12, 2020,
> at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I just
> looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes. Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just that we
> are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah. It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but probably worth
> it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I think I’ll
> try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >> suggestions. I do
> not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process. But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local machine. The
> ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One thing we
> can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d probably
> use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK, that's
> pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins jobs. The
> CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave it
> running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On 4/12/20,
> 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My experience
> is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience with
> Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Instances can
> be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than 10
> minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours of
> server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Leaving a
> server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s just
> spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr 12,
> 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access on
> private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same. IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared) MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs between
> releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is that what
> you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another committer
> got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On 4/12/20,
> 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Considering
> that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand. This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for release
> jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Tue, Apr 21, 2020 at 10:16 AM Yishay Weiss <yi...@hotmail.com>
wrote:
>
> >Yishay, can you please confirm that your release jobs are running without
> >being hindered by CI jobs?
>
> So far so good. Also, connection to CI server is much faster now, I’m
> assuming it’s because of the extra agent. Thanks for this.
>
That's good to know. Thanks for the confirmation!
>
> On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bigosmallm@gmail.com
> >
> wrote:
>
> >
> > On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> > wrote:
> >
> >> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
> >> you are talking about your VM, you can compare console output from
> recent
> >> successful builds on both VMs.
> >>
> >>
> > I was talking about my VM.
> > A rebuild of royale-compiler seems to have fixed that problem. Now
> > royale-typedefs passes as well!
> >
> > Next up royale-asjs_jsonly...
> >
> >
> >> I'm done for tonight. Good luck,
> >> -Alex
> >>
> >> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui
> <aharui@adobe.com.invalid
> >> >
> >> wrote:
> >>
> >> > Royale-compiler has to be built first. This is an example of
> shared
> >> > resources that I mentioned upthread. Royale-typedefs is going to
> >> look for
> >> > a sibling workspace folder called royale-compiler with a built of
> >> > royale-compiler in it. If royale-compiler fails to create all of
> >> its
> >> > binaries or is in the process of building them, royale-typedefs
> >> will report
> >> > an error.
> >> >
> >>
> >> Got it. I was just looking at the logic here:
> >>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
> >>
> >> Weird. The royale-compiler build says it was successful, but I cant
> >> find
> >> the lib directory under
> >> C:\jenkins\workspace\royale-compiler\compiler-jx
> >>
> >>
> >>
> >>
> >> >
> >> > What should probably happen is that royale-typedefs pulls down the
> >> > lastsuccessfulartifacts from royale-compiler, but I've never found
> >> enough
> >> > time and energy to try to make changes like that since most of us
> >> do have
> >> > all of the folders as siblings.
> >> >
> >> > HTH,
> >> > -Alex
> >> >
> >> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> >
> >> wrote:
> >> >
> >> > I am now getting this error on royale-typedefs build:
> >> >
> >> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> >> The
> >> > following error occurred while executing this line:
> >> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
> >> >
> >> >
> >>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> >> > doesn't exist.
> >> >
> >> >
> >> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >> >
> >> > Here is the full console output:
> >> >
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >> >
> >> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> >> > bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> >> <aharui@adobe.com.invalid
> >> > >
> >> > > wrote:
> >> > >
> >> > >> Congratulations! But does that mean that JAVA_HOME is
> >> pointing at
> >> > a JRE
> >> > >> instead of a JDK? If you have other issues that might be a
> >> factor.
> >> > >>
> >> > >
> >> > > Yeah, I messed up initially by getting the JRE instead of
> >> JDK. I
> >> > have
> >> > > since corrected it. But for some reason Ant still thinks
> that
> >> > JAVA_HOME is
> >> > > the jre directory.
> >> > > I don't know how to fix this, hence the hack :-|
> >> > >
> >> > >
> >> > >
> >> > >
> >> > >>
> >> > >> HTH,
> >> > >> -Alex
> >> > >>
> >> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> I copied tools.jar from jdk/lib to the jre/lib. That
> >> seems to
> >> > have
> >> > >> fixed
> >> > >> the issue.
> >> > >> We now have a successful build of the royale-compiler
> on
> >> the
> >> > new Agent
> >> > >> machine!!
> >> > >>
> >> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> > >> bigosmallm@gmail.com>
> >> > >> wrote:
> >> > >>
> >> > >> > Restart dint help. Although Serkan's reply made me
> >> look at
> >> > how Ant
> >> > >> was
> >> > >> > getting invoked.
> >> > >> >
> >> > >> > I see this warning that tools.jar is missing:
> >> > >> >
> >> > >> > [royale-compiler] $ cmd.exe /C
> >> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main &&
> exit
> >> > >> %%ERRORLEVEL%%"
> >> > >> >
> >> > >> > Unable to locate tools.jar. Expected to find it in
> >> C:\Program
> >> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> > >> >
> >> > >> >
> >> > >> > I am pretty sure this is related to this issue.
> >> > >> >
> >> > >> >
> >> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala
> <
> >> > >> bigosmallm@gmail.com>
> >> > >> > wrote:
> >> > >> >
> >> > >> >>
> >> > >> >>
> >> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >> wrote:
> >> > >> >>
> >> > >> >>> Did you reboot your VM? Also, have you checked
> what
> >> user is
> >> > >> running
> >> > >> >>> Jenkins on your VM? I think that can sometimes be
> a
> >> > problem. I
> >> > >> might be
> >> > >> >>> running Jenkins as the user.
> >> > >> >>>
> >> > >> >>>
> >> > >> >> Agents don't require Jenkins to be running. I will
> >> give the
> >> > >> rebooting of
> >> > >> >> the VM a shot .
> >> > >> >>
> >> > >> >> Thanks,
> >> > >> >> Om
> >> > >> >>
> >> > >> >>
> >> > >> >>> -Alex
> >> > >> >>>
> >> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> >> > bigosmallm@gmail.com
> >> > >> >
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>>
> >> > >> >>> > Should be here:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> My git is located in the same exact location as
> >> master.
> >> > >> >>> Moreover, the git call from the commandline
> >> executes
> >> > fine.
> >> > >> The git
> >> > >> >>> call
> >> > >> >>> from ant exec is what is failing.
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > HTH,
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > From: OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > >> >>> > Reply-To: "dev@royale.apache.org" <
> >> > dev@royale.apache.org>
> >> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> > >> >>> > To: Apache Royale Development <
> >> dev@royale.apache.org>
> >> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> > >> >>> >
> >> > >> >>> > I'm a bit stumped here. The royale-compiler
> is
> >> > failing
> >> > >> with this
> >> > >> >>> error:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > BUILD FAILED
> >> > >> >>> >
> >> > >> >>> >
> >> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> >> > Execute
> >> > >> >>> failed:
> >> > >> >>> > java.io.IOException: Cannot run program "git"
> >> (in
> >> > directory
> >> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
> >> CreateProcess
> >> > >> error=2,
> >> > >> >>> The system
> >> > >> >>> > cannot find the file specified
> >> > >> >>> >
> >> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
> >> Source)
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > It is from this part of the jenkins.xml:
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > <target name="closure-lib-download"
> >> > description="Copies
> >> > >> Closure
> >> > >> >>> > Library from GitHub">
> >> > >> >>> > <echo message="Be patient. This takes
> >> a few
> >> > >> minutes..." />
> >> > >> >>> > <exec executable="git"
> >> > failifexecutionfails="true">
> >> > >> >>> > <arg value="clone" />
> >> > >> >>> > <arg value="
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> > >> >>> >"
> >> > >> >>> > />
> >> > >> >>> > <arg value="${closure.root}" />
> >> > >> >>> > </exec>
> >> > >> >>> > <echo>Cloned fresh copy of Google
> >> Closure
> >> > >> Library</echo>
> >> > >> >>> > </target>
> >> > >> >>> >
> >> > >> >>> > I am not sure how this executable call works
> >> without
> >> > the
> >> > >> full path.
> >> > >> >>> >
> >> > >> >>> > I checked the env variables, I do have both
> the
> >> > git/bin and
> >> > >> git/cmd
> >> > >> >>> > directory in the PATH:
> >> > >> >>> >
> >> > >> >>> > [cid:ii_k97zkk9o0]
> >> > >> >>> >
> >> > >> >>> > What am I missing?
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > Update - I have successfully attached my VM
> as
> >> a slave
> >> > >> agent of our
> >> > >> >>> > Jenkins instance.
> >> > >> >>> > I am going to pull the job -
> >> /royale-asjs_jsonly and
> >> > tie it
> >> > >> to my
> >> > >> >>> agent so
> >> > >> >>> > I can test it.
> >> > >> >>> >
> >> > >> >>> > It will fail for a sometime while I go set up
> >> my VM
> >> > with
> >> > >> all the
> >> > >> >>> > dependencies.
> >> > >> >>> >
> >> > >> >>> > Once we have the job successfully building on
> >> my VM,
> >> > we can
> >> > >> figure
> >> > >> >>> out how
> >> > >> >>> > to divide the load between the master and
> >> agent.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > We could achieve the same by creating a new
> >> agent
> >> > (separate
> >> > >> vm) and
> >> > >> >>> > attaching it as a slave to the current
> Jenkins
> >> server.
> >> > >> >>> >
> >> > >> >>> > Then we can use labels/tags to tie release
> >> jobs to one
> >> > >> agent and
> >> > >> >>> non
> >> > >> >>> > release jobs to another agent.
> >> > >> >>> >
> >> > >> >>> > That way we can maintain everything in one
> UI,
> >> one
> >> > login
> >> > >> while
> >> > >> >>> achieving
> >> > >> >>> > the concurrent building capabilities we want.
> >> > >> >>> >
> >> > >> >>> > Jenkins is built for this kind of stuff and I
> >> think it
> >> > >> would be
> >> > >> >>> best we
> >> > >> >>> > followed this practice.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> > >> <ah...@adobe.com.invalid>
> >> > >> >>> wrote:
> >> > >> >>> > Om, I thought you were going to get the image
> >> from my
> >> > VM
> >> > >> and run
> >> > >> >>> it on
> >> > >> >>> > another VM. Then we'd remove all non-release
> >> jobs
> >> > from
> >> > >> your VM
> >> > >> >>> and all of
> >> > >> >>> > the release jobs from my VM. That won't
> solve
> >> the
> >> > problem
> >> > >> of how
> >> > >> >>> long it
> >> > >> >>> > takes for a commit to be built and tested,
> but
> >> will
> >> > allow
> >> > >> the RM
> >> > >> >>> to get a
> >> > >> >>> > release out without getting stuck behind the
> >> commit
> >> > jobs.
> >> > >> Is that
> >> > >> >>> > currently the plan?
> >> > >> >>> >
> >> > >> >>> > -Alex
> >> > >> >>> >
> >> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> > >> bigosmallm@gmail.com
> >> > >> >>> <mailto:
> >> > >> >>> > bigosmallm@gmail.com>> wrote:
> >> > >> >>> >
> >> > >> >>> > Makes sense to me. I will set parallel
> >> executors
> >> > back
> >> > >> to 1.
> >> > >> >>> >
> >> > >> >>> > And start working on a new Jenkins
> >> instance.
> >> > >> >>> >
> >> > >> >>> > Thanks,
> >> > >> >>> > Om
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> > >> >>> <ah...@adobe.com.invalid>
> >> > >> >>> > wrote:
> >> > >> >>> >
> >> > >> >>> > > Are you saying that Java, Ant and Maven
> >> do not
> >> > know
> >> > >> how to
> >> > >> >>> > distribute work
> >> > >> >>> > > to different cores?
> >> > >> >>> > >
> >> > >> >>> > > To repeat my main concern: our Jenkins
> >> jobs
> >> > often
> >> > >> use shared
> >> > >> >>> > resources.
> >> > >> >>> > > If you want to take the time to fix
> >> that, feel
> >> > free,
> >> > >> but I
> >> > >> >>> do not
> >> > >> >>> > know how
> >> > >> >>> > > you are going to keep two jobs from
> both
> >> trying
> >> > to
> >> > >> launch
> >> > >> >>> Flash
> >> > >> >>> > Player
> >> > >> >>> > > Debugger at the same time and open the
> >> same
> >> > socket to
> >> > >> >>> communicate
> >> > >> >>> > with it,
> >> > >> >>> > > or try to parse the flashlog.txt that
> >> they have
> >> > both
> >> > >> written
> >> > >> >>> to.
> >> > >> >>> > >
> >> > >> >>> > > The royale-asjs job will use the
> >> royale-compiler
> >> > >> workspace
> >> > >> >>> to get the
> >> > >> >>> > > compiler. If the compiler is building,
> >> the
> >> > jars are
> >> > >> not
> >> > >> >>> there and
> >> > >> >>> > the
> >> > >> >>> > > royale-asjs build fails.
> >> > >> >>> > >
> >> > >> >>> > > There is also only so much memory and
> >> some of
> >> > our
> >> > >> jobs use
> >> > >> >>> all of it
> >> > >> >>> > and
> >> > >> >>> > > I'm not sure if jobs slowed down due to
> >> paging
> >> > memory
> >> > >> and
> >> > >> >>> > writing/reading
> >> > >> >>> > > from disk, even if it is an SSD.
> >> > >> >>> > >
> >> > >> >>> > > I'm done for tonight, but that's what I
> >> was
> >> > seeing
> >> > >> last time
> >> > >> >>> I tried
> >> > >> >>> > to
> >> > >> >>> > > have both master and an agent running
> >> jobs in
> >> > >> parallel.
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > -Alex
> >> > >> >>> > >
> >> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
> >> Muppirala" <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>> wrote:
> >> > >> >>> > >
> >> > >> >>> > > A typical setup would be to have 0
> >> > executors on
> >> > >> master
> >> > >> >>> and at
> >> > >> >>> > least n
> >> > >> >>> > > number of executors on each agent,
> >> where n =
> >> > >> number of
> >> > >> >>> cpu cores.
> >> > >> >>> > > I see that the current VM has 2
> >> cores. So,
> >> > I
> >> > >> started
> >> > >> >>> with
> >> > >> >>> > setting the
> >> > >> >>> > > num
> >> > >> >>> > > executors on the current agent to
> 2.
> >> > >> >>> > >
> >> > >> >>> > > This should improve things quite a
> >> bit. If
> >> > this
> >> > >> doesn't
> >> > >> >>> work, I
> >> > >> >>> > will
> >> > >> >>> > > create a new VM and make it the
> >> slave agent
> >> > of the
> >> > >> >>> current
> >> > >> >>> > Jenkins
> >> > >> >>> > > master.
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > > Thanks,
> >> > >> >>> > > Om
> >> > >> >>> > >
> >> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
> >> Alex Harui
> >> > >> >>> > <ah...@adobe.com.invalid>
> >> > >> >>> > > wrote:
> >> > >> >>> > >
> >> > >> >>> > > > On your VM or mine? I don't
> think
> >> mine
> >> > can
> >> > >> handle
> >> > >> >>> it. I used
> >> > >> >>> > to
> >> > >> >>> > > run jobs
> >> > >> >>> > > > of master and agent and we got
> >> lots of
> >> > failures
> >> > >> and
> >> > >> >>> jobs took
> >> > >> >>> > > forever. If
> >> > >> >>> > > > two jobs are trying to run tests
> >> with the
> >> > >> shared Flash
> >> > >> >>> Player
> >> > >> >>> > > Debugger, for
> >> > >> >>> > > > example, you won't get consistent
> >> results.
> >> > >> >>> > > >
> >> > >> >>> > > > -Alex
> >> > >> >>> > > >
> >> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> >> > Muppirala" <
> >> > >> >>> > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com>>
> >> > >> >>> > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > I just realized that we have
> >> only one
> >> > Agent
> >> > >> (node)
> >> > >> >>> listed
> >> > >> >>> > under
> >> > >> >>> > > > Jenkins. I
> >> > >> >>> > > > am going to add at least one
> >> more
> >> > node to
> >> > >> start
> >> > >> >>> with.
> >> > >> >>> > > >
> >> > >> >>> > > > Thanks,
> >> > >> >>> > > > Om
> >> > >> >>> > > >
> >> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
> >> AM Alex
> >> > Harui
> >> > >> >>> > > <ah...@adobe.com.invalid>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > >
> >> > >> >>> > > > > I think I followed the
> >> instructions
> >> > and
> >> > >> enabled
> >> > >> >>> SSH.
> >> > >> >>> > > > >
> >> > >> >>> > > > > On 4/16/20, 9:37 AM,
> "Yishay
> >> Weiss"
> >> > <
> >> > >> >>> > yishayjobs@hotmail.com<mailto:
> >> yishayjobs@hotmail.com
> >> > >>
> >> > >> >>> > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > I haven’t gotten it to
> >> work.
> >> > Could be
> >> > >> ssh
> >> > >> >>> needs to be
> >> > >> >>> > > enabled on
> >> > >> >>> > > > the
> >> > >> >>> > > > > VM [1]. This is nice to
> have
> >> but not
> >> > >> essential.
> >> > >> >>> So Alex,
> >> > >> >>> > let
> >> > >> >>> > > me know
> >> > >> >>> > > > if you
> >> > >> >>> > > > > want to try that, otherwise
> >> I’ll
> >> > suspend
> >> > >> my
> >> > >> >>> efforts on
> >> > >> >>> > this.
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Wednesday, April
> >> 15, 2020
> >> > 5:09
> >> > >> PM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > I’d like to try and
> >> install an
> >> > ssh
> >> > >> server.
> >> > >> >>> Can anyone
> >> > >> >>> > > think of a
> >> > >> >>> > > > > reason not to do that? I’m
> >> asking in
> >> > >> terms of
> >> > >> >>> security,
> >> > >> >>> > and if
> >> > >> >>> > > there
> >> > >> >>> > > > might
> >> > >> >>> > > > > be a problem because it’s a
> >> VM.
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks.
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 10:02 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Related, as most (all?)
> >> of the
> >> > >> instructions
> >> > >> >>> don’t
> >> > >> >>> > require
> >> > >> >>> > > > anything but
> >> > >> >>> > > > > a shell wouldn’t it be
> >> easier and
> >> > faster
> >> > >> to
> >> > >> >>> access the
> >> > >> >>> > machine
> >> > >> >>> > > with
> >> > >> >>> > > > ssh
> >> > >> >>> > > > > [1], rather than using
> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > > [1]
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > >
> >> > >> >>> > > > > From: Yishay
> >> Weiss<mailto:
> >> > >> >>> yishayjobs@hotmail.com
> >> > >> >>> > <ma...@hotmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:55 AM
> >> > >> >>> > > > > To:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org><mailto:
> >> dev@royale.apache.org
> >> > <mailto:
> >> > >> >>> > dev@royale.apache.org>>
> >> > >> >>> > > > > Subject: RE: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Can’t you do that with
> >> remote
> >> > desktop?
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> ________________________________
> >> > >> >>> > > > > From: OmPrakash
> >> Muppirala <
> >> > >> >>> bigosmallm@gmail.com
> >> > >> >>> > <ma...@gmail.com>>
> >> > >> >>> > > > > Sent: Monday, April 13,
> >> 2020
> >> > 9:51:25
> >> > >> AM
> >> > >> >>> > > > > To: Apache Royale
> >> Development <
> >> > >> >>> dev@royale.apache.org
> >> > >> >>> > <ma...@royale.apache.org>>
> >> > >> >>> > > > > Subject: Re: Prioritize
> >> Release
> >> > Jobs
> >> > >> on CI
> >> > >> >>> > > > >
> >> > >> >>> > > > > Alex,
> >> > >> >>> > > > >
> >> > >> >>> > > > > I believe this is your
> >> personal
> >> > Azure
> >> > >> >>> subscription
> >> > >> >>> > right?
> >> > >> >>> > > Any
> >> > >> >>> > > > chance
> >> > >> >>> > > > > I can
> >> > >> >>> > > > > get access to it so I
> >> can try
> >> > to copy
> >> > >> the
> >> > >> >>> image out
> >> > >> >>> > the
> >> > >> >>> > > machine
> >> > >> >>> > > > and
> >> > >> >>> > > > > redeploy it somewhere
> >> else?
> >> > >> >>> > > > >
> >> > >> >>> > > > > Thanks,
> >> > >> >>> > > > > Om
> >> > >> >>> > > > >
> >> > >> >>> > > > > On Sun, Apr 12, 2020 at
> >> 6:18 PM
> >> > >> OmPrakash
> >> > >> >>> Muppirala <
> >> > >> >>> > > > > bigosmallm@gmail.com
> <mailto:
> >> > >> bigosmallm@gmail.com
> >> > >> >>> >>
> >> > >> >>> > > > > wrote:
> >> > >> >>> > > > >
> >> > >> >>> > > > > > I can help set this
> up
> >> on
> >> > Azure.
> >> > >> Give me
> >> > >> >>> some
> >> > >> >>> > time to
> >> > >> >>> > > work
> >> > >> >>> > > > out the
> >> > >> >>> > > > > > details?
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > Thanks,
> >> > >> >>> > > > > > Om
> >> > >> >>> > > > > >
> >> > >> >>> > > > > > On Sun, Apr 12, 2020,
> >> 11:49 AM
> >> > >> Harbs <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> OK. Good to know.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >> > On Apr 12, 2020,
> at
> >> 9:45
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > FWIW, I just
> looked
> >> and the
> >> > >> longest job
> >> > >> >>> in the
> >> > >> >>> > release
> >> > >> >>> > > > steps so
> >> > >> >>> > > > > far is
> >> > >> >>> > > > > >> 8 minutes. Most are
> >> under 2
> >> > >> minutes.
> >> > >> >>> There
> >> > >> >>> > might be
> >> > >> >>> > > jobs
> >> > >> >>> > > > later
> >> > >> >>> > > > > that take
> >> > >> >>> > > > > >> longer that we
> >> haven't run
> >> > yet.
> >> > >> IMO, the
> >> > >> >>> issue
> >> > >> >>> > isn't
> >> > >> >>> > > speed
> >> > >> >>> > > > of the
> >> > >> >>> > > > > machine,
> >> > >> >>> > > > > >> it is just that we
> are
> >> > sharing the
> >> > >> >>> machine with
> >> > >> >>> > longer
> >> > >> >>> > > jobs
> >> > >> >>> > > > (1 hour
> >> > >> >>> > > > > for
> >> > >> >>> > > > > >>
> >> TourDeFlexMigration). And
> >> > again,
> >> > >> the
> >> > >> >>> machine
> >> > >> >>> > will be
> >> > >> >>> > > idle for
> >> > >> >>> > > > > stretches of
> >> > >> >>> > > > > >> time while the RM
> >> verifies
> >> > >> artifacts
> >> > >> >>> after each
> >> > >> >>> > step.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > -Alex
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > On 4/12/20, 11:32
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Fair enough.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I expect builds
> >> to be
> >> > >> somewhere
> >> > >> >>> between 10
> >> > >> >>> > and 20
> >> > >> >>> > > times
> >> > >> >>> > > > faster
> >> > >> >>> > > > > on a
> >> > >> >>> > > > > >> powerful machine.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Yeah. It’s
> >> probably
> >> > going to
> >> > >> be a
> >> > >> >>> bit of work
> >> > >> >>> > > changing
> >> > >> >>> > > > the
> >> > >> >>> > > > > server,
> >> > >> >>> > > > > >> but probably worth
> it
> >> in the
> >> > long
> >> > >> run.
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > I think I’ll
> try
> >> this
> >> > when I
> >> > >> do the
> >> > >> >>> next
> >> > >> >>> > release
> >> > >> >>> > > unless
> >> > >> >>> > > > Yishay
> >> > >> >>> > > > > wants
> >> > >> >>> > > > > >> to work with me on
> >> this for
> >> > this
> >> > >> release
> >> > >> >>> — but
> >> > >> >>> > I’m not
> >> > >> >>> > > going
> >> > >> >>> > > > to be
> >> > >> >>> > > > > able to
> >> > >> >>> > > > > >> help until after
> >> Passover
> >> > (i.e.
> >> > >> next
> >> > >> >>> week).
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> > Thanks,
> >> > >> >>> > > > > >> > Harbs
> >> > >> >>> > > > > >> >
> >> > >> >>> > > > > >> >> On Apr 12, 2020,
> >> at 9:22
> >> > PM,
> >> > >> Alex Harui
> >> > >> >>> > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The Azure portal
> >> says:
> >> > Standard
> >> > >> F2s_v2
> >> > >> >>> (2
> >> > >> >>> > vcpus, 4
> >> > >> >>> > > GiB
> >> > >> >>> > > > memory)
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> I think I am
> >> reading
> >> > changes to
> >> > >> the
> >> > >> >>> build
> >> > >> >>> > process in
> >> > >> >>> > > your
> >> > >> >>> > > > > >> suggestions. I do
> not
> >> > really want
> >> > >> to
> >> > >> >>> spend more
> >> > >> >>> > of my
> >> > >> >>> > > time
> >> > >> >>> > > > on this
> >> > >> >>> > > > > >> process. But if you
> >> want to
> >> > do
> >> > >> the work,
> >> > >> >>> that's
> >> > >> >>> > fine
> >> > >> >>> > > with me.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> -Alex
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> On 4/12/20, 10:57
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > harbs.lists@gmail.com<mailto:
> >> harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>> <mailto:
> >> harbs.lists@gmail.com
> >> > >> <mailto:
> >> > >> >>> > harbs.lists@gmail.com>
> >> > >> >>> > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> What kind of
> >> horsepower
> >> > is
> >> > >> included
> >> > >> >>> in the
> >> > >> >>> > free
> >> > >> >>> > > Azure
> >> > >> >>> > > > account?
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> The server I
> >> mentioned
> >> > builds
> >> > >> >>> (considerably)
> >> > >> >>> > > faster than
> >> > >> >>> > > > my own
> >> > >> >>> > > > > >> local machine. The
> ci
> >> server
> >> > seems
> >> > >> to
> >> > >> >>> build many
> >> > >> >>> > times
> >> > >> >>> > > slower.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >> One thing we
> can
> >> do to
> >> > >> minimize
> >> > >> >>> running
> >> > >> >>> > server time
> >> > >> >>> > > > would be to
> >> > >> >>> > > > > >> transfer the
> >> artifacts to
> >> > storage
> >> > >> instead
> >> > >> >>> of
> >> > >> >>> > keeping
> >> > >> >>> > > them on
> >> > >> >>> > > > the
> >> > >> >>> > > > > server. On
> >> > >> >>> > > > > >> AWS, I’d probably
> use
> >> S3.
> >> > Not sure
> >> > >> what
> >> > >> >>> the
> >> > >> >>> > similar
> >> > >> >>> > > service on
> >> > >> >>> > > > > Azure is
> >> > >> >>> > > > > >> called.
> >> > >> >>> > > > > >> >>
> >> > >> >>> > > > > >> >>> On Apr 12, 2020,
> >> at 8:26
> >> > PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <aharui@adobe.com.INVALID
> >> > >> >>> > > > > >> <mailto:
> >> > aharui@adobe.com.INVALID
> >> > >> <mailto:
> >> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> OK, that's
> pretty
> >> much
> >> > how I
> >> > >> >>> understand Azure
> >> > >> >>> > as
> >> > >> >>> > > well.
> >> > >> >>> > > > The key
> >> > >> >>> > > > > thing
> >> > >> >>> > > > > >> is that "running"
> >> includes
> >> > time
> >> > >> where the
> >> > >> >>> CI
> >> > >> >>> > server is
> >> > >> >>> > > not
> >> > >> >>> > > > running
> >> > >> >>> > > > > any
> >> > >> >>> > > > > >> Jenkins jobs. The
> CI
> >> Server
> >> > steps
> >> > >> might
> >> > >> >>> take
> >> > >> >>> > only a few
> >> > >> >>> > > > hours of
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> server time, but
> >> there is
> >> > time
> >> > >> where the
> >> > >> >>> RM is
> >> > >> >>> > verifying
> >> > >> >>> > > > artifacts
> >> > >> >>> > > > > locally
> >> > >> >>> > > > > >> so you'd be paying
> >> for that
> >> > or the
> >> > >> RM
> >> > >> >>> would have
> >> > >> >>> > to keep
> >> > >> >>> > > > shutting
> >> > >> >>> > > > > down and
> >> > >> >>> > > > > >> restarting.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Seems like it
> >> would be
> >> > >> >>> cheaper/simpler to get
> >> > >> >>> > the
> >> > >> >>> > > free
> >> > >> >>> > > > MSDN
> >> > >> >>> > > > > account
> >> > >> >>> > > > > >> and leave it
> running.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> -Alex
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> On 4/12/20,
> 10:15
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>
> >> > >> >>> > > > <mailto:
> >> > >> >>> > > > > >>
> harbs.lists@gmail.com
> >> > <mailto:
> >> > >> >>> > harbs.lists@gmail.com>>> wrote:
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> My experience
> is
> >> with
> >> > AWS.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I assume
> >> Microsoft has
> >> > similar
> >> > >> >>> offerings,
> >> > >> >>> > but I
> >> > >> >>> > > don’t
> >> > >> >>> > > > have
> >> > >> >>> > > > > >> experience with
> Azure.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> AWS has
> >> on-demand EC2
> >> > >> instances
> >> > >> >>> which you
> >> > >> >>> > pay for
> >> > >> >>> > > only
> >> > >> >>> > > > the
> >> > >> >>> > > > > actual
> >> > >> >>> > > > > >> time that they are
> >> > running.[1]
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Instances can
> be
> >> > started and
> >> > >> stopped
> >> > >> >>> via
> >> > >> >>> > command
> >> > >> >>> > > line
> >> > >> >>> > > > (or via
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> web interface) as
> >> long as
> >> > you have
> >> > >> valid
> >> > >> >>> > credentials to
> >> > >> >>> > > do so.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> For example: an
> >> > m5.4xlarge
> >> > >> instance
> >> > >> >>> has 16
> >> > >> >>> > cores
> >> > >> >>> > > and
> >> > >> >>> > > > costs
> >> > >> >>> > > > > about
> >> > >> >>> > > > > >> $1.5 per hour. On a
> >> machine
> >> > like
> >> > >> that, a
> >> > >> >>> full
> >> > >> >>> > build
> >> > >> >>> > > would
> >> > >> >>> > > > probably
> >> > >> >>> > > > > take
> >> > >> >>> > > > > >> less than 10
> minutes.
> >> It’s
> >> > probably
> >> > >> >>> possible to
> >> > >> >>> > do a
> >> > >> >>> > > full
> >> > >> >>> > > > release
> >> > >> >>> > > > > with only
> >> > >> >>> > > > > >> a few hours of
> server
> >> time.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> Leaving a
> server
> >> like
> >> > that
> >> > >> running
> >> > >> >>> all the
> >> > >> >>> > time
> >> > >> >>> > > would get
> >> > >> >>> > > > > expensive,
> >> > >> >>> > > > > >> but if it’s just
> spun
> >> up for
> >> > >> releases,
> >> > >> >>> you’d get
> >> > >> >>> > very
> >> > >> >>> > > fast
> >> > >> >>> > > > builds
> >> > >> >>> > > > > at a
> >> > >> >>> > > > > >> reasonable price.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> I’d be happy to
> >> pay
> >> > $10-$50
> >> > >> (and
> >> > >> >>> possibly
> >> > >> >>> > more) per
> >> > >> >>> > > > release to
> >> > >> >>> > > > > make
> >> > >> >>> > > > > >> the release process
> >> painless
> >> > for
> >> > >> the RM.
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>> [1]
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> ><
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> <
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > <
> >> > >> >>> >
> >> > >> >>>
> >> > >>
> >> >
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> > >> >>> > >
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>
> >> > >> >>> > > > > >> >>>> On Apr 12,
> 2020,
> >> at
> >> > 7:45 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I'm not very
> >> > experienced with
> >> > >> >>> spinning up
> >> > >> >>> > > servers. The
> >> > >> >>> > > > CI
> >> > >> >>> > > > > server we
> >> > >> >>> > > > > >> are using is
> >> effectively
> >> > free,
> >> > >> based on a
> >> > >> >>> generous
> >> > >> >>> > > donation
> >> > >> >>> > > > from
> >> > >> >>> > > > > Microsoft
> >> > >> >>> > > > > >> of MSDN accounts to
> >> ASF
> >> > >> committers. So I
> >> > >> >>> leave
> >> > >> >>> > it up
> >> > >> >>> > > 24/7,
> >> > >> >>> > > > and
> >> > >> >>> > > > > share the
> >> > >> >>> > > > > >> RDP access on
> private@.
> >> I
> >> > think
> >> > >> any
> >> > >> >>> other ASF
> >> > >> >>> > > committer
> >> > >> >>> > > > could do
> >> > >> >>> > > > > the
> >> > >> >>> > > > > >> same. IIRC, if that
> >> server
> >> > >> actually is
> >> > >> >>> stopped,
> >> > >> >>> > I have
> >> > >> >>> > > to
> >> > >> >>> > > > use my
> >> > >> >>> > > > > personal
> >> > >> >>> > > > > >> (unshared) MSDN
> >> credentials
> >> > to
> >> > >> start it
> >> > >> >>> again.
> >> > >> >>> > AIUI,
> >> > >> >>> > > if I
> >> > >> >>> > > > > actually paid
> >> > >> >>> > > > > >> for the server, it
> >> would
> >> > cost me
> >> > >> to leave
> >> > >> >>> it
> >> > >> >>> > running
> >> > >> >>> > > even if
> >> > >> >>> > > > it
> >> > >> >>> > > > > didn't run
> >> > >> >>> > > > > >> jobs between
> releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Is that what
> you
> >> are
> >> > basically
> >> > >> >>> saying? I
> >> > >> >>> > think it
> >> > >> >>> > > might
> >> > >> >>> > > > be
> >> > >> >>> > > > > best if
> >> > >> >>> > > > > >> another committer
> got
> >> a CI
> >> > server
> >> > >> going
> >> > >> >>> via the MS
> >> > >> >>> > > donation
> >> > >> >>> > > > and
> >> > >> >>> > > > > could leave
> >> > >> >>> > > > > >> it up 24/7.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> -Alex
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> On 4/12/20,
> 9:28
> >> AM,
> >> > "Harbs" <
> >> > >> >>> > > harbs.lists@gmail.com<mailto:
> >> > harbs.lists@gmail.com>>
> >> > >> >>> > > > wrote:
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> I’m willing to
> >> do this.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Considering
> that
> >> the
> >> > release
> >> > >> will be
> >> > >> >>> run
> >> > >> >>> > > infrequently, it
> >> > >> >>> > > > > should be
> >> > >> >>> > > > > >> doable to have a
> >> relatively
> >> > >> powerful
> >> > >> >>> server that
> >> > >> >>> > could
> >> > >> >>> > > be
> >> > >> >>> > > > spun up on
> >> > >> >>> > > > > >> demand. This is
> >> something I
> >> > have
> >> > >> setup
> >> > >> >>> for my own
> >> > >> >>> > > releases.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> The only
> >> complication
> >> > would
> >> > >> be that
> >> > >> >>> each RM
> >> > >> >>> > would
> >> > >> >>> > > need
> >> > >> >>> > > > valid
> >> > >> >>> > > > > >> credentials to spin
> >> up the
> >> > server.
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>> Harbs
> >> > >> >>> > > > > >> >>>>
> >> > >> >>> > > > > >> >>>>> On Apr 12,
> >> 2020, at
> >> > 7:10 PM,
> >> > >> Alex
> >> > >> >>> Harui
> >> > >> >>> > > > > <ah...@adobe.com.INVALID>
> >> > >> >>> > > > > >> wrote:
> >> > >> >>> > > > > >> >>>>>
> >> > >> >>> > > > > >> >>>>> A better
> >> solution,
> >> > IMO, is
> >> > >> for
> >> > >> >>> someone else
> >> > >> >>> > to
> >> > >> >>> > > offer up
> >> > >> >>> > > > a CI
> >> > >> >>> > > > > server
> >> > >> >>> > > > > >> only for release
> jobs.
> >> > >> >>> > > > > >>
> >> > >> >>> > > > > >>
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> > >
> >> > >> >>> >
> >> > >> >>> >
> >> > >> >>>
> >> > >> >>>
> >> > >> >>>
> >> > >>
> >> > >>
> >> > >>
> >> >
> >> >
> >> >
> >>
> >>
> >>
>
>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
>Yishay, can you please confirm that your release jobs are running without
>being hindered by CI jobs?
So far so good. Also, connection to CI server is much faster now, I’m assuming it’s because of the extra agent. Thanks for this.
On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bi...@gmail.com>
wrote:
>
> On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
>> you are talking about your VM, you can compare console output from recent
>> successful builds on both VMs.
>>
>>
> I was talking about my VM.
> A rebuild of royale-compiler seems to have fixed that problem. Now
> royale-typedefs passes as well!
>
> Next up royale-asjs_jsonly...
>
>
>> I'm done for tonight. Good luck,
>> -Alex
>>
>> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <aharui@adobe.com.invalid
>> >
>> wrote:
>>
>> > Royale-compiler has to be built first. This is an example of shared
>> > resources that I mentioned upthread. Royale-typedefs is going to
>> look for
>> > a sibling workspace folder called royale-compiler with a built of
>> > royale-compiler in it. If royale-compiler fails to create all of
>> its
>> > binaries or is in the process of building them, royale-typedefs
>> will report
>> > an error.
>> >
>>
>> Got it. I was just looking at the logic here:
>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
>>
>> Weird. The royale-compiler build says it was successful, but I cant
>> find
>> the lib directory under
>> C:\jenkins\workspace\royale-compiler\compiler-jx
>>
>>
>>
>>
>> >
>> > What should probably happen is that royale-typedefs pulls down the
>> > lastsuccessfulartifacts from royale-compiler, but I've never found
>> enough
>> > time and energy to try to make changes like that since most of us
>> do have
>> > all of the folders as siblings.
>> >
>> > HTH,
>> > -Alex
>> >
>> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>> >
>> > I am now getting this error on royale-typedefs build:
>> >
>> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
>> The
>> > following error occurred while executing this line:
>> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>> >
>> >
>> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
>> > doesn't exist.
>> >
>> >
>> > Where does the ROYALE_TRANSPILER_HOME var come from?
>> >
>> > Here is the full console output:
>> >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>> >
>> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
>> > bigosmallm@gmail.com>
>> > wrote:
>> >
>> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
>> <aharui@adobe.com.invalid
>> > >
>> > > wrote:
>> > >
>> > >> Congratulations! But does that mean that JAVA_HOME is
>> pointing at
>> > a JRE
>> > >> instead of a JDK? If you have other issues that might be a
>> factor.
>> > >>
>> > >
>> > > Yeah, I messed up initially by getting the JRE instead of
>> JDK. I
>> > have
>> > > since corrected it. But for some reason Ant still thinks that
>> > JAVA_HOME is
>> > > the jre directory.
>> > > I don't know how to fix this, hence the hack :-|
>> > >
>> > >
>> > >
>> > >
>> > >>
>> > >> HTH,
>> > >> -Alex
>> > >>
>> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> I copied tools.jar from jdk/lib to the jre/lib. That
>> seems to
>> > have
>> > >> fixed
>> > >> the issue.
>> > >> We now have a successful build of the royale-compiler on
>> the
>> > new Agent
>> > >> machine!!
>> > >>
>> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > Restart dint help. Although Serkan's reply made me
>> look at
>> > how Ant
>> > >> was
>> > >> > getting invoked.
>> > >> >
>> > >> > I see this warning that tools.jar is missing:
>> > >> >
>> > >> > [royale-compiler] $ cmd.exe /C
>> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
>> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
>> > >> %%ERRORLEVEL%%"
>> > >> >
>> > >> > Unable to locate tools.jar. Expected to find it in
>> C:\Program
>> > >> Files\Java\jre1.8.0_251\lib\tools.jar
>> > >> >
>> > >> >
>> > >> > I am pretty sure this is related to this issue.
>> > >> >
>> > >> >
>> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> > wrote:
>> > >> >
>> > >> >>
>> > >> >>
>> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >> wrote:
>> > >> >>
>> > >> >>> Did you reboot your VM? Also, have you checked what
>> user is
>> > >> running
>> > >> >>> Jenkins on your VM? I think that can sometimes be a
>> > problem. I
>> > >> might be
>> > >> >>> running Jenkins as the user.
>> > >> >>>
>> > >> >>>
>> > >> >> Agents don't require Jenkins to be running. I will
>> give the
>> > >> rebooting of
>> > >> >> the VM a shot .
>> > >> >>
>> > >> >> Thanks,
>> > >> >> Om
>> > >> >>
>> > >> >>
>> > >> >>> -Alex
>> > >> >>>
>> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
>> > bigosmallm@gmail.com
>> > >> >
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> > Should be here:
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
>> > >> >>>
>> > >> >>>
>> > >> >>> My git is located in the same exact location as
>> master.
>> > >> >>> Moreover, the git call from the commandline
>> executes
>> > fine.
>> > >> The git
>> > >> >>> call
>> > >> >>> from ant exec is what is failing.
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > HTH,
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > From: OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> > >> >>> > Reply-To: "dev@royale.apache.org" <
>> > dev@royale.apache.org>
>> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> > >> >>> > To: Apache Royale Development <
>> dev@royale.apache.org>
>> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
>> > >> >>> >
>> > >> >>> > I'm a bit stumped here. The royale-compiler is
>> > failing
>> > >> with this
>> > >> >>> error:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > BUILD FAILED
>> > >> >>> >
>> > >> >>> >
>> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
>> > Execute
>> > >> >>> failed:
>> > >> >>> > java.io.IOException: Cannot run program "git"
>> (in
>> > directory
>> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
>> CreateProcess
>> > >> error=2,
>> > >> >>> The system
>> > >> >>> > cannot find the file specified
>> > >> >>> >
>> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
>> Source)
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > It is from this part of the jenkins.xml:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > <target name="closure-lib-download"
>> > description="Copies
>> > >> Closure
>> > >> >>> > Library from GitHub">
>> > >> >>> > <echo message="Be patient. This takes
>> a few
>> > >> minutes..." />
>> > >> >>> > <exec executable="git"
>> > failifexecutionfails="true">
>> > >> >>> > <arg value="clone" />
>> > >> >>> > <arg value="
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
>> > >> >>> <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
>> > >> >>> >"
>> > >> >>> > />
>> > >> >>> > <arg value="${closure.root}" />
>> > >> >>> > </exec>
>> > >> >>> > <echo>Cloned fresh copy of Google
>> Closure
>> > >> Library</echo>
>> > >> >>> > </target>
>> > >> >>> >
>> > >> >>> > I am not sure how this executable call works
>> without
>> > the
>> > >> full path.
>> > >> >>> >
>> > >> >>> > I checked the env variables, I do have both the
>> > git/bin and
>> > >> git/cmd
>> > >> >>> > directory in the PATH:
>> > >> >>> >
>> > >> >>> > [cid:ii_k97zkk9o0]
>> > >> >>> >
>> > >> >>> > What am I missing?
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > Update - I have successfully attached my VM as
>> a slave
>> > >> agent of our
>> > >> >>> > Jenkins instance.
>> > >> >>> > I am going to pull the job -
>> /royale-asjs_jsonly and
>> > tie it
>> > >> to my
>> > >> >>> agent so
>> > >> >>> > I can test it.
>> > >> >>> >
>> > >> >>> > It will fail for a sometime while I go set up
>> my VM
>> > with
>> > >> all the
>> > >> >>> > dependencies.
>> > >> >>> >
>> > >> >>> > Once we have the job successfully building on
>> my VM,
>> > we can
>> > >> figure
>> > >> >>> out how
>> > >> >>> > to divide the load between the master and
>> agent.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > We could achieve the same by creating a new
>> agent
>> > (separate
>> > >> vm) and
>> > >> >>> > attaching it as a slave to the current Jenkins
>> server.
>> > >> >>> >
>> > >> >>> > Then we can use labels/tags to tie release
>> jobs to one
>> > >> agent and
>> > >> >>> non
>> > >> >>> > release jobs to another agent.
>> > >> >>> >
>> > >> >>> > That way we can maintain everything in one UI,
>> one
>> > login
>> > >> while
>> > >> >>> achieving
>> > >> >>> > the concurrent building capabilities we want.
>> > >> >>> >
>> > >> >>> > Jenkins is built for this kind of stuff and I
>> think it
>> > >> would be
>> > >> >>> best we
>> > >> >>> > followed this practice.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>> > Om, I thought you were going to get the image
>> from my
>> > VM
>> > >> and run
>> > >> >>> it on
>> > >> >>> > another VM. Then we'd remove all non-release
>> jobs
>> > from
>> > >> your VM
>> > >> >>> and all of
>> > >> >>> > the release jobs from my VM. That won't solve
>> the
>> > problem
>> > >> of how
>> > >> >>> long it
>> > >> >>> > takes for a commit to be built and tested, but
>> will
>> > allow
>> > >> the RM
>> > >> >>> to get a
>> > >> >>> > release out without getting stuck behind the
>> commit
>> > jobs.
>> > >> Is that
>> > >> >>> > currently the plan?
>> > >> >>> >
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
>> > >> bigosmallm@gmail.com
>> > >> >>> <mailto:
>> > >> >>> > bigosmallm@gmail.com>> wrote:
>> > >> >>> >
>> > >> >>> > Makes sense to me. I will set parallel
>> executors
>> > back
>> > >> to 1.
>> > >> >>> >
>> > >> >>> > And start working on a new Jenkins
>> instance.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> > >> >>> <ah...@adobe.com.invalid>
>> > >> >>> > wrote:
>> > >> >>> >
>> > >> >>> > > Are you saying that Java, Ant and Maven
>> do not
>> > know
>> > >> how to
>> > >> >>> > distribute work
>> > >> >>> > > to different cores?
>> > >> >>> > >
>> > >> >>> > > To repeat my main concern: our Jenkins
>> jobs
>> > often
>> > >> use shared
>> > >> >>> > resources.
>> > >> >>> > > If you want to take the time to fix
>> that, feel
>> > free,
>> > >> but I
>> > >> >>> do not
>> > >> >>> > know how
>> > >> >>> > > you are going to keep two jobs from both
>> trying
>> > to
>> > >> launch
>> > >> >>> Flash
>> > >> >>> > Player
>> > >> >>> > > Debugger at the same time and open the
>> same
>> > socket to
>> > >> >>> communicate
>> > >> >>> > with it,
>> > >> >>> > > or try to parse the flashlog.txt that
>> they have
>> > both
>> > >> written
>> > >> >>> to.
>> > >> >>> > >
>> > >> >>> > > The royale-asjs job will use the
>> royale-compiler
>> > >> workspace
>> > >> >>> to get the
>> > >> >>> > > compiler. If the compiler is building,
>> the
>> > jars are
>> > >> not
>> > >> >>> there and
>> > >> >>> > the
>> > >> >>> > > royale-asjs build fails.
>> > >> >>> > >
>> > >> >>> > > There is also only so much memory and
>> some of
>> > our
>> > >> jobs use
>> > >> >>> all of it
>> > >> >>> > and
>> > >> >>> > > I'm not sure if jobs slowed down due to
>> paging
>> > memory
>> > >> and
>> > >> >>> > writing/reading
>> > >> >>> > > from disk, even if it is an SSD.
>> > >> >>> > >
>> > >> >>> > > I'm done for tonight, but that's what I
>> was
>> > seeing
>> > >> last time
>> > >> >>> I tried
>> > >> >>> > to
>> > >> >>> > > have both master and an agent running
>> jobs in
>> > >> parallel.
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > -Alex
>> > >> >>> > >
>> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
>> Muppirala" <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > >
>> > >> >>> > > A typical setup would be to have 0
>> > executors on
>> > >> master
>> > >> >>> and at
>> > >> >>> > least n
>> > >> >>> > > number of executors on each agent,
>> where n =
>> > >> number of
>> > >> >>> cpu cores.
>> > >> >>> > > I see that the current VM has 2
>> cores. So,
>> > I
>> > >> started
>> > >> >>> with
>> > >> >>> > setting the
>> > >> >>> > > num
>> > >> >>> > > executors on the current agent to 2.
>> > >> >>> > >
>> > >> >>> > > This should improve things quite a
>> bit. If
>> > this
>> > >> doesn't
>> > >> >>> work, I
>> > >> >>> > will
>> > >> >>> > > create a new VM and make it the
>> slave agent
>> > of the
>> > >> >>> current
>> > >> >>> > Jenkins
>> > >> >>> > > master.
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > Om
>> > >> >>> > >
>> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
>> Alex Harui
>> > >> >>> > <ah...@adobe.com.invalid>
>> > >> >>> > > wrote:
>> > >> >>> > >
>> > >> >>> > > > On your VM or mine? I don't think
>> mine
>> > can
>> > >> handle
>> > >> >>> it. I used
>> > >> >>> > to
>> > >> >>> > > run jobs
>> > >> >>> > > > of master and agent and we got
>> lots of
>> > failures
>> > >> and
>> > >> >>> jobs took
>> > >> >>> > > forever. If
>> > >> >>> > > > two jobs are trying to run tests
>> with the
>> > >> shared Flash
>> > >> >>> Player
>> > >> >>> > > Debugger, for
>> > >> >>> > > > example, you won't get consistent
>> results.
>> > >> >>> > > >
>> > >> >>> > > > -Alex
>> > >> >>> > > >
>> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
>> > Muppirala" <
>> > >> >>> > bigosmallm@gmail.com<mailto:
>> bigosmallm@gmail.com>>
>> > >> >>> > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > I just realized that we have
>> only one
>> > Agent
>> > >> (node)
>> > >> >>> listed
>> > >> >>> > under
>> > >> >>> > > > Jenkins. I
>> > >> >>> > > > am going to add at least one
>> more
>> > node to
>> > >> start
>> > >> >>> with.
>> > >> >>> > > >
>> > >> >>> > > > Thanks,
>> > >> >>> > > > Om
>> > >> >>> > > >
>> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
>> AM Alex
>> > Harui
>> > >> >>> > > <ah...@adobe.com.invalid>
>> > >> >>> > > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > > I think I followed the
>> instructions
>> > and
>> > >> enabled
>> > >> >>> SSH.
>> > >> >>> > > > >
>> > >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay
>> Weiss"
>> > <
>> > >> >>> > yishayjobs@hotmail.com<mailto:
>> yishayjobs@hotmail.com
>> > >>
>> > >> >>> > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > I haven’t gotten it to
>> work.
>> > Could be
>> > >> ssh
>> > >> >>> needs to be
>> > >> >>> > > enabled on
>> > >> >>> > > > the
>> > >> >>> > > > > VM [1]. This is nice to have
>> but not
>> > >> essential.
>> > >> >>> So Alex,
>> > >> >>> > let
>> > >> >>> > > me know
>> > >> >>> > > > if you
>> > >> >>> > > > > want to try that, otherwise
>> I’ll
>> > suspend
>> > >> my
>> > >> >>> efforts on
>> > >> >>> > this.
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Wednesday, April
>> 15, 2020
>> > 5:09
>> > >> PM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > I’d like to try and
>> install an
>> > ssh
>> > >> server.
>> > >> >>> Can anyone
>> > >> >>> > > think of a
>> > >> >>> > > > > reason not to do that? I’m
>> asking in
>> > >> terms of
>> > >> >>> security,
>> > >> >>> > and if
>> > >> >>> > > there
>> > >> >>> > > > might
>> > >> >>> > > > > be a problem because it’s a
>> VM.
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks.
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 10:02 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Related, as most (all?)
>> of the
>> > >> instructions
>> > >> >>> don’t
>> > >> >>> > require
>> > >> >>> > > > anything but
>> > >> >>> > > > > a shell wouldn’t it be
>> easier and
>> > faster
>> > >> to
>> > >> >>> access the
>> > >> >>> > machine
>> > >> >>> > > with
>> > >> >>> > > > ssh
>> > >> >>> > > > > [1], rather than using remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:55 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Can’t you do that with
>> remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > >
>> ________________________________
>> > >> >>> > > > > From: OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:51:25
>> > >> AM
>> > >> >>> > > > > To: Apache Royale
>> Development <
>> > >> >>> dev@royale.apache.org
>> > >> >>> > <ma...@royale.apache.org>>
>> > >> >>> > > > > Subject: Re: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Alex,
>> > >> >>> > > > >
>> > >> >>> > > > > I believe this is your
>> personal
>> > Azure
>> > >> >>> subscription
>> > >> >>> > right?
>> > >> >>> > > Any
>> > >> >>> > > > chance
>> > >> >>> > > > > I can
>> > >> >>> > > > > get access to it so I
>> can try
>> > to copy
>> > >> the
>> > >> >>> image out
>> > >> >>> > the
>> > >> >>> > > machine
>> > >> >>> > > > and
>> > >> >>> > > > > redeploy it somewhere
>> else?
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks,
>> > >> >>> > > > > Om
>> > >> >>> > > > >
>> > >> >>> > > > > On Sun, Apr 12, 2020 at
>> 6:18 PM
>> > >> OmPrakash
>> > >> >>> Muppirala <
>> > >> >>> > > > > bigosmallm@gmail.com<mailto:
>> > >> bigosmallm@gmail.com
>> > >> >>> >>
>> > >> >>> > > > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > > I can help set this up
>> on
>> > Azure.
>> > >> Give me
>> > >> >>> some
>> > >> >>> > time to
>> > >> >>> > > work
>> > >> >>> > > > out the
>> > >> >>> > > > > > details?
>> > >> >>> > > > > >
>> > >> >>> > > > > > Thanks,
>> > >> >>> > > > > > Om
>> > >> >>> > > > > >
>> > >> >>> > > > > > On Sun, Apr 12, 2020,
>> 11:49 AM
>> > >> Harbs <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >
>> > >> >>> > > > > >> OK. Good to know.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >> > On Apr 12, 2020, at
>> 9:45
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > FWIW, I just looked
>> and the
>> > >> longest job
>> > >> >>> in the
>> > >> >>> > release
>> > >> >>> > > > steps so
>> > >> >>> > > > > far is
>> > >> >>> > > > > >> 8 minutes. Most are
>> under 2
>> > >> minutes.
>> > >> >>> There
>> > >> >>> > might be
>> > >> >>> > > jobs
>> > >> >>> > > > later
>> > >> >>> > > > > that take
>> > >> >>> > > > > >> longer that we
>> haven't run
>> > yet.
>> > >> IMO, the
>> > >> >>> issue
>> > >> >>> > isn't
>> > >> >>> > > speed
>> > >> >>> > > > of the
>> > >> >>> > > > > machine,
>> > >> >>> > > > > >> it is just that we are
>> > sharing the
>> > >> >>> machine with
>> > >> >>> > longer
>> > >> >>> > > jobs
>> > >> >>> > > > (1 hour
>> > >> >>> > > > > for
>> > >> >>> > > > > >>
>> TourDeFlexMigration). And
>> > again,
>> > >> the
>> > >> >>> machine
>> > >> >>> > will be
>> > >> >>> > > idle for
>> > >> >>> > > > > stretches of
>> > >> >>> > > > > >> time while the RM
>> verifies
>> > >> artifacts
>> > >> >>> after each
>> > >> >>> > step.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > -Alex
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > On 4/12/20, 11:32
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Fair enough.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I expect builds
>> to be
>> > >> somewhere
>> > >> >>> between 10
>> > >> >>> > and 20
>> > >> >>> > > times
>> > >> >>> > > > faster
>> > >> >>> > > > > on a
>> > >> >>> > > > > >> powerful machine.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Yeah. It’s
>> probably
>> > going to
>> > >> be a
>> > >> >>> bit of work
>> > >> >>> > > changing
>> > >> >>> > > > the
>> > >> >>> > > > > server,
>> > >> >>> > > > > >> but probably worth it
>> in the
>> > long
>> > >> run.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I think I’ll try
>> this
>> > when I
>> > >> do the
>> > >> >>> next
>> > >> >>> > release
>> > >> >>> > > unless
>> > >> >>> > > > Yishay
>> > >> >>> > > > > wants
>> > >> >>> > > > > >> to work with me on
>> this for
>> > this
>> > >> release
>> > >> >>> — but
>> > >> >>> > I’m not
>> > >> >>> > > going
>> > >> >>> > > > to be
>> > >> >>> > > > > able to
>> > >> >>> > > > > >> help until after
>> Passover
>> > (i.e.
>> > >> next
>> > >> >>> week).
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Thanks,
>> > >> >>> > > > > >> > Harbs
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> >> On Apr 12, 2020,
>> at 9:22
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The Azure portal
>> says:
>> > Standard
>> > >> F2s_v2
>> > >> >>> (2
>> > >> >>> > vcpus, 4
>> > >> >>> > > GiB
>> > >> >>> > > > memory)
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> I think I am
>> reading
>> > changes to
>> > >> the
>> > >> >>> build
>> > >> >>> > process in
>> > >> >>> > > your
>> > >> >>> > > > > >> suggestions. I do not
>> > really want
>> > >> to
>> > >> >>> spend more
>> > >> >>> > of my
>> > >> >>> > > time
>> > >> >>> > > > on this
>> > >> >>> > > > > >> process. But if you
>> want to
>> > do
>> > >> the work,
>> > >> >>> that's
>> > >> >>> > fine
>> > >> >>> > > with me.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> -Alex
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> On 4/12/20, 10:57
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>> <mailto:
>> harbs.lists@gmail.com
>> > >> <mailto:
>> > >> >>> > harbs.lists@gmail.com>
>> > >> >>> > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>>> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> What kind of
>> horsepower
>> > is
>> > >> included
>> > >> >>> in the
>> > >> >>> > free
>> > >> >>> > > Azure
>> > >> >>> > > > account?
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The server I
>> mentioned
>> > builds
>> > >> >>> (considerably)
>> > >> >>> > > faster than
>> > >> >>> > > > my own
>> > >> >>> > > > > >> local machine. The ci
>> server
>> > seems
>> > >> to
>> > >> >>> build many
>> > >> >>> > times
>> > >> >>> > > slower.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> One thing we can
>> do to
>> > >> minimize
>> > >> >>> running
>> > >> >>> > server time
>> > >> >>> > > > would be to
>> > >> >>> > > > > >> transfer the
>> artifacts to
>> > storage
>> > >> instead
>> > >> >>> of
>> > >> >>> > keeping
>> > >> >>> > > them on
>> > >> >>> > > > the
>> > >> >>> > > > > server. On
>> > >> >>> > > > > >> AWS, I’d probably use
>> S3.
>> > Not sure
>> > >> what
>> > >> >>> the
>> > >> >>> > similar
>> > >> >>> > > service on
>> > >> >>> > > > > Azure is
>> > >> >>> > > > > >> called.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >>> On Apr 12, 2020,
>> at 8:26
>> > PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >> <mailto:
>> > aharui@adobe.com.INVALID
>> > >> <mailto:
>> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> OK, that's pretty
>> much
>> > how I
>> > >> >>> understand Azure
>> > >> >>> > as
>> > >> >>> > > well.
>> > >> >>> > > > The key
>> > >> >>> > > > > thing
>> > >> >>> > > > > >> is that "running"
>> includes
>> > time
>> > >> where the
>> > >> >>> CI
>> > >> >>> > server is
>> > >> >>> > > not
>> > >> >>> > > > running
>> > >> >>> > > > > any
>> > >> >>> > > > > >> Jenkins jobs. The CI
>> Server
>> > steps
>> > >> might
>> > >> >>> take
>> > >> >>> > only a few
>> > >> >>> > > > hours of
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> server time, but
>> there is
>> > time
>> > >> where the
>> > >> >>> RM is
>> > >> >>> > verifying
>> > >> >>> > > > artifacts
>> > >> >>> > > > > locally
>> > >> >>> > > > > >> so you'd be paying
>> for that
>> > or the
>> > >> RM
>> > >> >>> would have
>> > >> >>> > to keep
>> > >> >>> > > > shutting
>> > >> >>> > > > > down and
>> > >> >>> > > > > >> restarting.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Seems like it
>> would be
>> > >> >>> cheaper/simpler to get
>> > >> >>> > the
>> > >> >>> > > free
>> > >> >>> > > > MSDN
>> > >> >>> > > > > account
>> > >> >>> > > > > >> and leave it running.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> -Alex
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> On 4/12/20, 10:15
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> My experience is
>> with
>> > AWS.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I assume
>> Microsoft has
>> > similar
>> > >> >>> offerings,
>> > >> >>> > but I
>> > >> >>> > > don’t
>> > >> >>> > > > have
>> > >> >>> > > > > >> experience with Azure.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> AWS has
>> on-demand EC2
>> > >> instances
>> > >> >>> which you
>> > >> >>> > pay for
>> > >> >>> > > only
>> > >> >>> > > > the
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> time that they are
>> > running.[1]
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Instances can be
>> > started and
>> > >> stopped
>> > >> >>> via
>> > >> >>> > command
>> > >> >>> > > line
>> > >> >>> > > > (or via
>> > >> >>> > > > > the
>> > >> >>> > > > > >> web interface) as
>> long as
>> > you have
>> > >> valid
>> > >> >>> > credentials to
>> > >> >>> > > do so.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> For example: an
>> > m5.4xlarge
>> > >> instance
>> > >> >>> has 16
>> > >> >>> > cores
>> > >> >>> > > and
>> > >> >>> > > > costs
>> > >> >>> > > > > about
>> > >> >>> > > > > >> $1.5 per hour. On a
>> machine
>> > like
>> > >> that, a
>> > >> >>> full
>> > >> >>> > build
>> > >> >>> > > would
>> > >> >>> > > > probably
>> > >> >>> > > > > take
>> > >> >>> > > > > >> less than 10 minutes.
>> It’s
>> > probably
>> > >> >>> possible to
>> > >> >>> > do a
>> > >> >>> > > full
>> > >> >>> > > > release
>> > >> >>> > > > > with only
>> > >> >>> > > > > >> a few hours of server
>> time.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Leaving a server
>> like
>> > that
>> > >> running
>> > >> >>> all the
>> > >> >>> > time
>> > >> >>> > > would get
>> > >> >>> > > > > expensive,
>> > >> >>> > > > > >> but if it’s just spun
>> up for
>> > >> releases,
>> > >> >>> you’d get
>> > >> >>> > very
>> > >> >>> > > fast
>> > >> >>> > > > builds
>> > >> >>> > > > > at a
>> > >> >>> > > > > >> reasonable price.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I’d be happy to
>> pay
>> > $10-$50
>> > >> (and
>> > >> >>> possibly
>> > >> >>> > more) per
>> > >> >>> > > > release to
>> > >> >>> > > > > make
>> > >> >>> > > > > >> the release process
>> painless
>> > for
>> > >> the RM.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> [1]
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>> On Apr 12, 2020,
>> at
>> > 7:45 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I'm not very
>> > experienced with
>> > >> >>> spinning up
>> > >> >>> > > servers. The
>> > >> >>> > > > CI
>> > >> >>> > > > > server we
>> > >> >>> > > > > >> are using is
>> effectively
>> > free,
>> > >> based on a
>> > >> >>> generous
>> > >> >>> > > donation
>> > >> >>> > > > from
>> > >> >>> > > > > Microsoft
>> > >> >>> > > > > >> of MSDN accounts to
>> ASF
>> > >> committers. So I
>> > >> >>> leave
>> > >> >>> > it up
>> > >> >>> > > 24/7,
>> > >> >>> > > > and
>> > >> >>> > > > > share the
>> > >> >>> > > > > >> RDP access on private@.
>> I
>> > think
>> > >> any
>> > >> >>> other ASF
>> > >> >>> > > committer
>> > >> >>> > > > could do
>> > >> >>> > > > > the
>> > >> >>> > > > > >> same. IIRC, if that
>> server
>> > >> actually is
>> > >> >>> stopped,
>> > >> >>> > I have
>> > >> >>> > > to
>> > >> >>> > > > use my
>> > >> >>> > > > > personal
>> > >> >>> > > > > >> (unshared) MSDN
>> credentials
>> > to
>> > >> start it
>> > >> >>> again.
>> > >> >>> > AIUI,
>> > >> >>> > > if I
>> > >> >>> > > > > actually paid
>> > >> >>> > > > > >> for the server, it
>> would
>> > cost me
>> > >> to leave
>> > >> >>> it
>> > >> >>> > running
>> > >> >>> > > even if
>> > >> >>> > > > it
>> > >> >>> > > > > didn't run
>> > >> >>> > > > > >> jobs between releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Is that what you
>> are
>> > basically
>> > >> >>> saying? I
>> > >> >>> > think it
>> > >> >>> > > might
>> > >> >>> > > > be
>> > >> >>> > > > > best if
>> > >> >>> > > > > >> another committer got
>> a CI
>> > server
>> > >> going
>> > >> >>> via the MS
>> > >> >>> > > donation
>> > >> >>> > > > and
>> > >> >>> > > > > could leave
>> > >> >>> > > > > >> it up 24/7.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> -Alex
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> On 4/12/20, 9:28
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I’m willing to
>> do this.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Considering that
>> the
>> > release
>> > >> will be
>> > >> >>> run
>> > >> >>> > > infrequently, it
>> > >> >>> > > > > should be
>> > >> >>> > > > > >> doable to have a
>> relatively
>> > >> powerful
>> > >> >>> server that
>> > >> >>> > could
>> > >> >>> > > be
>> > >> >>> > > > spun up on
>> > >> >>> > > > > >> demand. This is
>> something I
>> > have
>> > >> setup
>> > >> >>> for my own
>> > >> >>> > > releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> The only
>> complication
>> > would
>> > >> be that
>> > >> >>> each RM
>> > >> >>> > would
>> > >> >>> > > need
>> > >> >>> > > > valid
>> > >> >>> > > > > >> credentials to spin
>> up the
>> > server.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Harbs
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>>> On Apr 12,
>> 2020, at
>> > 7:10 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>>
>> > >> >>> > > > > >> >>>>> A better
>> solution,
>> > IMO, is
>> > >> for
>> > >> >>> someone else
>> > >> >>> > to
>> > >> >>> > > offer up
>> > >> >>> > > > a CI
>> > >> >>> > > > > server
>> > >> >>> > > > > >> only for release jobs.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >>
>> > >>
>> > >>
>> >
>> >
>> >
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
Update - royale-asjs_jsonly successfully build on my agent VM.
Right now, we have 3 jobs running on this VM:
1. royale-asjs_jsonly
2. royale-compiler
3. royale-typedefs
Are there any other jobs we need to move to the new agent?
Yishay, can you please confirm that your release jobs are running without
being hindered by CI jobs?
Thanks,
Om
On Mon, Apr 20, 2020 at 12:05 AM OmPrakash Muppirala <bi...@gmail.com>
wrote:
>
> On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
>> you are talking about your VM, you can compare console output from recent
>> successful builds on both VMs.
>>
>>
> I was talking about my VM.
> A rebuild of royale-compiler seems to have fixed that problem. Now
> royale-typedefs passes as well!
>
> Next up royale-asjs_jsonly...
>
>
>> I'm done for tonight. Good luck,
>> -Alex
>>
>> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <aharui@adobe.com.invalid
>> >
>> wrote:
>>
>> > Royale-compiler has to be built first. This is an example of shared
>> > resources that I mentioned upthread. Royale-typedefs is going to
>> look for
>> > a sibling workspace folder called royale-compiler with a built of
>> > royale-compiler in it. If royale-compiler fails to create all of
>> its
>> > binaries or is in the process of building them, royale-typedefs
>> will report
>> > an error.
>> >
>>
>> Got it. I was just looking at the logic here:
>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
>>
>> Weird. The royale-compiler build says it was successful, but I cant
>> find
>> the lib directory under
>> C:\jenkins\workspace\royale-compiler\compiler-jx
>>
>>
>>
>>
>> >
>> > What should probably happen is that royale-typedefs pulls down the
>> > lastsuccessfulartifacts from royale-compiler, but I've never found
>> enough
>> > time and energy to try to make changes like that since most of us
>> do have
>> > all of the folders as siblings.
>> >
>> > HTH,
>> > -Alex
>> >
>> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>> >
>> > I am now getting this error on royale-typedefs build:
>> >
>> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
>> The
>> > following error occurred while executing this line:
>> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>> >
>> >
>> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
>> > doesn't exist.
>> >
>> >
>> > Where does the ROYALE_TRANSPILER_HOME var come from?
>> >
>> > Here is the full console output:
>> >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>> >
>> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
>> > bigosmallm@gmail.com>
>> > wrote:
>> >
>> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
>> <aharui@adobe.com.invalid
>> > >
>> > > wrote:
>> > >
>> > >> Congratulations! But does that mean that JAVA_HOME is
>> pointing at
>> > a JRE
>> > >> instead of a JDK? If you have other issues that might be a
>> factor.
>> > >>
>> > >
>> > > Yeah, I messed up initially by getting the JRE instead of
>> JDK. I
>> > have
>> > > since corrected it. But for some reason Ant still thinks that
>> > JAVA_HOME is
>> > > the jre directory.
>> > > I don't know how to fix this, hence the hack :-|
>> > >
>> > >
>> > >
>> > >
>> > >>
>> > >> HTH,
>> > >> -Alex
>> > >>
>> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> I copied tools.jar from jdk/lib to the jre/lib. That
>> seems to
>> > have
>> > >> fixed
>> > >> the issue.
>> > >> We now have a successful build of the royale-compiler on
>> the
>> > new Agent
>> > >> machine!!
>> > >>
>> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> wrote:
>> > >>
>> > >> > Restart dint help. Although Serkan's reply made me
>> look at
>> > how Ant
>> > >> was
>> > >> > getting invoked.
>> > >> >
>> > >> > I see this warning that tools.jar is missing:
>> > >> >
>> > >> > [royale-compiler] $ cmd.exe /C
>> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
>> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
>> > >> %%ERRORLEVEL%%"
>> > >> >
>> > >> > Unable to locate tools.jar. Expected to find it in
>> C:\Program
>> > >> Files\Java\jre1.8.0_251\lib\tools.jar
>> > >> >
>> > >> >
>> > >> > I am pretty sure this is related to this issue.
>> > >> >
>> > >> >
>> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
>> > >> bigosmallm@gmail.com>
>> > >> > wrote:
>> > >> >
>> > >> >>
>> > >> >>
>> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >> wrote:
>> > >> >>
>> > >> >>> Did you reboot your VM? Also, have you checked what
>> user is
>> > >> running
>> > >> >>> Jenkins on your VM? I think that can sometimes be a
>> > problem. I
>> > >> might be
>> > >> >>> running Jenkins as the user.
>> > >> >>>
>> > >> >>>
>> > >> >> Agents don't require Jenkins to be running. I will
>> give the
>> > >> rebooting of
>> > >> >> the VM a shot .
>> > >> >>
>> > >> >> Thanks,
>> > >> >> Om
>> > >> >>
>> > >> >>
>> > >> >>> -Alex
>> > >> >>>
>> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
>> > bigosmallm@gmail.com
>> > >> >
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>>
>> > >> >>> > Should be here:
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
>> > >> >>>
>> > >> >>>
>> > >> >>> My git is located in the same exact location as
>> master.
>> > >> >>> Moreover, the git call from the commandline
>> executes
>> > fine.
>> > >> The git
>> > >> >>> call
>> > >> >>> from ant exec is what is failing.
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > HTH,
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > From: OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> > >> >>> > Reply-To: "dev@royale.apache.org" <
>> > dev@royale.apache.org>
>> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> > >> >>> > To: Apache Royale Development <
>> dev@royale.apache.org>
>> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
>> > >> >>> >
>> > >> >>> > I'm a bit stumped here. The royale-compiler is
>> > failing
>> > >> with this
>> > >> >>> error:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > BUILD FAILED
>> > >> >>> >
>> > >> >>> >
>> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
>> > Execute
>> > >> >>> failed:
>> > >> >>> > java.io.IOException: Cannot run program "git"
>> (in
>> > directory
>> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
>> CreateProcess
>> > >> error=2,
>> > >> >>> The system
>> > >> >>> > cannot find the file specified
>> > >> >>> >
>> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
>> Source)
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > It is from this part of the jenkins.xml:
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > <target name="closure-lib-download"
>> > description="Copies
>> > >> Closure
>> > >> >>> > Library from GitHub">
>> > >> >>> > <echo message="Be patient. This takes
>> a few
>> > >> minutes..." />
>> > >> >>> > <exec executable="git"
>> > failifexecutionfails="true">
>> > >> >>> > <arg value="clone" />
>> > >> >>> > <arg value="
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
>> > >> >>> <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
>> > >> >>> >"
>> > >> >>> > />
>> > >> >>> > <arg value="${closure.root}" />
>> > >> >>> > </exec>
>> > >> >>> > <echo>Cloned fresh copy of Google
>> Closure
>> > >> Library</echo>
>> > >> >>> > </target>
>> > >> >>> >
>> > >> >>> > I am not sure how this executable call works
>> without
>> > the
>> > >> full path.
>> > >> >>> >
>> > >> >>> > I checked the env variables, I do have both the
>> > git/bin and
>> > >> git/cmd
>> > >> >>> > directory in the PATH:
>> > >> >>> >
>> > >> >>> > [cid:ii_k97zkk9o0]
>> > >> >>> >
>> > >> >>> > What am I missing?
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > Update - I have successfully attached my VM as
>> a slave
>> > >> agent of our
>> > >> >>> > Jenkins instance.
>> > >> >>> > I am going to pull the job -
>> /royale-asjs_jsonly and
>> > tie it
>> > >> to my
>> > >> >>> agent so
>> > >> >>> > I can test it.
>> > >> >>> >
>> > >> >>> > It will fail for a sometime while I go set up
>> my VM
>> > with
>> > >> all the
>> > >> >>> > dependencies.
>> > >> >>> >
>> > >> >>> > Once we have the job successfully building on
>> my VM,
>> > we can
>> > >> figure
>> > >> >>> out how
>> > >> >>> > to divide the load between the master and
>> agent.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > We could achieve the same by creating a new
>> agent
>> > (separate
>> > >> vm) and
>> > >> >>> > attaching it as a slave to the current Jenkins
>> server.
>> > >> >>> >
>> > >> >>> > Then we can use labels/tags to tie release
>> jobs to one
>> > >> agent and
>> > >> >>> non
>> > >> >>> > release jobs to another agent.
>> > >> >>> >
>> > >> >>> > That way we can maintain everything in one UI,
>> one
>> > login
>> > >> while
>> > >> >>> achieving
>> > >> >>> > the concurrent building capabilities we want.
>> > >> >>> >
>> > >> >>> > Jenkins is built for this kind of stuff and I
>> think it
>> > >> would be
>> > >> >>> best we
>> > >> >>> > followed this practice.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
>> > >> <ah...@adobe.com.invalid>
>> > >> >>> wrote:
>> > >> >>> > Om, I thought you were going to get the image
>> from my
>> > VM
>> > >> and run
>> > >> >>> it on
>> > >> >>> > another VM. Then we'd remove all non-release
>> jobs
>> > from
>> > >> your VM
>> > >> >>> and all of
>> > >> >>> > the release jobs from my VM. That won't solve
>> the
>> > problem
>> > >> of how
>> > >> >>> long it
>> > >> >>> > takes for a commit to be built and tested, but
>> will
>> > allow
>> > >> the RM
>> > >> >>> to get a
>> > >> >>> > release out without getting stuck behind the
>> commit
>> > jobs.
>> > >> Is that
>> > >> >>> > currently the plan?
>> > >> >>> >
>> > >> >>> > -Alex
>> > >> >>> >
>> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
>> > >> bigosmallm@gmail.com
>> > >> >>> <mailto:
>> > >> >>> > bigosmallm@gmail.com>> wrote:
>> > >> >>> >
>> > >> >>> > Makes sense to me. I will set parallel
>> executors
>> > back
>> > >> to 1.
>> > >> >>> >
>> > >> >>> > And start working on a new Jenkins
>> instance.
>> > >> >>> >
>> > >> >>> > Thanks,
>> > >> >>> > Om
>> > >> >>> >
>> > >> >>> >
>> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> > >> >>> <ah...@adobe.com.invalid>
>> > >> >>> > wrote:
>> > >> >>> >
>> > >> >>> > > Are you saying that Java, Ant and Maven
>> do not
>> > know
>> > >> how to
>> > >> >>> > distribute work
>> > >> >>> > > to different cores?
>> > >> >>> > >
>> > >> >>> > > To repeat my main concern: our Jenkins
>> jobs
>> > often
>> > >> use shared
>> > >> >>> > resources.
>> > >> >>> > > If you want to take the time to fix
>> that, feel
>> > free,
>> > >> but I
>> > >> >>> do not
>> > >> >>> > know how
>> > >> >>> > > you are going to keep two jobs from both
>> trying
>> > to
>> > >> launch
>> > >> >>> Flash
>> > >> >>> > Player
>> > >> >>> > > Debugger at the same time and open the
>> same
>> > socket to
>> > >> >>> communicate
>> > >> >>> > with it,
>> > >> >>> > > or try to parse the flashlog.txt that
>> they have
>> > both
>> > >> written
>> > >> >>> to.
>> > >> >>> > >
>> > >> >>> > > The royale-asjs job will use the
>> royale-compiler
>> > >> workspace
>> > >> >>> to get the
>> > >> >>> > > compiler. If the compiler is building,
>> the
>> > jars are
>> > >> not
>> > >> >>> there and
>> > >> >>> > the
>> > >> >>> > > royale-asjs build fails.
>> > >> >>> > >
>> > >> >>> > > There is also only so much memory and
>> some of
>> > our
>> > >> jobs use
>> > >> >>> all of it
>> > >> >>> > and
>> > >> >>> > > I'm not sure if jobs slowed down due to
>> paging
>> > memory
>> > >> and
>> > >> >>> > writing/reading
>> > >> >>> > > from disk, even if it is an SSD.
>> > >> >>> > >
>> > >> >>> > > I'm done for tonight, but that's what I
>> was
>> > seeing
>> > >> last time
>> > >> >>> I tried
>> > >> >>> > to
>> > >> >>> > > have both master and an agent running
>> jobs in
>> > >> parallel.
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > -Alex
>> > >> >>> > >
>> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
>> Muppirala" <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>> wrote:
>> > >> >>> > >
>> > >> >>> > > A typical setup would be to have 0
>> > executors on
>> > >> master
>> > >> >>> and at
>> > >> >>> > least n
>> > >> >>> > > number of executors on each agent,
>> where n =
>> > >> number of
>> > >> >>> cpu cores.
>> > >> >>> > > I see that the current VM has 2
>> cores. So,
>> > I
>> > >> started
>> > >> >>> with
>> > >> >>> > setting the
>> > >> >>> > > num
>> > >> >>> > > executors on the current agent to 2.
>> > >> >>> > >
>> > >> >>> > > This should improve things quite a
>> bit. If
>> > this
>> > >> doesn't
>> > >> >>> work, I
>> > >> >>> > will
>> > >> >>> > > create a new VM and make it the
>> slave agent
>> > of the
>> > >> >>> current
>> > >> >>> > Jenkins
>> > >> >>> > > master.
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > > Thanks,
>> > >> >>> > > Om
>> > >> >>> > >
>> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM
>> Alex Harui
>> > >> >>> > <ah...@adobe.com.invalid>
>> > >> >>> > > wrote:
>> > >> >>> > >
>> > >> >>> > > > On your VM or mine? I don't think
>> mine
>> > can
>> > >> handle
>> > >> >>> it. I used
>> > >> >>> > to
>> > >> >>> > > run jobs
>> > >> >>> > > > of master and agent and we got
>> lots of
>> > failures
>> > >> and
>> > >> >>> jobs took
>> > >> >>> > > forever. If
>> > >> >>> > > > two jobs are trying to run tests
>> with the
>> > >> shared Flash
>> > >> >>> Player
>> > >> >>> > > Debugger, for
>> > >> >>> > > > example, you won't get consistent
>> results.
>> > >> >>> > > >
>> > >> >>> > > > -Alex
>> > >> >>> > > >
>> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
>> > Muppirala" <
>> > >> >>> > bigosmallm@gmail.com<mailto:
>> bigosmallm@gmail.com>>
>> > >> >>> > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > I just realized that we have
>> only one
>> > Agent
>> > >> (node)
>> > >> >>> listed
>> > >> >>> > under
>> > >> >>> > > > Jenkins. I
>> > >> >>> > > > am going to add at least one
>> more
>> > node to
>> > >> start
>> > >> >>> with.
>> > >> >>> > > >
>> > >> >>> > > > Thanks,
>> > >> >>> > > > Om
>> > >> >>> > > >
>> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58
>> AM Alex
>> > Harui
>> > >> >>> > > <ah...@adobe.com.invalid>
>> > >> >>> > > > wrote:
>> > >> >>> > > >
>> > >> >>> > > > > I think I followed the
>> instructions
>> > and
>> > >> enabled
>> > >> >>> SSH.
>> > >> >>> > > > >
>> > >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay
>> Weiss"
>> > <
>> > >> >>> > yishayjobs@hotmail.com<mailto:
>> yishayjobs@hotmail.com
>> > >>
>> > >> >>> > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > I haven’t gotten it to
>> work.
>> > Could be
>> > >> ssh
>> > >> >>> needs to be
>> > >> >>> > > enabled on
>> > >> >>> > > > the
>> > >> >>> > > > > VM [1]. This is nice to have
>> but not
>> > >> essential.
>> > >> >>> So Alex,
>> > >> >>> > let
>> > >> >>> > > me know
>> > >> >>> > > > if you
>> > >> >>> > > > > want to try that, otherwise
>> I’ll
>> > suspend
>> > >> my
>> > >> >>> efforts on
>> > >> >>> > this.
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Wednesday, April
>> 15, 2020
>> > 5:09
>> > >> PM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > I’d like to try and
>> install an
>> > ssh
>> > >> server.
>> > >> >>> Can anyone
>> > >> >>> > > think of a
>> > >> >>> > > > > reason not to do that? I’m
>> asking in
>> > >> terms of
>> > >> >>> security,
>> > >> >>> > and if
>> > >> >>> > > there
>> > >> >>> > > > might
>> > >> >>> > > > > be a problem because it’s a
>> VM.
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks.
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 10:02 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Related, as most (all?)
>> of the
>> > >> instructions
>> > >> >>> don’t
>> > >> >>> > require
>> > >> >>> > > > anything but
>> > >> >>> > > > > a shell wouldn’t it be
>> easier and
>> > faster
>> > >> to
>> > >> >>> access the
>> > >> >>> > machine
>> > >> >>> > > with
>> > >> >>> > > > ssh
>> > >> >>> > > > > [1], rather than using remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > > [1]
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > >
>> > >> >>> > > > > From: Yishay
>> Weiss<mailto:
>> > >> >>> yishayjobs@hotmail.com
>> > >> >>> > <ma...@hotmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:55 AM
>> > >> >>> > > > > To:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org><mailto:
>> dev@royale.apache.org
>> > <mailto:
>> > >> >>> > dev@royale.apache.org>>
>> > >> >>> > > > > Subject: RE: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Can’t you do that with
>> remote
>> > desktop?
>> > >> >>> > > > >
>> > >> >>> > > > >
>> ________________________________
>> > >> >>> > > > > From: OmPrakash
>> Muppirala <
>> > >> >>> bigosmallm@gmail.com
>> > >> >>> > <ma...@gmail.com>>
>> > >> >>> > > > > Sent: Monday, April 13,
>> 2020
>> > 9:51:25
>> > >> AM
>> > >> >>> > > > > To: Apache Royale
>> Development <
>> > >> >>> dev@royale.apache.org
>> > >> >>> > <ma...@royale.apache.org>>
>> > >> >>> > > > > Subject: Re: Prioritize
>> Release
>> > Jobs
>> > >> on CI
>> > >> >>> > > > >
>> > >> >>> > > > > Alex,
>> > >> >>> > > > >
>> > >> >>> > > > > I believe this is your
>> personal
>> > Azure
>> > >> >>> subscription
>> > >> >>> > right?
>> > >> >>> > > Any
>> > >> >>> > > > chance
>> > >> >>> > > > > I can
>> > >> >>> > > > > get access to it so I
>> can try
>> > to copy
>> > >> the
>> > >> >>> image out
>> > >> >>> > the
>> > >> >>> > > machine
>> > >> >>> > > > and
>> > >> >>> > > > > redeploy it somewhere
>> else?
>> > >> >>> > > > >
>> > >> >>> > > > > Thanks,
>> > >> >>> > > > > Om
>> > >> >>> > > > >
>> > >> >>> > > > > On Sun, Apr 12, 2020 at
>> 6:18 PM
>> > >> OmPrakash
>> > >> >>> Muppirala <
>> > >> >>> > > > > bigosmallm@gmail.com<mailto:
>> > >> bigosmallm@gmail.com
>> > >> >>> >>
>> > >> >>> > > > > wrote:
>> > >> >>> > > > >
>> > >> >>> > > > > > I can help set this up
>> on
>> > Azure.
>> > >> Give me
>> > >> >>> some
>> > >> >>> > time to
>> > >> >>> > > work
>> > >> >>> > > > out the
>> > >> >>> > > > > > details?
>> > >> >>> > > > > >
>> > >> >>> > > > > > Thanks,
>> > >> >>> > > > > > Om
>> > >> >>> > > > > >
>> > >> >>> > > > > > On Sun, Apr 12, 2020,
>> 11:49 AM
>> > >> Harbs <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >
>> > >> >>> > > > > >> OK. Good to know.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >> > On Apr 12, 2020, at
>> 9:45
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > FWIW, I just looked
>> and the
>> > >> longest job
>> > >> >>> in the
>> > >> >>> > release
>> > >> >>> > > > steps so
>> > >> >>> > > > > far is
>> > >> >>> > > > > >> 8 minutes. Most are
>> under 2
>> > >> minutes.
>> > >> >>> There
>> > >> >>> > might be
>> > >> >>> > > jobs
>> > >> >>> > > > later
>> > >> >>> > > > > that take
>> > >> >>> > > > > >> longer that we
>> haven't run
>> > yet.
>> > >> IMO, the
>> > >> >>> issue
>> > >> >>> > isn't
>> > >> >>> > > speed
>> > >> >>> > > > of the
>> > >> >>> > > > > machine,
>> > >> >>> > > > > >> it is just that we are
>> > sharing the
>> > >> >>> machine with
>> > >> >>> > longer
>> > >> >>> > > jobs
>> > >> >>> > > > (1 hour
>> > >> >>> > > > > for
>> > >> >>> > > > > >>
>> TourDeFlexMigration). And
>> > again,
>> > >> the
>> > >> >>> machine
>> > >> >>> > will be
>> > >> >>> > > idle for
>> > >> >>> > > > > stretches of
>> > >> >>> > > > > >> time while the RM
>> verifies
>> > >> artifacts
>> > >> >>> after each
>> > >> >>> > step.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > -Alex
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > On 4/12/20, 11:32
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Fair enough.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I expect builds
>> to be
>> > >> somewhere
>> > >> >>> between 10
>> > >> >>> > and 20
>> > >> >>> > > times
>> > >> >>> > > > faster
>> > >> >>> > > > > on a
>> > >> >>> > > > > >> powerful machine.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Yeah. It’s
>> probably
>> > going to
>> > >> be a
>> > >> >>> bit of work
>> > >> >>> > > changing
>> > >> >>> > > > the
>> > >> >>> > > > > server,
>> > >> >>> > > > > >> but probably worth it
>> in the
>> > long
>> > >> run.
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > I think I’ll try
>> this
>> > when I
>> > >> do the
>> > >> >>> next
>> > >> >>> > release
>> > >> >>> > > unless
>> > >> >>> > > > Yishay
>> > >> >>> > > > > wants
>> > >> >>> > > > > >> to work with me on
>> this for
>> > this
>> > >> release
>> > >> >>> — but
>> > >> >>> > I’m not
>> > >> >>> > > going
>> > >> >>> > > > to be
>> > >> >>> > > > > able to
>> > >> >>> > > > > >> help until after
>> Passover
>> > (i.e.
>> > >> next
>> > >> >>> week).
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> > Thanks,
>> > >> >>> > > > > >> > Harbs
>> > >> >>> > > > > >> >
>> > >> >>> > > > > >> >> On Apr 12, 2020,
>> at 9:22
>> > PM,
>> > >> Alex Harui
>> > >> >>> > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The Azure portal
>> says:
>> > Standard
>> > >> F2s_v2
>> > >> >>> (2
>> > >> >>> > vcpus, 4
>> > >> >>> > > GiB
>> > >> >>> > > > memory)
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> I think I am
>> reading
>> > changes to
>> > >> the
>> > >> >>> build
>> > >> >>> > process in
>> > >> >>> > > your
>> > >> >>> > > > > >> suggestions. I do not
>> > really want
>> > >> to
>> > >> >>> spend more
>> > >> >>> > of my
>> > >> >>> > > time
>> > >> >>> > > > on this
>> > >> >>> > > > > >> process. But if you
>> want to
>> > do
>> > >> the work,
>> > >> >>> that's
>> > >> >>> > fine
>> > >> >>> > > with me.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> -Alex
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> On 4/12/20, 10:57
>> AM,
>> > "Harbs" <
>> > >> >>> > harbs.lists@gmail.com<mailto:
>> harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>> <mailto:
>> harbs.lists@gmail.com
>> > >> <mailto:
>> > >> >>> > harbs.lists@gmail.com>
>> > >> >>> > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>>> wrote:
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> What kind of
>> horsepower
>> > is
>> > >> included
>> > >> >>> in the
>> > >> >>> > free
>> > >> >>> > > Azure
>> > >> >>> > > > account?
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> The server I
>> mentioned
>> > builds
>> > >> >>> (considerably)
>> > >> >>> > > faster than
>> > >> >>> > > > my own
>> > >> >>> > > > > >> local machine. The ci
>> server
>> > seems
>> > >> to
>> > >> >>> build many
>> > >> >>> > times
>> > >> >>> > > slower.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >> One thing we can
>> do to
>> > >> minimize
>> > >> >>> running
>> > >> >>> > server time
>> > >> >>> > > > would be to
>> > >> >>> > > > > >> transfer the
>> artifacts to
>> > storage
>> > >> instead
>> > >> >>> of
>> > >> >>> > keeping
>> > >> >>> > > them on
>> > >> >>> > > > the
>> > >> >>> > > > > server. On
>> > >> >>> > > > > >> AWS, I’d probably use
>> S3.
>> > Not sure
>> > >> what
>> > >> >>> the
>> > >> >>> > similar
>> > >> >>> > > service on
>> > >> >>> > > > > Azure is
>> > >> >>> > > > > >> called.
>> > >> >>> > > > > >> >>
>> > >> >>> > > > > >> >>> On Apr 12, 2020,
>> at 8:26
>> > PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <aharui@adobe.com.INVALID
>> > >> >>> > > > > >> <mailto:
>> > aharui@adobe.com.INVALID
>> > >> <mailto:
>> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> OK, that's pretty
>> much
>> > how I
>> > >> >>> understand Azure
>> > >> >>> > as
>> > >> >>> > > well.
>> > >> >>> > > > The key
>> > >> >>> > > > > thing
>> > >> >>> > > > > >> is that "running"
>> includes
>> > time
>> > >> where the
>> > >> >>> CI
>> > >> >>> > server is
>> > >> >>> > > not
>> > >> >>> > > > running
>> > >> >>> > > > > any
>> > >> >>> > > > > >> Jenkins jobs. The CI
>> Server
>> > steps
>> > >> might
>> > >> >>> take
>> > >> >>> > only a few
>> > >> >>> > > > hours of
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> server time, but
>> there is
>> > time
>> > >> where the
>> > >> >>> RM is
>> > >> >>> > verifying
>> > >> >>> > > > artifacts
>> > >> >>> > > > > locally
>> > >> >>> > > > > >> so you'd be paying
>> for that
>> > or the
>> > >> RM
>> > >> >>> would have
>> > >> >>> > to keep
>> > >> >>> > > > shutting
>> > >> >>> > > > > down and
>> > >> >>> > > > > >> restarting.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Seems like it
>> would be
>> > >> >>> cheaper/simpler to get
>> > >> >>> > the
>> > >> >>> > > free
>> > >> >>> > > > MSDN
>> > >> >>> > > > > account
>> > >> >>> > > > > >> and leave it running.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> -Alex
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> On 4/12/20, 10:15
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>
>> > >> >>> > > > <mailto:
>> > >> >>> > > > > >> harbs.lists@gmail.com
>> > <mailto:
>> > >> >>> > harbs.lists@gmail.com>>> wrote:
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> My experience is
>> with
>> > AWS.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I assume
>> Microsoft has
>> > similar
>> > >> >>> offerings,
>> > >> >>> > but I
>> > >> >>> > > don’t
>> > >> >>> > > > have
>> > >> >>> > > > > >> experience with Azure.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> AWS has
>> on-demand EC2
>> > >> instances
>> > >> >>> which you
>> > >> >>> > pay for
>> > >> >>> > > only
>> > >> >>> > > > the
>> > >> >>> > > > > actual
>> > >> >>> > > > > >> time that they are
>> > running.[1]
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Instances can be
>> > started and
>> > >> stopped
>> > >> >>> via
>> > >> >>> > command
>> > >> >>> > > line
>> > >> >>> > > > (or via
>> > >> >>> > > > > the
>> > >> >>> > > > > >> web interface) as
>> long as
>> > you have
>> > >> valid
>> > >> >>> > credentials to
>> > >> >>> > > do so.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> For example: an
>> > m5.4xlarge
>> > >> instance
>> > >> >>> has 16
>> > >> >>> > cores
>> > >> >>> > > and
>> > >> >>> > > > costs
>> > >> >>> > > > > about
>> > >> >>> > > > > >> $1.5 per hour. On a
>> machine
>> > like
>> > >> that, a
>> > >> >>> full
>> > >> >>> > build
>> > >> >>> > > would
>> > >> >>> > > > probably
>> > >> >>> > > > > take
>> > >> >>> > > > > >> less than 10 minutes.
>> It’s
>> > probably
>> > >> >>> possible to
>> > >> >>> > do a
>> > >> >>> > > full
>> > >> >>> > > > release
>> > >> >>> > > > > with only
>> > >> >>> > > > > >> a few hours of server
>> time.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> Leaving a server
>> like
>> > that
>> > >> running
>> > >> >>> all the
>> > >> >>> > time
>> > >> >>> > > would get
>> > >> >>> > > > > expensive,
>> > >> >>> > > > > >> but if it’s just spun
>> up for
>> > >> releases,
>> > >> >>> you’d get
>> > >> >>> > very
>> > >> >>> > > fast
>> > >> >>> > > > builds
>> > >> >>> > > > > at a
>> > >> >>> > > > > >> reasonable price.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> I’d be happy to
>> pay
>> > $10-$50
>> > >> (and
>> > >> >>> possibly
>> > >> >>> > more) per
>> > >> >>> > > > release to
>> > >> >>> > > > > make
>> > >> >>> > > > > >> the release process
>> painless
>> > for
>> > >> the RM.
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>> [1]
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> ><
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> <
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > <
>> > >> >>> >
>> > >> >>>
>> > >>
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
>> > >> >>> > >
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>
>> > >> >>> > > > > >> >>>> On Apr 12, 2020,
>> at
>> > 7:45 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I'm not very
>> > experienced with
>> > >> >>> spinning up
>> > >> >>> > > servers. The
>> > >> >>> > > > CI
>> > >> >>> > > > > server we
>> > >> >>> > > > > >> are using is
>> effectively
>> > free,
>> > >> based on a
>> > >> >>> generous
>> > >> >>> > > donation
>> > >> >>> > > > from
>> > >> >>> > > > > Microsoft
>> > >> >>> > > > > >> of MSDN accounts to
>> ASF
>> > >> committers. So I
>> > >> >>> leave
>> > >> >>> > it up
>> > >> >>> > > 24/7,
>> > >> >>> > > > and
>> > >> >>> > > > > share the
>> > >> >>> > > > > >> RDP access on private@.
>> I
>> > think
>> > >> any
>> > >> >>> other ASF
>> > >> >>> > > committer
>> > >> >>> > > > could do
>> > >> >>> > > > > the
>> > >> >>> > > > > >> same. IIRC, if that
>> server
>> > >> actually is
>> > >> >>> stopped,
>> > >> >>> > I have
>> > >> >>> > > to
>> > >> >>> > > > use my
>> > >> >>> > > > > personal
>> > >> >>> > > > > >> (unshared) MSDN
>> credentials
>> > to
>> > >> start it
>> > >> >>> again.
>> > >> >>> > AIUI,
>> > >> >>> > > if I
>> > >> >>> > > > > actually paid
>> > >> >>> > > > > >> for the server, it
>> would
>> > cost me
>> > >> to leave
>> > >> >>> it
>> > >> >>> > running
>> > >> >>> > > even if
>> > >> >>> > > > it
>> > >> >>> > > > > didn't run
>> > >> >>> > > > > >> jobs between releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Is that what you
>> are
>> > basically
>> > >> >>> saying? I
>> > >> >>> > think it
>> > >> >>> > > might
>> > >> >>> > > > be
>> > >> >>> > > > > best if
>> > >> >>> > > > > >> another committer got
>> a CI
>> > server
>> > >> going
>> > >> >>> via the MS
>> > >> >>> > > donation
>> > >> >>> > > > and
>> > >> >>> > > > > could leave
>> > >> >>> > > > > >> it up 24/7.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> -Alex
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> On 4/12/20, 9:28
>> AM,
>> > "Harbs" <
>> > >> >>> > > harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>
>> > >> >>> > > > wrote:
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> I’m willing to
>> do this.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Considering that
>> the
>> > release
>> > >> will be
>> > >> >>> run
>> > >> >>> > > infrequently, it
>> > >> >>> > > > > should be
>> > >> >>> > > > > >> doable to have a
>> relatively
>> > >> powerful
>> > >> >>> server that
>> > >> >>> > could
>> > >> >>> > > be
>> > >> >>> > > > spun up on
>> > >> >>> > > > > >> demand. This is
>> something I
>> > have
>> > >> setup
>> > >> >>> for my own
>> > >> >>> > > releases.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> The only
>> complication
>> > would
>> > >> be that
>> > >> >>> each RM
>> > >> >>> > would
>> > >> >>> > > need
>> > >> >>> > > > valid
>> > >> >>> > > > > >> credentials to spin
>> up the
>> > server.
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>> Harbs
>> > >> >>> > > > > >> >>>>
>> > >> >>> > > > > >> >>>>> On Apr 12,
>> 2020, at
>> > 7:10 PM,
>> > >> Alex
>> > >> >>> Harui
>> > >> >>> > > > > <ah...@adobe.com.INVALID>
>> > >> >>> > > > > >> wrote:
>> > >> >>> > > > > >> >>>>>
>> > >> >>> > > > > >> >>>>> A better
>> solution,
>> > IMO, is
>> > >> for
>> > >> >>> someone else
>> > >> >>> > to
>> > >> >>> > > offer up
>> > >> >>> > > > a CI
>> > >> >>> > > > > server
>> > >> >>> > > > > >> only for release jobs.
>> > >> >>> > > > > >>
>> > >> >>> > > > > >>
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> > >
>> > >> >>> >
>> > >> >>> >
>> > >> >>>
>> > >> >>>
>> > >> >>>
>> > >>
>> > >>
>> > >>
>> >
>> >
>> >
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Mon, Apr 20, 2020 at 12:01 AM Alex Harui <ah...@adobe.com.invalid>
wrote:
> I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If
> you are talking about your VM, you can compare console output from recent
> successful builds on both VMs.
>
>
I was talking about my VM.
A rebuild of royale-compiler seems to have fixed that problem. Now
royale-typedefs passes as well!
Next up royale-asjs_jsonly...
> I'm done for tonight. Good luck,
> -Alex
>
> On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > Royale-compiler has to be built first. This is an example of shared
> > resources that I mentioned upthread. Royale-typedefs is going to
> look for
> > a sibling workspace folder called royale-compiler with a built of
> > royale-compiler in it. If royale-compiler fails to create all of its
> > binaries or is in the process of building them, royale-typedefs will
> report
> > an error.
> >
>
> Got it. I was just looking at the logic here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
>
> Weird. The royale-compiler build says it was successful, but I cant
> find
> the lib directory under
> C:\jenkins\workspace\royale-compiler\compiler-jx
>
>
>
>
> >
> > What should probably happen is that royale-typedefs pulls down the
> > lastsuccessfulartifacts from royale-compiler, but I've never found
> enough
> > time and energy to try to make changes like that since most of us do
> have
> > all of the folders as siblings.
> >
> > HTH,
> > -Alex
> >
> > On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> wrote:
> >
> > I am now getting this error on royale-typedefs build:
> >
> > BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58:
> The
> > following error occurred while executing this line:
> > c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
> >
> >
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> > doesn't exist.
> >
> >
> > Where does the ROYALE_TRANSPILER_HOME var come from?
> >
> > Here is the full console output:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
> >
> > On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> > bigosmallm@gmail.com>
> > wrote:
> >
> > > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui
> <aharui@adobe.com.invalid
> > >
> > > wrote:
> > >
> > >> Congratulations! But does that mean that JAVA_HOME is
> pointing at
> > a JRE
> > >> instead of a JDK? If you have other issues that might be a
> factor.
> > >>
> > >
> > > Yeah, I messed up initially by getting the JRE instead of
> JDK. I
> > have
> > > since corrected it. But for some reason Ant still thinks that
> > JAVA_HOME is
> > > the jre directory.
> > > I don't know how to fix this, hence the hack :-|
> > >
> > >
> > >
> > >
> > >>
> > >> HTH,
> > >> -Alex
> > >>
> > >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com>
> > >> wrote:
> > >>
> > >> I copied tools.jar from jdk/lib to the jre/lib. That
> seems to
> > have
> > >> fixed
> > >> the issue.
> > >> We now have a successful build of the royale-compiler on
> the
> > new Agent
> > >> machine!!
> > >>
> > >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> > >> bigosmallm@gmail.com>
> > >> wrote:
> > >>
> > >> > Restart dint help. Although Serkan's reply made me
> look at
> > how Ant
> > >> was
> > >> > getting invoked.
> > >> >
> > >> > I see this warning that tools.jar is missing:
> > >> >
> > >> > [royale-compiler] $ cmd.exe /C
> > >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> > >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
> > >> %%ERRORLEVEL%%"
> > >> >
> > >> > Unable to locate tools.jar. Expected to find it in
> C:\Program
> > >> Files\Java\jre1.8.0_251\lib\tools.jar
> > >> >
> > >> >
> > >> > I am pretty sure this is related to this issue.
> > >> >
> > >> >
> > >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
> > >> bigosmallm@gmail.com>
> > >> > wrote:
> > >> >
> > >> >>
> > >> >>
> > >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> > >> <ah...@adobe.com.invalid>
> > >> >> wrote:
> > >> >>
> > >> >>> Did you reboot your VM? Also, have you checked what
> user is
> > >> running
> > >> >>> Jenkins on your VM? I think that can sometimes be a
> > problem. I
> > >> might be
> > >> >>> running Jenkins as the user.
> > >> >>>
> > >> >>>
> > >> >> Agents don't require Jenkins to be running. I will
> give the
> > >> rebooting of
> > >> >> the VM a shot .
> > >> >>
> > >> >> Thanks,
> > >> >> Om
> > >> >>
> > >> >>
> > >> >>> -Alex
> > >> >>>
> > >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> > bigosmallm@gmail.com
> > >> >
> > >> >>> wrote:
> > >> >>>
> > >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> > >> <ah...@adobe.com.invalid>
> > >> >>> wrote:
> > >> >>>
> > >> >>> > Should be here:
> > >> >>> >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> > >> >>>
> > >> >>>
> > >> >>> My git is located in the same exact location as
> master.
> > >> >>> Moreover, the git call from the commandline
> executes
> > fine.
> > >> The git
> > >> >>> call
> > >> >>> from ant exec is what is failing.
> > >> >>>
> > >> >>>
> > >> >>>
> > >> >>> >
> > >> >>> >
> > >> >>> > HTH,
> > >> >>> > -Alex
> > >> >>> >
> > >> >>> > From: OmPrakash Muppirala <bigosmallm@gmail.com
> >
> > >> >>> > Reply-To: "dev@royale.apache.org" <
> > dev@royale.apache.org>
> > >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> > >> >>> > To: Apache Royale Development <
> dev@royale.apache.org>
> > >> >>> > Subject: Re: Prioritize Release Jobs on CI
> > >> >>> >
> > >> >>> > I'm a bit stumped here. The royale-compiler is
> > failing
> > >> with this
> > >> >>> error:
> > >> >>> >
> > >> >>> >
> > >> >>> > BUILD FAILED
> > >> >>> >
> > >> >>> >
> c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> > Execute
> > >> >>> failed:
> > >> >>> > java.io.IOException: Cannot run program "git"
> (in
> > directory
> > >> >>> > "c:\jenkins\workspace\royale-compiler"):
> CreateProcess
> > >> error=2,
> > >> >>> The system
> > >> >>> > cannot find the file specified
> > >> >>> >
> > >> >>> > at java.lang.ProcessBuilder.start(Unknown
> Source)
> > >> >>> >
> > >> >>> >
> > >> >>> > It is from this part of the jenkins.xml:
> > >> >>> >
> > >> >>> >
> > >> >>> > <target name="closure-lib-download"
> > description="Copies
> > >> Closure
> > >> >>> > Library from GitHub">
> > >> >>> > <echo message="Be patient. This takes a
> few
> > >> minutes..." />
> > >> >>> > <exec executable="git"
> > failifexecutionfails="true">
> > >> >>> > <arg value="clone" />
> > >> >>> > <arg value="
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> > >> >>> <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> > >> >>> >"
> > >> >>> > />
> > >> >>> > <arg value="${closure.root}" />
> > >> >>> > </exec>
> > >> >>> > <echo>Cloned fresh copy of Google
> Closure
> > >> Library</echo>
> > >> >>> > </target>
> > >> >>> >
> > >> >>> > I am not sure how this executable call works
> without
> > the
> > >> full path.
> > >> >>> >
> > >> >>> > I checked the env variables, I do have both the
> > git/bin and
> > >> git/cmd
> > >> >>> > directory in the PATH:
> > >> >>> >
> > >> >>> > [cid:ii_k97zkk9o0]
> > >> >>> >
> > >> >>> > What am I missing?
> > >> >>> >
> > >> >>> > Thanks,
> > >> >>> > Om
> > >> >>> >
> > >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash
> Muppirala <
> > >> >>> bigosmallm@gmail.com
> > >> >>> > <ma...@gmail.com>> wrote:
> > >> >>> > Update - I have successfully attached my VM as
> a slave
> > >> agent of our
> > >> >>> > Jenkins instance.
> > >> >>> > I am going to pull the job -
> /royale-asjs_jsonly and
> > tie it
> > >> to my
> > >> >>> agent so
> > >> >>> > I can test it.
> > >> >>> >
> > >> >>> > It will fail for a sometime while I go set up
> my VM
> > with
> > >> all the
> > >> >>> > dependencies.
> > >> >>> >
> > >> >>> > Once we have the job successfully building on
> my VM,
> > we can
> > >> figure
> > >> >>> out how
> > >> >>> > to divide the load between the master and agent.
> > >> >>> >
> > >> >>> > Thanks,
> > >> >>> > Om
> > >> >>> >
> > >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash
> Muppirala <
> > >> >>> bigosmallm@gmail.com
> > >> >>> > <ma...@gmail.com>> wrote:
> > >> >>> > We could achieve the same by creating a new
> agent
> > (separate
> > >> vm) and
> > >> >>> > attaching it as a slave to the current Jenkins
> server.
> > >> >>> >
> > >> >>> > Then we can use labels/tags to tie release jobs
> to one
> > >> agent and
> > >> >>> non
> > >> >>> > release jobs to another agent.
> > >> >>> >
> > >> >>> > That way we can maintain everything in one UI,
> one
> > login
> > >> while
> > >> >>> achieving
> > >> >>> > the concurrent building capabilities we want.
> > >> >>> >
> > >> >>> > Jenkins is built for this kind of stuff and I
> think it
> > >> would be
> > >> >>> best we
> > >> >>> > followed this practice.
> > >> >>> >
> > >> >>> > Thanks,
> > >> >>> > Om
> > >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> > >> <ah...@adobe.com.invalid>
> > >> >>> wrote:
> > >> >>> > Om, I thought you were going to get the image
> from my
> > VM
> > >> and run
> > >> >>> it on
> > >> >>> > another VM. Then we'd remove all non-release
> jobs
> > from
> > >> your VM
> > >> >>> and all of
> > >> >>> > the release jobs from my VM. That won't solve
> the
> > problem
> > >> of how
> > >> >>> long it
> > >> >>> > takes for a commit to be built and tested, but
> will
> > allow
> > >> the RM
> > >> >>> to get a
> > >> >>> > release out without getting stuck behind the
> commit
> > jobs.
> > >> Is that
> > >> >>> > currently the plan?
> > >> >>> >
> > >> >>> > -Alex
> > >> >>> >
> > >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> > >> bigosmallm@gmail.com
> > >> >>> <mailto:
> > >> >>> > bigosmallm@gmail.com>> wrote:
> > >> >>> >
> > >> >>> > Makes sense to me. I will set parallel
> executors
> > back
> > >> to 1.
> > >> >>> >
> > >> >>> > And start working on a new Jenkins instance.
> > >> >>> >
> > >> >>> > Thanks,
> > >> >>> > Om
> > >> >>> >
> > >> >>> >
> > >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> > >> >>> <ah...@adobe.com.invalid>
> > >> >>> > wrote:
> > >> >>> >
> > >> >>> > > Are you saying that Java, Ant and Maven
> do not
> > know
> > >> how to
> > >> >>> > distribute work
> > >> >>> > > to different cores?
> > >> >>> > >
> > >> >>> > > To repeat my main concern: our Jenkins
> jobs
> > often
> > >> use shared
> > >> >>> > resources.
> > >> >>> > > If you want to take the time to fix that,
> feel
> > free,
> > >> but I
> > >> >>> do not
> > >> >>> > know how
> > >> >>> > > you are going to keep two jobs from both
> trying
> > to
> > >> launch
> > >> >>> Flash
> > >> >>> > Player
> > >> >>> > > Debugger at the same time and open the
> same
> > socket to
> > >> >>> communicate
> > >> >>> > with it,
> > >> >>> > > or try to parse the flashlog.txt that
> they have
> > both
> > >> written
> > >> >>> to.
> > >> >>> > >
> > >> >>> > > The royale-asjs job will use the
> royale-compiler
> > >> workspace
> > >> >>> to get the
> > >> >>> > > compiler. If the compiler is building,
> the
> > jars are
> > >> not
> > >> >>> there and
> > >> >>> > the
> > >> >>> > > royale-asjs build fails.
> > >> >>> > >
> > >> >>> > > There is also only so much memory and
> some of
> > our
> > >> jobs use
> > >> >>> all of it
> > >> >>> > and
> > >> >>> > > I'm not sure if jobs slowed down due to
> paging
> > memory
> > >> and
> > >> >>> > writing/reading
> > >> >>> > > from disk, even if it is an SSD.
> > >> >>> > >
> > >> >>> > > I'm done for tonight, but that's what I
> was
> > seeing
> > >> last time
> > >> >>> I tried
> > >> >>> > to
> > >> >>> > > have both master and an agent running
> jobs in
> > >> parallel.
> > >> >>> > >
> > >> >>> > > Thanks,
> > >> >>> > > -Alex
> > >> >>> > >
> > >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash
> Muppirala" <
> > >> >>> bigosmallm@gmail.com
> > >> >>> > <ma...@gmail.com>> wrote:
> > >> >>> > >
> > >> >>> > > A typical setup would be to have 0
> > executors on
> > >> master
> > >> >>> and at
> > >> >>> > least n
> > >> >>> > > number of executors on each agent,
> where n =
> > >> number of
> > >> >>> cpu cores.
> > >> >>> > > I see that the current VM has 2
> cores. So,
> > I
> > >> started
> > >> >>> with
> > >> >>> > setting the
> > >> >>> > > num
> > >> >>> > > executors on the current agent to 2.
> > >> >>> > >
> > >> >>> > > This should improve things quite a
> bit. If
> > this
> > >> doesn't
> > >> >>> work, I
> > >> >>> > will
> > >> >>> > > create a new VM and make it the slave
> agent
> > of the
> > >> >>> current
> > >> >>> > Jenkins
> > >> >>> > > master.
> > >> >>> > >
> > >> >>> > >
> > >> >>> > > Thanks,
> > >> >>> > > Om
> > >> >>> > >
> > >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex
> Harui
> > >> >>> > <ah...@adobe.com.invalid>
> > >> >>> > > wrote:
> > >> >>> > >
> > >> >>> > > > On your VM or mine? I don't think
> mine
> > can
> > >> handle
> > >> >>> it. I used
> > >> >>> > to
> > >> >>> > > run jobs
> > >> >>> > > > of master and agent and we got lots
> of
> > failures
> > >> and
> > >> >>> jobs took
> > >> >>> > > forever. If
> > >> >>> > > > two jobs are trying to run tests
> with the
> > >> shared Flash
> > >> >>> Player
> > >> >>> > > Debugger, for
> > >> >>> > > > example, you won't get consistent
> results.
> > >> >>> > > >
> > >> >>> > > > -Alex
> > >> >>> > > >
> > >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> > Muppirala" <
> > >> >>> > bigosmallm@gmail.com<mailto:
> bigosmallm@gmail.com>>
> > >> >>> > > wrote:
> > >> >>> > > >
> > >> >>> > > > I just realized that we have
> only one
> > Agent
> > >> (node)
> > >> >>> listed
> > >> >>> > under
> > >> >>> > > > Jenkins. I
> > >> >>> > > > am going to add at least one
> more
> > node to
> > >> start
> > >> >>> with.
> > >> >>> > > >
> > >> >>> > > > Thanks,
> > >> >>> > > > Om
> > >> >>> > > >
> > >> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM
> Alex
> > Harui
> > >> >>> > > <ah...@adobe.com.invalid>
> > >> >>> > > > wrote:
> > >> >>> > > >
> > >> >>> > > > > I think I followed the
> instructions
> > and
> > >> enabled
> > >> >>> SSH.
> > >> >>> > > > >
> > >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay
> Weiss"
> > <
> > >> >>> > yishayjobs@hotmail.com<mailto:
> yishayjobs@hotmail.com
> > >>
> > >> >>> > > wrote:
> > >> >>> > > > >
> > >> >>> > > > > I haven’t gotten it to
> work.
> > Could be
> > >> ssh
> > >> >>> needs to be
> > >> >>> > > enabled on
> > >> >>> > > > the
> > >> >>> > > > > VM [1]. This is nice to have
> but not
> > >> essential.
> > >> >>> So Alex,
> > >> >>> > let
> > >> >>> > > me know
> > >> >>> > > > if you
> > >> >>> > > > > want to try that, otherwise
> I’ll
> > suspend
> > >> my
> > >> >>> efforts on
> > >> >>> > this.
> > >> >>> > > > >
> > >> >>> > > > > [1]
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > >
> > >> >>> > > > > From: Yishay Weiss<mailto:
> > >> >>> yishayjobs@hotmail.com
> > >> >>> > <ma...@hotmail.com>>
> > >> >>> > > > > Sent: Wednesday, April
> 15, 2020
> > 5:09
> > >> PM
> > >> >>> > > > > To: dev@royale.apache.org
> > <mailto:
> > >> >>> > dev@royale.apache.org><mailto:
> dev@royale.apache.org
> > <mailto:
> > >> >>> > dev@royale.apache.org>>
> > >> >>> > > > > Subject: RE: Prioritize
> Release
> > Jobs
> > >> on CI
> > >> >>> > > > >
> > >> >>> > > > > I’d like to try and
> install an
> > ssh
> > >> server.
> > >> >>> Can anyone
> > >> >>> > > think of a
> > >> >>> > > > > reason not to do that? I’m
> asking in
> > >> terms of
> > >> >>> security,
> > >> >>> > and if
> > >> >>> > > there
> > >> >>> > > > might
> > >> >>> > > > > be a problem because it’s a
> VM.
> > >> >>> > > > >
> > >> >>> > > > > Thanks.
> > >> >>> > > > >
> > >> >>> > > > > From: Yishay Weiss<mailto:
> > >> >>> yishayjobs@hotmail.com
> > >> >>> > <ma...@hotmail.com>>
> > >> >>> > > > > Sent: Monday, April 13,
> 2020
> > 10:02 AM
> > >> >>> > > > > To: dev@royale.apache.org
> > <mailto:
> > >> >>> > dev@royale.apache.org><mailto:
> dev@royale.apache.org
> > <mailto:
> > >> >>> > dev@royale.apache.org>>
> > >> >>> > > > > Subject: RE: Prioritize
> Release
> > Jobs
> > >> on CI
> > >> >>> > > > >
> > >> >>> > > > > Related, as most (all?)
> of the
> > >> instructions
> > >> >>> don’t
> > >> >>> > require
> > >> >>> > > > anything but
> > >> >>> > > > > a shell wouldn’t it be easier
> and
> > faster
> > >> to
> > >> >>> access the
> > >> >>> > machine
> > >> >>> > > with
> > >> >>> > > > ssh
> > >> >>> > > > > [1], rather than using remote
> > desktop?
> > >> >>> > > > >
> > >> >>> > > > > [1]
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > >
> > >> >>> > > > > From: Yishay Weiss<mailto:
> > >> >>> yishayjobs@hotmail.com
> > >> >>> > <ma...@hotmail.com>>
> > >> >>> > > > > Sent: Monday, April 13,
> 2020
> > 9:55 AM
> > >> >>> > > > > To: dev@royale.apache.org
> > <mailto:
> > >> >>> > dev@royale.apache.org><mailto:
> dev@royale.apache.org
> > <mailto:
> > >> >>> > dev@royale.apache.org>>
> > >> >>> > > > > Subject: RE: Prioritize
> Release
> > Jobs
> > >> on CI
> > >> >>> > > > >
> > >> >>> > > > > Can’t you do that with
> remote
> > desktop?
> > >> >>> > > > >
> > >> >>> > > > >
> ________________________________
> > >> >>> > > > > From: OmPrakash Muppirala
> <
> > >> >>> bigosmallm@gmail.com
> > >> >>> > <ma...@gmail.com>>
> > >> >>> > > > > Sent: Monday, April 13,
> 2020
> > 9:51:25
> > >> AM
> > >> >>> > > > > To: Apache Royale
> Development <
> > >> >>> dev@royale.apache.org
> > >> >>> > <ma...@royale.apache.org>>
> > >> >>> > > > > Subject: Re: Prioritize
> Release
> > Jobs
> > >> on CI
> > >> >>> > > > >
> > >> >>> > > > > Alex,
> > >> >>> > > > >
> > >> >>> > > > > I believe this is your
> personal
> > Azure
> > >> >>> subscription
> > >> >>> > right?
> > >> >>> > > Any
> > >> >>> > > > chance
> > >> >>> > > > > I can
> > >> >>> > > > > get access to it so I can
> try
> > to copy
> > >> the
> > >> >>> image out
> > >> >>> > the
> > >> >>> > > machine
> > >> >>> > > > and
> > >> >>> > > > > redeploy it somewhere
> else?
> > >> >>> > > > >
> > >> >>> > > > > Thanks,
> > >> >>> > > > > Om
> > >> >>> > > > >
> > >> >>> > > > > On Sun, Apr 12, 2020 at
> 6:18 PM
> > >> OmPrakash
> > >> >>> Muppirala <
> > >> >>> > > > > bigosmallm@gmail.com<mailto:
> > >> bigosmallm@gmail.com
> > >> >>> >>
> > >> >>> > > > > wrote:
> > >> >>> > > > >
> > >> >>> > > > > > I can help set this up
> on
> > Azure.
> > >> Give me
> > >> >>> some
> > >> >>> > time to
> > >> >>> > > work
> > >> >>> > > > out the
> > >> >>> > > > > > details?
> > >> >>> > > > > >
> > >> >>> > > > > > Thanks,
> > >> >>> > > > > > Om
> > >> >>> > > > > >
> > >> >>> > > > > > On Sun, Apr 12, 2020,
> 11:49 AM
> > >> Harbs <
> > >> >>> > > harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>>
> > >> >>> > > > wrote:
> > >> >>> > > > > >
> > >> >>> > > > > >> OK. Good to know.
> > >> >>> > > > > >>
> > >> >>> > > > > >> > On Apr 12, 2020, at
> 9:45
> > PM,
> > >> Alex Harui
> > >> >>> > > > <aharui@adobe.com.INVALID
> > >> >>> > > > > >
> > >> >>> > > > > >> wrote:
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > FWIW, I just looked
> and the
> > >> longest job
> > >> >>> in the
> > >> >>> > release
> > >> >>> > > > steps so
> > >> >>> > > > > far is
> > >> >>> > > > > >> 8 minutes. Most are
> under 2
> > >> minutes.
> > >> >>> There
> > >> >>> > might be
> > >> >>> > > jobs
> > >> >>> > > > later
> > >> >>> > > > > that take
> > >> >>> > > > > >> longer that we haven't
> run
> > yet.
> > >> IMO, the
> > >> >>> issue
> > >> >>> > isn't
> > >> >>> > > speed
> > >> >>> > > > of the
> > >> >>> > > > > machine,
> > >> >>> > > > > >> it is just that we are
> > sharing the
> > >> >>> machine with
> > >> >>> > longer
> > >> >>> > > jobs
> > >> >>> > > > (1 hour
> > >> >>> > > > > for
> > >> >>> > > > > >> TourDeFlexMigration).
> And
> > again,
> > >> the
> > >> >>> machine
> > >> >>> > will be
> > >> >>> > > idle for
> > >> >>> > > > > stretches of
> > >> >>> > > > > >> time while the RM
> verifies
> > >> artifacts
> > >> >>> after each
> > >> >>> > step.
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > -Alex
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > On 4/12/20, 11:32 AM,
> > "Harbs" <
> > >> >>> > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>
> > >> >>> > > > <mailto:
> > >> >>> > > > > >> harbs.lists@gmail.com
> > <mailto:
> > >> >>> > harbs.lists@gmail.com>>> wrote:
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > Fair enough.
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > I expect builds
> to be
> > >> somewhere
> > >> >>> between 10
> > >> >>> > and 20
> > >> >>> > > times
> > >> >>> > > > faster
> > >> >>> > > > > on a
> > >> >>> > > > > >> powerful machine.
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > Yeah. It’s
> probably
> > going to
> > >> be a
> > >> >>> bit of work
> > >> >>> > > changing
> > >> >>> > > > the
> > >> >>> > > > > server,
> > >> >>> > > > > >> but probably worth it
> in the
> > long
> > >> run.
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > I think I’ll try
> this
> > when I
> > >> do the
> > >> >>> next
> > >> >>> > release
> > >> >>> > > unless
> > >> >>> > > > Yishay
> > >> >>> > > > > wants
> > >> >>> > > > > >> to work with me on
> this for
> > this
> > >> release
> > >> >>> — but
> > >> >>> > I’m not
> > >> >>> > > going
> > >> >>> > > > to be
> > >> >>> > > > > able to
> > >> >>> > > > > >> help until after
> Passover
> > (i.e.
> > >> next
> > >> >>> week).
> > >> >>> > > > > >> >
> > >> >>> > > > > >> > Thanks,
> > >> >>> > > > > >> > Harbs
> > >> >>> > > > > >> >
> > >> >>> > > > > >> >> On Apr 12, 2020, at
> 9:22
> > PM,
> > >> Alex Harui
> > >> >>> > > > <aharui@adobe.com.INVALID
> > >> >>> > > > > >
> > >> >>> > > > > >> wrote:
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> The Azure portal
> says:
> > Standard
> > >> F2s_v2
> > >> >>> (2
> > >> >>> > vcpus, 4
> > >> >>> > > GiB
> > >> >>> > > > memory)
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> I think I am reading
> > changes to
> > >> the
> > >> >>> build
> > >> >>> > process in
> > >> >>> > > your
> > >> >>> > > > > >> suggestions. I do not
> > really want
> > >> to
> > >> >>> spend more
> > >> >>> > of my
> > >> >>> > > time
> > >> >>> > > > on this
> > >> >>> > > > > >> process. But if you
> want to
> > do
> > >> the work,
> > >> >>> that's
> > >> >>> > fine
> > >> >>> > > with me.
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> -Alex
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> On 4/12/20, 10:57
> AM,
> > "Harbs" <
> > >> >>> > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>
> > >> >>> > > > <mailto:
> > >> >>> > > > > >> harbs.lists@gmail.com
> > <mailto:
> > >> >>> > harbs.lists@gmail.com>> <mailto:
> harbs.lists@gmail.com
> > >> <mailto:
> > >> >>> > harbs.lists@gmail.com>
> > >> >>> > > <mailto:
> > >> >>> > > > > >> harbs.lists@gmail.com
> > <mailto:
> > >> >>> > harbs.lists@gmail.com>>>> wrote:
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> What kind of
> horsepower
> > is
> > >> included
> > >> >>> in the
> > >> >>> > free
> > >> >>> > > Azure
> > >> >>> > > > account?
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> The server I
> mentioned
> > builds
> > >> >>> (considerably)
> > >> >>> > > faster than
> > >> >>> > > > my own
> > >> >>> > > > > >> local machine. The ci
> server
> > seems
> > >> to
> > >> >>> build many
> > >> >>> > times
> > >> >>> > > slower.
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >> One thing we can
> do to
> > >> minimize
> > >> >>> running
> > >> >>> > server time
> > >> >>> > > > would be to
> > >> >>> > > > > >> transfer the artifacts
> to
> > storage
> > >> instead
> > >> >>> of
> > >> >>> > keeping
> > >> >>> > > them on
> > >> >>> > > > the
> > >> >>> > > > > server. On
> > >> >>> > > > > >> AWS, I’d probably use
> S3.
> > Not sure
> > >> what
> > >> >>> the
> > >> >>> > similar
> > >> >>> > > service on
> > >> >>> > > > > Azure is
> > >> >>> > > > > >> called.
> > >> >>> > > > > >> >>
> > >> >>> > > > > >> >>> On Apr 12, 2020,
> at 8:26
> > PM,
> > >> Alex
> > >> >>> Harui
> > >> >>> > > > > <aharui@adobe.com.INVALID
> > >> >>> > > > > >> <mailto:
> > aharui@adobe.com.INVALID
> > >> <mailto:
> > >> >>> > aharui@adobe.com.INVALID>>> wrote:
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> OK, that's pretty
> much
> > how I
> > >> >>> understand Azure
> > >> >>> > as
> > >> >>> > > well.
> > >> >>> > > > The key
> > >> >>> > > > > thing
> > >> >>> > > > > >> is that "running"
> includes
> > time
> > >> where the
> > >> >>> CI
> > >> >>> > server is
> > >> >>> > > not
> > >> >>> > > > running
> > >> >>> > > > > any
> > >> >>> > > > > >> Jenkins jobs. The CI
> Server
> > steps
> > >> might
> > >> >>> take
> > >> >>> > only a few
> > >> >>> > > > hours of
> > >> >>> > > > > actual
> > >> >>> > > > > >> server time, but there
> is
> > time
> > >> where the
> > >> >>> RM is
> > >> >>> > verifying
> > >> >>> > > > artifacts
> > >> >>> > > > > locally
> > >> >>> > > > > >> so you'd be paying for
> that
> > or the
> > >> RM
> > >> >>> would have
> > >> >>> > to keep
> > >> >>> > > > shutting
> > >> >>> > > > > down and
> > >> >>> > > > > >> restarting.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> Seems like it
> would be
> > >> >>> cheaper/simpler to get
> > >> >>> > the
> > >> >>> > > free
> > >> >>> > > > MSDN
> > >> >>> > > > > account
> > >> >>> > > > > >> and leave it running.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> -Alex
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> On 4/12/20, 10:15
> AM,
> > "Harbs" <
> > >> >>> > > harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>
> > >> >>> > > > <mailto:
> > >> >>> > > > > >> harbs.lists@gmail.com
> > <mailto:
> > >> >>> > harbs.lists@gmail.com>>> wrote:
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> My experience is
> with
> > AWS.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> I assume
> Microsoft has
> > similar
> > >> >>> offerings,
> > >> >>> > but I
> > >> >>> > > don’t
> > >> >>> > > > have
> > >> >>> > > > > >> experience with Azure.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> AWS has on-demand
> EC2
> > >> instances
> > >> >>> which you
> > >> >>> > pay for
> > >> >>> > > only
> > >> >>> > > > the
> > >> >>> > > > > actual
> > >> >>> > > > > >> time that they are
> > running.[1]
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> Instances can be
> > started and
> > >> stopped
> > >> >>> via
> > >> >>> > command
> > >> >>> > > line
> > >> >>> > > > (or via
> > >> >>> > > > > the
> > >> >>> > > > > >> web interface) as long
> as
> > you have
> > >> valid
> > >> >>> > credentials to
> > >> >>> > > do so.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> For example: an
> > m5.4xlarge
> > >> instance
> > >> >>> has 16
> > >> >>> > cores
> > >> >>> > > and
> > >> >>> > > > costs
> > >> >>> > > > > about
> > >> >>> > > > > >> $1.5 per hour. On a
> machine
> > like
> > >> that, a
> > >> >>> full
> > >> >>> > build
> > >> >>> > > would
> > >> >>> > > > probably
> > >> >>> > > > > take
> > >> >>> > > > > >> less than 10 minutes.
> It’s
> > probably
> > >> >>> possible to
> > >> >>> > do a
> > >> >>> > > full
> > >> >>> > > > release
> > >> >>> > > > > with only
> > >> >>> > > > > >> a few hours of server
> time.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> Leaving a server
> like
> > that
> > >> running
> > >> >>> all the
> > >> >>> > time
> > >> >>> > > would get
> > >> >>> > > > > expensive,
> > >> >>> > > > > >> but if it’s just spun
> up for
> > >> releases,
> > >> >>> you’d get
> > >> >>> > very
> > >> >>> > > fast
> > >> >>> > > > builds
> > >> >>> > > > > at a
> > >> >>> > > > > >> reasonable price.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> I’d be happy to
> pay
> > $10-$50
> > >> (and
> > >> >>> possibly
> > >> >>> > more) per
> > >> >>> > > > release to
> > >> >>> > > > > make
> > >> >>> > > > > >> the release process
> painless
> > for
> > >> the RM.
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>> [1]
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> <
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> ><
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> <
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> >><
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> <
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> ><
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> <
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> > >> >>> > <
> > >> >>> >
> > >> >>>
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> > >> >>> > >
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>>
> > >> >>> > > > > >> >>>> On Apr 12, 2020,
> at
> > 7:45 PM,
> > >> Alex
> > >> >>> Harui
> > >> >>> > > > > <ah...@adobe.com.INVALID>
> > >> >>> > > > > >> wrote:
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> I'm not very
> > experienced with
> > >> >>> spinning up
> > >> >>> > > servers. The
> > >> >>> > > > CI
> > >> >>> > > > > server we
> > >> >>> > > > > >> are using is
> effectively
> > free,
> > >> based on a
> > >> >>> generous
> > >> >>> > > donation
> > >> >>> > > > from
> > >> >>> > > > > Microsoft
> > >> >>> > > > > >> of MSDN accounts to ASF
> > >> committers. So I
> > >> >>> leave
> > >> >>> > it up
> > >> >>> > > 24/7,
> > >> >>> > > > and
> > >> >>> > > > > share the
> > >> >>> > > > > >> RDP access on private@.
> I
> > think
> > >> any
> > >> >>> other ASF
> > >> >>> > > committer
> > >> >>> > > > could do
> > >> >>> > > > > the
> > >> >>> > > > > >> same. IIRC, if that
> server
> > >> actually is
> > >> >>> stopped,
> > >> >>> > I have
> > >> >>> > > to
> > >> >>> > > > use my
> > >> >>> > > > > personal
> > >> >>> > > > > >> (unshared) MSDN
> credentials
> > to
> > >> start it
> > >> >>> again.
> > >> >>> > AIUI,
> > >> >>> > > if I
> > >> >>> > > > > actually paid
> > >> >>> > > > > >> for the server, it
> would
> > cost me
> > >> to leave
> > >> >>> it
> > >> >>> > running
> > >> >>> > > even if
> > >> >>> > > > it
> > >> >>> > > > > didn't run
> > >> >>> > > > > >> jobs between releases.
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> Is that what you
> are
> > basically
> > >> >>> saying? I
> > >> >>> > think it
> > >> >>> > > might
> > >> >>> > > > be
> > >> >>> > > > > best if
> > >> >>> > > > > >> another committer got
> a CI
> > server
> > >> going
> > >> >>> via the MS
> > >> >>> > > donation
> > >> >>> > > > and
> > >> >>> > > > > could leave
> > >> >>> > > > > >> it up 24/7.
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> -Alex
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> On 4/12/20, 9:28
> AM,
> > "Harbs" <
> > >> >>> > > harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>>
> > >> >>> > > > wrote:
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> I’m willing to do
> this.
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> Considering that
> the
> > release
> > >> will be
> > >> >>> run
> > >> >>> > > infrequently, it
> > >> >>> > > > > should be
> > >> >>> > > > > >> doable to have a
> relatively
> > >> powerful
> > >> >>> server that
> > >> >>> > could
> > >> >>> > > be
> > >> >>> > > > spun up on
> > >> >>> > > > > >> demand. This is
> something I
> > have
> > >> setup
> > >> >>> for my own
> > >> >>> > > releases.
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> The only
> complication
> > would
> > >> be that
> > >> >>> each RM
> > >> >>> > would
> > >> >>> > > need
> > >> >>> > > > valid
> > >> >>> > > > > >> credentials to spin up
> the
> > server.
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>> Harbs
> > >> >>> > > > > >> >>>>
> > >> >>> > > > > >> >>>>> On Apr 12, 2020,
> at
> > 7:10 PM,
> > >> Alex
> > >> >>> Harui
> > >> >>> > > > > <ah...@adobe.com.INVALID>
> > >> >>> > > > > >> wrote:
> > >> >>> > > > > >> >>>>>
> > >> >>> > > > > >> >>>>> A better
> solution,
> > IMO, is
> > >> for
> > >> >>> someone else
> > >> >>> > to
> > >> >>> > > offer up
> > >> >>> > > > a CI
> > >> >>> > > > > server
> > >> >>> > > > > >> only for release jobs.
> > >> >>> > > > > >>
> > >> >>> > > > > >>
> > >> >>> > > > >
> > >> >>> > > > >
> > >> >>> > > > >
> > >> >>> > > > >
> > >> >>> > > >
> > >> >>> > > >
> > >> >>> > > >
> > >> >>> > >
> > >> >>> > >
> > >> >>> > >
> > >> >>> >
> > >> >>> >
> > >> >>>
> > >> >>>
> > >> >>>
> > >>
> > >>
> > >>
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
I see compiler-jx/lib in the Workspace for royale-compiler on my VM. If you are talking about your VM, you can compare console output from recent successful builds on both VMs.
I'm done for tonight. Good luck,
-Alex
On 4/19/20, 11:50 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Royale-compiler has to be built first. This is an example of shared
> resources that I mentioned upthread. Royale-typedefs is going to look for
> a sibling workspace folder called royale-compiler with a built of
> royale-compiler in it. If royale-compiler fails to create all of its
> binaries or is in the process of building them, royale-typedefs will report
> an error.
>
Got it. I was just looking at the logic here:
https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Froyale-typedefs%2Fblob%2F85c74dde104294a0127ce46a8795d7534216e7eb%2Fjs%2Fbuild.xml%23L53&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064138237&sdata=WjJhmdD0PeHDCYfqg%2Bf4mofhnQHdEPnwwj2ti%2FqlmII%3D&reserved=0
Weird. The royale-compiler build says it was successful, but I cant find
the lib directory under C:\jenkins\workspace\royale-compiler\compiler-jx
>
> What should probably happen is that royale-typedefs pulls down the
> lastsuccessfulartifacts from royale-compiler, but I've never found enough
> time and energy to try to make changes like that since most of us do have
> all of the folders as siblings.
>
> HTH,
> -Alex
>
> On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> I am now getting this error on royale-typedefs build:
>
> BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58: The
> following error occurred while executing this line:
> c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> doesn't exist.
>
>
> Where does the ROYALE_TRANSPILER_HOME var come from?
>
> Here is the full console output:
>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Rl%2F6kGkOf3Z2pauOtISD6aoqJ23M05iKMMxUV0eweuc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>
> On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <aharui@adobe.com.invalid
> >
> > wrote:
> >
> >> Congratulations! But does that mean that JAVA_HOME is pointing at
> a JRE
> >> instead of a JDK? If you have other issues that might be a factor.
> >>
> >
> > Yeah, I messed up initially by getting the JRE instead of JDK. I
> have
> > since corrected it. But for some reason Ant still thinks that
> JAVA_HOME is
> > the jre directory.
> > I don't know how to fix this, hence the hack :-|
> >
> >
> >
> >
> >>
> >> HTH,
> >> -Alex
> >>
> >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> I copied tools.jar from jdk/lib to the jre/lib. That seems to
> have
> >> fixed
> >> the issue.
> >> We now have a successful build of the royale-compiler on the
> new Agent
> >> machine!!
> >>
> >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> wrote:
> >>
> >> > Restart dint help. Although Serkan's reply made me look at
> how Ant
> >> was
> >> > getting invoked.
> >> >
> >> > I see this warning that tools.jar is missing:
> >> >
> >> > [royale-compiler] $ cmd.exe /C
> >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
> >> %%ERRORLEVEL%%"
> >> >
> >> > Unable to locate tools.jar. Expected to find it in C:\Program
> >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> >
> >> >
> >> > I am pretty sure this is related to this issue.
> >> >
> >> >
> >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> >>
> >> >>
> >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> <ah...@adobe.com.invalid>
> >> >> wrote:
> >> >>
> >> >>> Did you reboot your VM? Also, have you checked what user is
> >> running
> >> >>> Jenkins on your VM? I think that can sometimes be a
> problem. I
> >> might be
> >> >>> running Jenkins as the user.
> >> >>>
> >> >>>
> >> >> Agents don't require Jenkins to be running. I will give the
> >> rebooting of
> >> >> the VM a shot .
> >> >>
> >> >> Thanks,
> >> >> Om
> >> >>
> >> >>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com
> >> >
> >> >>> wrote:
> >> >>>
> >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> <ah...@adobe.com.invalid>
> >> >>> wrote:
> >> >>>
> >> >>> > Should be here:
> >> >>> >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=KIX2arrk2%2BYbozSCKqTJ3sbG3E9IuYjTvFxhc4hbW6U%3D&reserved=0
> >> >>>
> >> >>>
> >> >>> My git is located in the same exact location as master.
> >> >>> Moreover, the git call from the commandline executes
> fine.
> >> The git
> >> >>> call
> >> >>> from ant exec is what is failing.
> >> >>>
> >> >>>
> >> >>>
> >> >>> >
> >> >>> >
> >> >>> > HTH,
> >> >>> > -Alex
> >> >>> >
> >> >>> > From: OmPrakash Muppirala <bi...@gmail.com>
> >> >>> > Reply-To: "dev@royale.apache.org" <
> dev@royale.apache.org>
> >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> >>> > To: Apache Royale Development <de...@royale.apache.org>
> >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> >>> >
> >> >>> > I'm a bit stumped here. The royale-compiler is
> failing
> >> with this
> >> >>> error:
> >> >>> >
> >> >>> >
> >> >>> > BUILD FAILED
> >> >>> >
> >> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> Execute
> >> >>> failed:
> >> >>> > java.io.IOException: Cannot run program "git" (in
> directory
> >> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess
> >> error=2,
> >> >>> The system
> >> >>> > cannot find the file specified
> >> >>> >
> >> >>> > at java.lang.ProcessBuilder.start(Unknown Source)
> >> >>> >
> >> >>> >
> >> >>> > It is from this part of the jenkins.xml:
> >> >>> >
> >> >>> >
> >> >>> > <target name="closure-lib-download"
> description="Copies
> >> Closure
> >> >>> > Library from GitHub">
> >> >>> > <echo message="Be patient. This takes a few
> >> minutes..." />
> >> >>> > <exec executable="git"
> failifexecutionfails="true">
> >> >>> > <arg value="clone" />
> >> >>> > <arg value="
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> >>> <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=GCBMy196MZ1t76SKma0mLXIpUAEt5kRVC2EAnzn2gdM%3D&reserved=0
> >> >>> >"
> >> >>> > />
> >> >>> > <arg value="${closure.root}" />
> >> >>> > </exec>
> >> >>> > <echo>Cloned fresh copy of Google Closure
> >> Library</echo>
> >> >>> > </target>
> >> >>> >
> >> >>> > I am not sure how this executable call works without
> the
> >> full path.
> >> >>> >
> >> >>> > I checked the env variables, I do have both the
> git/bin and
> >> git/cmd
> >> >>> > directory in the PATH:
> >> >>> >
> >> >>> > [cid:ii_k97zkk9o0]
> >> >>> >
> >> >>> > What am I missing?
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> >
> >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>> wrote:
> >> >>> > Update - I have successfully attached my VM as a slave
> >> agent of our
> >> >>> > Jenkins instance.
> >> >>> > I am going to pull the job - /royale-asjs_jsonly and
> tie it
> >> to my
> >> >>> agent so
> >> >>> > I can test it.
> >> >>> >
> >> >>> > It will fail for a sometime while I go set up my VM
> with
> >> all the
> >> >>> > dependencies.
> >> >>> >
> >> >>> > Once we have the job successfully building on my VM,
> we can
> >> figure
> >> >>> out how
> >> >>> > to divide the load between the master and agent.
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> >
> >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>> wrote:
> >> >>> > We could achieve the same by creating a new agent
> (separate
> >> vm) and
> >> >>> > attaching it as a slave to the current Jenkins server.
> >> >>> >
> >> >>> > Then we can use labels/tags to tie release jobs to one
> >> agent and
> >> >>> non
> >> >>> > release jobs to another agent.
> >> >>> >
> >> >>> > That way we can maintain everything in one UI, one
> login
> >> while
> >> >>> achieving
> >> >>> > the concurrent building capabilities we want.
> >> >>> >
> >> >>> > Jenkins is built for this kind of stuff and I think it
> >> would be
> >> >>> best we
> >> >>> > followed this practice.
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> <ah...@adobe.com.invalid>
> >> >>> wrote:
> >> >>> > Om, I thought you were going to get the image from my
> VM
> >> and run
> >> >>> it on
> >> >>> > another VM. Then we'd remove all non-release jobs
> from
> >> your VM
> >> >>> and all of
> >> >>> > the release jobs from my VM. That won't solve the
> problem
> >> of how
> >> >>> long it
> >> >>> > takes for a commit to be built and tested, but will
> allow
> >> the RM
> >> >>> to get a
> >> >>> > release out without getting stuck behind the commit
> jobs.
> >> Is that
> >> >>> > currently the plan?
> >> >>> >
> >> >>> > -Alex
> >> >>> >
> >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com
> >> >>> <mailto:
> >> >>> > bigosmallm@gmail.com>> wrote:
> >> >>> >
> >> >>> > Makes sense to me. I will set parallel executors
> back
> >> to 1.
> >> >>> >
> >> >>> > And start working on a new Jenkins instance.
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> >
> >> >>> >
> >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> >>> <ah...@adobe.com.invalid>
> >> >>> > wrote:
> >> >>> >
> >> >>> > > Are you saying that Java, Ant and Maven do not
> know
> >> how to
> >> >>> > distribute work
> >> >>> > > to different cores?
> >> >>> > >
> >> >>> > > To repeat my main concern: our Jenkins jobs
> often
> >> use shared
> >> >>> > resources.
> >> >>> > > If you want to take the time to fix that, feel
> free,
> >> but I
> >> >>> do not
> >> >>> > know how
> >> >>> > > you are going to keep two jobs from both trying
> to
> >> launch
> >> >>> Flash
> >> >>> > Player
> >> >>> > > Debugger at the same time and open the same
> socket to
> >> >>> communicate
> >> >>> > with it,
> >> >>> > > or try to parse the flashlog.txt that they have
> both
> >> written
> >> >>> to.
> >> >>> > >
> >> >>> > > The royale-asjs job will use the royale-compiler
> >> workspace
> >> >>> to get the
> >> >>> > > compiler. If the compiler is building, the
> jars are
> >> not
> >> >>> there and
> >> >>> > the
> >> >>> > > royale-asjs build fails.
> >> >>> > >
> >> >>> > > There is also only so much memory and some of
> our
> >> jobs use
> >> >>> all of it
> >> >>> > and
> >> >>> > > I'm not sure if jobs slowed down due to paging
> memory
> >> and
> >> >>> > writing/reading
> >> >>> > > from disk, even if it is an SSD.
> >> >>> > >
> >> >>> > > I'm done for tonight, but that's what I was
> seeing
> >> last time
> >> >>> I tried
> >> >>> > to
> >> >>> > > have both master and an agent running jobs in
> >> parallel.
> >> >>> > >
> >> >>> > > Thanks,
> >> >>> > > -Alex
> >> >>> > >
> >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>> wrote:
> >> >>> > >
> >> >>> > > A typical setup would be to have 0
> executors on
> >> master
> >> >>> and at
> >> >>> > least n
> >> >>> > > number of executors on each agent, where n =
> >> number of
> >> >>> cpu cores.
> >> >>> > > I see that the current VM has 2 cores. So,
> I
> >> started
> >> >>> with
> >> >>> > setting the
> >> >>> > > num
> >> >>> > > executors on the current agent to 2.
> >> >>> > >
> >> >>> > > This should improve things quite a bit. If
> this
> >> doesn't
> >> >>> work, I
> >> >>> > will
> >> >>> > > create a new VM and make it the slave agent
> of the
> >> >>> current
> >> >>> > Jenkins
> >> >>> > > master.
> >> >>> > >
> >> >>> > >
> >> >>> > > Thanks,
> >> >>> > > Om
> >> >>> > >
> >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> >> >>> > <ah...@adobe.com.invalid>
> >> >>> > > wrote:
> >> >>> > >
> >> >>> > > > On your VM or mine? I don't think mine
> can
> >> handle
> >> >>> it. I used
> >> >>> > to
> >> >>> > > run jobs
> >> >>> > > > of master and agent and we got lots of
> failures
> >> and
> >> >>> jobs took
> >> >>> > > forever. If
> >> >>> > > > two jobs are trying to run tests with the
> >> shared Flash
> >> >>> Player
> >> >>> > > Debugger, for
> >> >>> > > > example, you won't get consistent results.
> >> >>> > > >
> >> >>> > > > -Alex
> >> >>> > > >
> >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> Muppirala" <
> >> >>> > bigosmallm@gmail.com<ma...@gmail.com>>
> >> >>> > > wrote:
> >> >>> > > >
> >> >>> > > > I just realized that we have only one
> Agent
> >> (node)
> >> >>> listed
> >> >>> > under
> >> >>> > > > Jenkins. I
> >> >>> > > > am going to add at least one more
> node to
> >> start
> >> >>> with.
> >> >>> > > >
> >> >>> > > > Thanks,
> >> >>> > > > Om
> >> >>> > > >
> >> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex
> Harui
> >> >>> > > <ah...@adobe.com.invalid>
> >> >>> > > > wrote:
> >> >>> > > >
> >> >>> > > > > I think I followed the instructions
> and
> >> enabled
> >> >>> SSH.
> >> >>> > > > >
> >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss"
> <
> >> >>> > yishayjobs@hotmail.com<mailto:yishayjobs@hotmail.com
> >>
> >> >>> > > wrote:
> >> >>> > > > >
> >> >>> > > > > I haven’t gotten it to work.
> Could be
> >> ssh
> >> >>> needs to be
> >> >>> > > enabled on
> >> >>> > > > the
> >> >>> > > > > VM [1]. This is nice to have but not
> >> essential.
> >> >>> So Alex,
> >> >>> > let
> >> >>> > > me know
> >> >>> > > > if you
> >> >>> > > > > want to try that, otherwise I’ll
> suspend
> >> my
> >> >>> efforts on
> >> >>> > this.
> >> >>> > > > >
> >> >>> > > > > [1]
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=Ikff9UaqSEGPgLs%2BUuFu3LC4nuq5DNyrECvZel0PnuE%3D&reserved=0
> >> >>> > >
> >> >>> > > > >
> >> >>> > > > > From: Yishay Weiss<mailto:
> >> >>> yishayjobs@hotmail.com
> >> >>> > <ma...@hotmail.com>>
> >> >>> > > > > Sent: Wednesday, April 15, 2020
> 5:09
> >> PM
> >> >>> > > > > To: dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org>>
> >> >>> > > > > Subject: RE: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > I’d like to try and install an
> ssh
> >> server.
> >> >>> Can anyone
> >> >>> > > think of a
> >> >>> > > > > reason not to do that? I’m asking in
> >> terms of
> >> >>> security,
> >> >>> > and if
> >> >>> > > there
> >> >>> > > > might
> >> >>> > > > > be a problem because it’s a VM.
> >> >>> > > > >
> >> >>> > > > > Thanks.
> >> >>> > > > >
> >> >>> > > > > From: Yishay Weiss<mailto:
> >> >>> yishayjobs@hotmail.com
> >> >>> > <ma...@hotmail.com>>
> >> >>> > > > > Sent: Monday, April 13, 2020
> 10:02 AM
> >> >>> > > > > To: dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org>>
> >> >>> > > > > Subject: RE: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > Related, as most (all?) of the
> >> instructions
> >> >>> don’t
> >> >>> > require
> >> >>> > > > anything but
> >> >>> > > > > a shell wouldn’t it be easier and
> faster
> >> to
> >> >>> access the
> >> >>> > machine
> >> >>> > > with
> >> >>> > > > ssh
> >> >>> > > > > [1], rather than using remote
> desktop?
> >> >>> > > > >
> >> >>> > > > > [1]
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=lIgC2%2F5w04u%2FXw87mk6OSSykzt%2F8st4vgZDB0yT54Dg%3D&reserved=0
> >> >>> > >
> >> >>> > > > >
> >> >>> > > > > From: Yishay Weiss<mailto:
> >> >>> yishayjobs@hotmail.com
> >> >>> > <ma...@hotmail.com>>
> >> >>> > > > > Sent: Monday, April 13, 2020
> 9:55 AM
> >> >>> > > > > To: dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org>>
> >> >>> > > > > Subject: RE: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > Can’t you do that with remote
> desktop?
> >> >>> > > > >
> >> >>> > > > > ________________________________
> >> >>> > > > > From: OmPrakash Muppirala <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>>
> >> >>> > > > > Sent: Monday, April 13, 2020
> 9:51:25
> >> AM
> >> >>> > > > > To: Apache Royale Development <
> >> >>> dev@royale.apache.org
> >> >>> > <ma...@royale.apache.org>>
> >> >>> > > > > Subject: Re: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > Alex,
> >> >>> > > > >
> >> >>> > > > > I believe this is your personal
> Azure
> >> >>> subscription
> >> >>> > right?
> >> >>> > > Any
> >> >>> > > > chance
> >> >>> > > > > I can
> >> >>> > > > > get access to it so I can try
> to copy
> >> the
> >> >>> image out
> >> >>> > the
> >> >>> > > machine
> >> >>> > > > and
> >> >>> > > > > redeploy it somewhere else?
> >> >>> > > > >
> >> >>> > > > > Thanks,
> >> >>> > > > > Om
> >> >>> > > > >
> >> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM
> >> OmPrakash
> >> >>> Muppirala <
> >> >>> > > > > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com
> >> >>> >>
> >> >>> > > > > wrote:
> >> >>> > > > >
> >> >>> > > > > > I can help set this up on
> Azure.
> >> Give me
> >> >>> some
> >> >>> > time to
> >> >>> > > work
> >> >>> > > > out the
> >> >>> > > > > > details?
> >> >>> > > > > >
> >> >>> > > > > > Thanks,
> >> >>> > > > > > Om
> >> >>> > > > > >
> >> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM
> >> Harbs <
> >> >>> > > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>
> >> >>> > > > wrote:
> >> >>> > > > > >
> >> >>> > > > > >> OK. Good to know.
> >> >>> > > > > >>
> >> >>> > > > > >> > On Apr 12, 2020, at 9:45
> PM,
> >> Alex Harui
> >> >>> > > > <aharui@adobe.com.INVALID
> >> >>> > > > > >
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >
> >> >>> > > > > >> > FWIW, I just looked and the
> >> longest job
> >> >>> in the
> >> >>> > release
> >> >>> > > > steps so
> >> >>> > > > > far is
> >> >>> > > > > >> 8 minutes. Most are under 2
> >> minutes.
> >> >>> There
> >> >>> > might be
> >> >>> > > jobs
> >> >>> > > > later
> >> >>> > > > > that take
> >> >>> > > > > >> longer that we haven't run
> yet.
> >> IMO, the
> >> >>> issue
> >> >>> > isn't
> >> >>> > > speed
> >> >>> > > > of the
> >> >>> > > > > machine,
> >> >>> > > > > >> it is just that we are
> sharing the
> >> >>> machine with
> >> >>> > longer
> >> >>> > > jobs
> >> >>> > > > (1 hour
> >> >>> > > > > for
> >> >>> > > > > >> TourDeFlexMigration). And
> again,
> >> the
> >> >>> machine
> >> >>> > will be
> >> >>> > > idle for
> >> >>> > > > > stretches of
> >> >>> > > > > >> time while the RM verifies
> >> artifacts
> >> >>> after each
> >> >>> > step.
> >> >>> > > > > >> >
> >> >>> > > > > >> > -Alex
> >> >>> > > > > >> >
> >> >>> > > > > >> > On 4/12/20, 11:32 AM,
> "Harbs" <
> >> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >> >>> > > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>>> wrote:
> >> >>> > > > > >> >
> >> >>> > > > > >> > Fair enough.
> >> >>> > > > > >> >
> >> >>> > > > > >> > I expect builds to be
> >> somewhere
> >> >>> between 10
> >> >>> > and 20
> >> >>> > > times
> >> >>> > > > faster
> >> >>> > > > > on a
> >> >>> > > > > >> powerful machine.
> >> >>> > > > > >> >
> >> >>> > > > > >> > Yeah. It’s probably
> going to
> >> be a
> >> >>> bit of work
> >> >>> > > changing
> >> >>> > > > the
> >> >>> > > > > server,
> >> >>> > > > > >> but probably worth it in the
> long
> >> run.
> >> >>> > > > > >> >
> >> >>> > > > > >> > I think I’ll try this
> when I
> >> do the
> >> >>> next
> >> >>> > release
> >> >>> > > unless
> >> >>> > > > Yishay
> >> >>> > > > > wants
> >> >>> > > > > >> to work with me on this for
> this
> >> release
> >> >>> — but
> >> >>> > I’m not
> >> >>> > > going
> >> >>> > > > to be
> >> >>> > > > > able to
> >> >>> > > > > >> help until after Passover
> (i.e.
> >> next
> >> >>> week).
> >> >>> > > > > >> >
> >> >>> > > > > >> > Thanks,
> >> >>> > > > > >> > Harbs
> >> >>> > > > > >> >
> >> >>> > > > > >> >> On Apr 12, 2020, at 9:22
> PM,
> >> Alex Harui
> >> >>> > > > <aharui@adobe.com.INVALID
> >> >>> > > > > >
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> The Azure portal says:
> Standard
> >> F2s_v2
> >> >>> (2
> >> >>> > vcpus, 4
> >> >>> > > GiB
> >> >>> > > > memory)
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> I think I am reading
> changes to
> >> the
> >> >>> build
> >> >>> > process in
> >> >>> > > your
> >> >>> > > > > >> suggestions. I do not
> really want
> >> to
> >> >>> spend more
> >> >>> > of my
> >> >>> > > time
> >> >>> > > > on this
> >> >>> > > > > >> process. But if you want to
> do
> >> the work,
> >> >>> that's
> >> >>> > fine
> >> >>> > > with me.
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> -Alex
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> On 4/12/20, 10:57 AM,
> "Harbs" <
> >> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >> >>> > > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com
> >> <mailto:
> >> >>> > harbs.lists@gmail.com>
> >> >>> > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> What kind of horsepower
> is
> >> included
> >> >>> in the
> >> >>> > free
> >> >>> > > Azure
> >> >>> > > > account?
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> The server I mentioned
> builds
> >> >>> (considerably)
> >> >>> > > faster than
> >> >>> > > > my own
> >> >>> > > > > >> local machine. The ci server
> seems
> >> to
> >> >>> build many
> >> >>> > times
> >> >>> > > slower.
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> One thing we can do to
> >> minimize
> >> >>> running
> >> >>> > server time
> >> >>> > > > would be to
> >> >>> > > > > >> transfer the artifacts to
> storage
> >> instead
> >> >>> of
> >> >>> > keeping
> >> >>> > > them on
> >> >>> > > > the
> >> >>> > > > > server. On
> >> >>> > > > > >> AWS, I’d probably use S3.
> Not sure
> >> what
> >> >>> the
> >> >>> > similar
> >> >>> > > service on
> >> >>> > > > > Azure is
> >> >>> > > > > >> called.
> >> >>> > > > > >> >>
> >> >>> > > > > >> >>> On Apr 12, 2020, at 8:26
> PM,
> >> Alex
> >> >>> Harui
> >> >>> > > > > <aharui@adobe.com.INVALID
> >> >>> > > > > >> <mailto:
> aharui@adobe.com.INVALID
> >> <mailto:
> >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> OK, that's pretty much
> how I
> >> >>> understand Azure
> >> >>> > as
> >> >>> > > well.
> >> >>> > > > The key
> >> >>> > > > > thing
> >> >>> > > > > >> is that "running" includes
> time
> >> where the
> >> >>> CI
> >> >>> > server is
> >> >>> > > not
> >> >>> > > > running
> >> >>> > > > > any
> >> >>> > > > > >> Jenkins jobs. The CI Server
> steps
> >> might
> >> >>> take
> >> >>> > only a few
> >> >>> > > > hours of
> >> >>> > > > > actual
> >> >>> > > > > >> server time, but there is
> time
> >> where the
> >> >>> RM is
> >> >>> > verifying
> >> >>> > > > artifacts
> >> >>> > > > > locally
> >> >>> > > > > >> so you'd be paying for that
> or the
> >> RM
> >> >>> would have
> >> >>> > to keep
> >> >>> > > > shutting
> >> >>> > > > > down and
> >> >>> > > > > >> restarting.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> Seems like it would be
> >> >>> cheaper/simpler to get
> >> >>> > the
> >> >>> > > free
> >> >>> > > > MSDN
> >> >>> > > > > account
> >> >>> > > > > >> and leave it running.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> -Alex
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> On 4/12/20, 10:15 AM,
> "Harbs" <
> >> >>> > > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>
> >> >>> > > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>>> wrote:
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> My experience is with
> AWS.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> I assume Microsoft has
> similar
> >> >>> offerings,
> >> >>> > but I
> >> >>> > > don’t
> >> >>> > > > have
> >> >>> > > > > >> experience with Azure.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> AWS has on-demand EC2
> >> instances
> >> >>> which you
> >> >>> > pay for
> >> >>> > > only
> >> >>> > > > the
> >> >>> > > > > actual
> >> >>> > > > > >> time that they are
> running.[1]
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> Instances can be
> started and
> >> stopped
> >> >>> via
> >> >>> > command
> >> >>> > > line
> >> >>> > > > (or via
> >> >>> > > > > the
> >> >>> > > > > >> web interface) as long as
> you have
> >> valid
> >> >>> > credentials to
> >> >>> > > do so.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> For example: an
> m5.4xlarge
> >> instance
> >> >>> has 16
> >> >>> > cores
> >> >>> > > and
> >> >>> > > > costs
> >> >>> > > > > about
> >> >>> > > > > >> $1.5 per hour. On a machine
> like
> >> that, a
> >> >>> full
> >> >>> > build
> >> >>> > > would
> >> >>> > > > probably
> >> >>> > > > > take
> >> >>> > > > > >> less than 10 minutes. It’s
> probably
> >> >>> possible to
> >> >>> > do a
> >> >>> > > full
> >> >>> > > > release
> >> >>> > > > > with only
> >> >>> > > > > >> a few hours of server time.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> Leaving a server like
> that
> >> running
> >> >>> all the
> >> >>> > time
> >> >>> > > would get
> >> >>> > > > > expensive,
> >> >>> > > > > >> but if it’s just spun up for
> >> releases,
> >> >>> you’d get
> >> >>> > very
> >> >>> > > fast
> >> >>> > > > builds
> >> >>> > > > > at a
> >> >>> > > > > >> reasonable price.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> I’d be happy to pay
> $10-$50
> >> (and
> >> >>> possibly
> >> >>> > more) per
> >> >>> > > > release to
> >> >>> > > > > make
> >> >>> > > > > >> the release process painless
> for
> >> the RM.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> [1]
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064148235&sdata=uWG4u%2FTSw4UKxnE989SwhpedCL1YqneOM03hB6bO09w%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> ><
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> >><
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064158224&sdata=Dl7nqEhexdwdk3ydY4yudv9kK3pT8Gp6lyVQDN2ruWE%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> ><
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C10c9e091b8054ef206df08d7e4f70e1a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229622064168215&sdata=9IHyKZw9hCPqqdsGYUJ%2F6%2BGt%2Bwb4dD8q1WFVkNxWK6E%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>>> On Apr 12, 2020, at
> 7:45 PM,
> >> Alex
> >> >>> Harui
> >> >>> > > > > <ah...@adobe.com.INVALID>
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> I'm not very
> experienced with
> >> >>> spinning up
> >> >>> > > servers. The
> >> >>> > > > CI
> >> >>> > > > > server we
> >> >>> > > > > >> are using is effectively
> free,
> >> based on a
> >> >>> generous
> >> >>> > > donation
> >> >>> > > > from
> >> >>> > > > > Microsoft
> >> >>> > > > > >> of MSDN accounts to ASF
> >> committers. So I
> >> >>> leave
> >> >>> > it up
> >> >>> > > 24/7,
> >> >>> > > > and
> >> >>> > > > > share the
> >> >>> > > > > >> RDP access on private@. I
> think
> >> any
> >> >>> other ASF
> >> >>> > > committer
> >> >>> > > > could do
> >> >>> > > > > the
> >> >>> > > > > >> same. IIRC, if that server
> >> actually is
> >> >>> stopped,
> >> >>> > I have
> >> >>> > > to
> >> >>> > > > use my
> >> >>> > > > > personal
> >> >>> > > > > >> (unshared) MSDN credentials
> to
> >> start it
> >> >>> again.
> >> >>> > AIUI,
> >> >>> > > if I
> >> >>> > > > > actually paid
> >> >>> > > > > >> for the server, it would
> cost me
> >> to leave
> >> >>> it
> >> >>> > running
> >> >>> > > even if
> >> >>> > > > it
> >> >>> > > > > didn't run
> >> >>> > > > > >> jobs between releases.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> Is that what you are
> basically
> >> >>> saying? I
> >> >>> > think it
> >> >>> > > might
> >> >>> > > > be
> >> >>> > > > > best if
> >> >>> > > > > >> another committer got a CI
> server
> >> going
> >> >>> via the MS
> >> >>> > > donation
> >> >>> > > > and
> >> >>> > > > > could leave
> >> >>> > > > > >> it up 24/7.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> -Alex
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> On 4/12/20, 9:28 AM,
> "Harbs" <
> >> >>> > > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>
> >> >>> > > > wrote:
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> I’m willing to do this.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> Considering that the
> release
> >> will be
> >> >>> run
> >> >>> > > infrequently, it
> >> >>> > > > > should be
> >> >>> > > > > >> doable to have a relatively
> >> powerful
> >> >>> server that
> >> >>> > could
> >> >>> > > be
> >> >>> > > > spun up on
> >> >>> > > > > >> demand. This is something I
> have
> >> setup
> >> >>> for my own
> >> >>> > > releases.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> The only complication
> would
> >> be that
> >> >>> each RM
> >> >>> > would
> >> >>> > > need
> >> >>> > > > valid
> >> >>> > > > > >> credentials to spin up the
> server.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> Harbs
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>>> On Apr 12, 2020, at
> 7:10 PM,
> >> Alex
> >> >>> Harui
> >> >>> > > > > <ah...@adobe.com.INVALID>
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >>>>>
> >> >>> > > > > >> >>>>> A better solution,
> IMO, is
> >> for
> >> >>> someone else
> >> >>> > to
> >> >>> > > offer up
> >> >>> > > > a CI
> >> >>> > > > > server
> >> >>> > > > > >> only for release jobs.
> >> >>> > > > > >>
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > > >
> >> >>> > > > >
> >> >>> > > > >
> >> >>> > > >
> >> >>> > > >
> >> >>> > > >
> >> >>> > >
> >> >>> > >
> >> >>> > >
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>>
> >>
> >>
> >>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Sun, Apr 19, 2020 at 11:37 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Royale-compiler has to be built first. This is an example of shared
> resources that I mentioned upthread. Royale-typedefs is going to look for
> a sibling workspace folder called royale-compiler with a built of
> royale-compiler in it. If royale-compiler fails to create all of its
> binaries or is in the process of building them, royale-typedefs will report
> an error.
>
Got it. I was just looking at the logic here:
https://github.com/apache/royale-typedefs/blob/85c74dde104294a0127ce46a8795d7534216e7eb/js/build.xml#L53
Weird. The royale-compiler build says it was successful, but I cant find
the lib directory under C:\jenkins\workspace\royale-compiler\compiler-jx
>
> What should probably happen is that royale-typedefs pulls down the
> lastsuccessfulartifacts from royale-compiler, but I've never found enough
> time and energy to try to make changes like that since most of us do have
> all of the folders as siblings.
>
> HTH,
> -Alex
>
> On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> I am now getting this error on royale-typedefs build:
>
> BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58: The
> following error occurred while executing this line:
> c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
>
> 'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
> doesn't exist.
>
>
> Where does the ROYALE_TRANSPILER_HOME var come from?
>
> Here is the full console output:
>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=vvN91svHM9UrGH%2FpsQoFdpyHgyVMwatr5NJ9s9%2FUfzc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
>
> On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <aharui@adobe.com.invalid
> >
> > wrote:
> >
> >> Congratulations! But does that mean that JAVA_HOME is pointing at
> a JRE
> >> instead of a JDK? If you have other issues that might be a factor.
> >>
> >
> > Yeah, I messed up initially by getting the JRE instead of JDK. I
> have
> > since corrected it. But for some reason Ant still thinks that
> JAVA_HOME is
> > the jre directory.
> > I don't know how to fix this, hence the hack :-|
> >
> >
> >
> >
> >>
> >> HTH,
> >> -Alex
> >>
> >> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >> wrote:
> >>
> >> I copied tools.jar from jdk/lib to the jre/lib. That seems to
> have
> >> fixed
> >> the issue.
> >> We now have a successful build of the royale-compiler on the
> new Agent
> >> machine!!
> >>
> >> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> wrote:
> >>
> >> > Restart dint help. Although Serkan's reply made me look at
> how Ant
> >> was
> >> > getting invoked.
> >> >
> >> > I see this warning that tools.jar is missing:
> >> >
> >> > [royale-compiler] $ cmd.exe /C
> >> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> >> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
> >> %%ERRORLEVEL%%"
> >> >
> >> > Unable to locate tools.jar. Expected to find it in C:\Program
> >> Files\Java\jre1.8.0_251\lib\tools.jar
> >> >
> >> >
> >> > I am pretty sure this is related to this issue.
> >> >
> >> >
> >> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
> >> bigosmallm@gmail.com>
> >> > wrote:
> >> >
> >> >>
> >> >>
> >> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> >> <ah...@adobe.com.invalid>
> >> >> wrote:
> >> >>
> >> >>> Did you reboot your VM? Also, have you checked what user is
> >> running
> >> >>> Jenkins on your VM? I think that can sometimes be a
> problem. I
> >> might be
> >> >>> running Jenkins as the user.
> >> >>>
> >> >>>
> >> >> Agents don't require Jenkins to be running. I will give the
> >> rebooting of
> >> >> the VM a shot .
> >> >>
> >> >> Thanks,
> >> >> Om
> >> >>
> >> >>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com
> >> >
> >> >>> wrote:
> >> >>>
> >> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> >> <ah...@adobe.com.invalid>
> >> >>> wrote:
> >> >>>
> >> >>> > Should be here:
> >> >>> >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=L6YhauHRF8IcSIlLJVFGn%2BPY5Ut%2BC9i2OBaNUF2yX20%3D&reserved=0
> >> >>>
> >> >>>
> >> >>> My git is located in the same exact location as master.
> >> >>> Moreover, the git call from the commandline executes
> fine.
> >> The git
> >> >>> call
> >> >>> from ant exec is what is failing.
> >> >>>
> >> >>>
> >> >>>
> >> >>> >
> >> >>> >
> >> >>> > HTH,
> >> >>> > -Alex
> >> >>> >
> >> >>> > From: OmPrakash Muppirala <bi...@gmail.com>
> >> >>> > Reply-To: "dev@royale.apache.org" <
> dev@royale.apache.org>
> >> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >> >>> > To: Apache Royale Development <de...@royale.apache.org>
> >> >>> > Subject: Re: Prioritize Release Jobs on CI
> >> >>> >
> >> >>> > I'm a bit stumped here. The royale-compiler is
> failing
> >> with this
> >> >>> error:
> >> >>> >
> >> >>> >
> >> >>> > BUILD FAILED
> >> >>> >
> >> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55:
> Execute
> >> >>> failed:
> >> >>> > java.io.IOException: Cannot run program "git" (in
> directory
> >> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess
> >> error=2,
> >> >>> The system
> >> >>> > cannot find the file specified
> >> >>> >
> >> >>> > at java.lang.ProcessBuilder.start(Unknown Source)
> >> >>> >
> >> >>> >
> >> >>> > It is from this part of the jenkins.xml:
> >> >>> >
> >> >>> >
> >> >>> > <target name="closure-lib-download"
> description="Copies
> >> Closure
> >> >>> > Library from GitHub">
> >> >>> > <echo message="Be patient. This takes a few
> >> minutes..." />
> >> >>> > <exec executable="git"
> failifexecutionfails="true">
> >> >>> > <arg value="clone" />
> >> >>> > <arg value="
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=a99eAxOF3LFn9BDj%2Ba%2FycnfqNWTKoBPMb9zqK37oEoo%3D&reserved=0
> >> >>> <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=a99eAxOF3LFn9BDj%2Ba%2FycnfqNWTKoBPMb9zqK37oEoo%3D&reserved=0
> >> >>> >"
> >> >>> > />
> >> >>> > <arg value="${closure.root}" />
> >> >>> > </exec>
> >> >>> > <echo>Cloned fresh copy of Google Closure
> >> Library</echo>
> >> >>> > </target>
> >> >>> >
> >> >>> > I am not sure how this executable call works without
> the
> >> full path.
> >> >>> >
> >> >>> > I checked the env variables, I do have both the
> git/bin and
> >> git/cmd
> >> >>> > directory in the PATH:
> >> >>> >
> >> >>> > [cid:ii_k97zkk9o0]
> >> >>> >
> >> >>> > What am I missing?
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> >
> >> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>> wrote:
> >> >>> > Update - I have successfully attached my VM as a slave
> >> agent of our
> >> >>> > Jenkins instance.
> >> >>> > I am going to pull the job - /royale-asjs_jsonly and
> tie it
> >> to my
> >> >>> agent so
> >> >>> > I can test it.
> >> >>> >
> >> >>> > It will fail for a sometime while I go set up my VM
> with
> >> all the
> >> >>> > dependencies.
> >> >>> >
> >> >>> > Once we have the job successfully building on my VM,
> we can
> >> figure
> >> >>> out how
> >> >>> > to divide the load between the master and agent.
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> >
> >> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>> wrote:
> >> >>> > We could achieve the same by creating a new agent
> (separate
> >> vm) and
> >> >>> > attaching it as a slave to the current Jenkins server.
> >> >>> >
> >> >>> > Then we can use labels/tags to tie release jobs to one
> >> agent and
> >> >>> non
> >> >>> > release jobs to another agent.
> >> >>> >
> >> >>> > That way we can maintain everything in one UI, one
> login
> >> while
> >> >>> achieving
> >> >>> > the concurrent building capabilities we want.
> >> >>> >
> >> >>> > Jenkins is built for this kind of stuff and I think it
> >> would be
> >> >>> best we
> >> >>> > followed this practice.
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> >> <ah...@adobe.com.invalid>
> >> >>> wrote:
> >> >>> > Om, I thought you were going to get the image from my
> VM
> >> and run
> >> >>> it on
> >> >>> > another VM. Then we'd remove all non-release jobs
> from
> >> your VM
> >> >>> and all of
> >> >>> > the release jobs from my VM. That won't solve the
> problem
> >> of how
> >> >>> long it
> >> >>> > takes for a commit to be built and tested, but will
> allow
> >> the RM
> >> >>> to get a
> >> >>> > release out without getting stuck behind the commit
> jobs.
> >> Is that
> >> >>> > currently the plan?
> >> >>> >
> >> >>> > -Alex
> >> >>> >
> >> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> >> bigosmallm@gmail.com
> >> >>> <mailto:
> >> >>> > bigosmallm@gmail.com>> wrote:
> >> >>> >
> >> >>> > Makes sense to me. I will set parallel executors
> back
> >> to 1.
> >> >>> >
> >> >>> > And start working on a new Jenkins instance.
> >> >>> >
> >> >>> > Thanks,
> >> >>> > Om
> >> >>> >
> >> >>> >
> >> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >> >>> <ah...@adobe.com.invalid>
> >> >>> > wrote:
> >> >>> >
> >> >>> > > Are you saying that Java, Ant and Maven do not
> know
> >> how to
> >> >>> > distribute work
> >> >>> > > to different cores?
> >> >>> > >
> >> >>> > > To repeat my main concern: our Jenkins jobs
> often
> >> use shared
> >> >>> > resources.
> >> >>> > > If you want to take the time to fix that, feel
> free,
> >> but I
> >> >>> do not
> >> >>> > know how
> >> >>> > > you are going to keep two jobs from both trying
> to
> >> launch
> >> >>> Flash
> >> >>> > Player
> >> >>> > > Debugger at the same time and open the same
> socket to
> >> >>> communicate
> >> >>> > with it,
> >> >>> > > or try to parse the flashlog.txt that they have
> both
> >> written
> >> >>> to.
> >> >>> > >
> >> >>> > > The royale-asjs job will use the royale-compiler
> >> workspace
> >> >>> to get the
> >> >>> > > compiler. If the compiler is building, the
> jars are
> >> not
> >> >>> there and
> >> >>> > the
> >> >>> > > royale-asjs build fails.
> >> >>> > >
> >> >>> > > There is also only so much memory and some of
> our
> >> jobs use
> >> >>> all of it
> >> >>> > and
> >> >>> > > I'm not sure if jobs slowed down due to paging
> memory
> >> and
> >> >>> > writing/reading
> >> >>> > > from disk, even if it is an SSD.
> >> >>> > >
> >> >>> > > I'm done for tonight, but that's what I was
> seeing
> >> last time
> >> >>> I tried
> >> >>> > to
> >> >>> > > have both master and an agent running jobs in
> >> parallel.
> >> >>> > >
> >> >>> > > Thanks,
> >> >>> > > -Alex
> >> >>> > >
> >> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>> wrote:
> >> >>> > >
> >> >>> > > A typical setup would be to have 0
> executors on
> >> master
> >> >>> and at
> >> >>> > least n
> >> >>> > > number of executors on each agent, where n =
> >> number of
> >> >>> cpu cores.
> >> >>> > > I see that the current VM has 2 cores. So,
> I
> >> started
> >> >>> with
> >> >>> > setting the
> >> >>> > > num
> >> >>> > > executors on the current agent to 2.
> >> >>> > >
> >> >>> > > This should improve things quite a bit. If
> this
> >> doesn't
> >> >>> work, I
> >> >>> > will
> >> >>> > > create a new VM and make it the slave agent
> of the
> >> >>> current
> >> >>> > Jenkins
> >> >>> > > master.
> >> >>> > >
> >> >>> > >
> >> >>> > > Thanks,
> >> >>> > > Om
> >> >>> > >
> >> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> >> >>> > <ah...@adobe.com.invalid>
> >> >>> > > wrote:
> >> >>> > >
> >> >>> > > > On your VM or mine? I don't think mine
> can
> >> handle
> >> >>> it. I used
> >> >>> > to
> >> >>> > > run jobs
> >> >>> > > > of master and agent and we got lots of
> failures
> >> and
> >> >>> jobs took
> >> >>> > > forever. If
> >> >>> > > > two jobs are trying to run tests with the
> >> shared Flash
> >> >>> Player
> >> >>> > > Debugger, for
> >> >>> > > > example, you won't get consistent results.
> >> >>> > > >
> >> >>> > > > -Alex
> >> >>> > > >
> >> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash
> Muppirala" <
> >> >>> > bigosmallm@gmail.com<ma...@gmail.com>>
> >> >>> > > wrote:
> >> >>> > > >
> >> >>> > > > I just realized that we have only one
> Agent
> >> (node)
> >> >>> listed
> >> >>> > under
> >> >>> > > > Jenkins. I
> >> >>> > > > am going to add at least one more
> node to
> >> start
> >> >>> with.
> >> >>> > > >
> >> >>> > > > Thanks,
> >> >>> > > > Om
> >> >>> > > >
> >> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex
> Harui
> >> >>> > > <ah...@adobe.com.invalid>
> >> >>> > > > wrote:
> >> >>> > > >
> >> >>> > > > > I think I followed the instructions
> and
> >> enabled
> >> >>> SSH.
> >> >>> > > > >
> >> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss"
> <
> >> >>> > yishayjobs@hotmail.com<mailto:yishayjobs@hotmail.com
> >>
> >> >>> > > wrote:
> >> >>> > > > >
> >> >>> > > > > I haven’t gotten it to work.
> Could be
> >> ssh
> >> >>> needs to be
> >> >>> > > enabled on
> >> >>> > > > the
> >> >>> > > > > VM [1]. This is nice to have but not
> >> essential.
> >> >>> So Alex,
> >> >>> > let
> >> >>> > > me know
> >> >>> > > > if you
> >> >>> > > > > want to try that, otherwise I’ll
> suspend
> >> my
> >> >>> efforts on
> >> >>> > this.
> >> >>> > > > >
> >> >>> > > > > [1]
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=MmNf%2F613Ns9MQEfBARvB4%2F15hs7UW1MIw6rsFo4EfCg%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=MmNf%2F613Ns9MQEfBARvB4%2F15hs7UW1MIw6rsFo4EfCg%3D&reserved=0
> >> >>> > >
> >> >>> > > > >
> >> >>> > > > > From: Yishay Weiss<mailto:
> >> >>> yishayjobs@hotmail.com
> >> >>> > <ma...@hotmail.com>>
> >> >>> > > > > Sent: Wednesday, April 15, 2020
> 5:09
> >> PM
> >> >>> > > > > To: dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org>>
> >> >>> > > > > Subject: RE: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > I’d like to try and install an
> ssh
> >> server.
> >> >>> Can anyone
> >> >>> > > think of a
> >> >>> > > > > reason not to do that? I’m asking in
> >> terms of
> >> >>> security,
> >> >>> > and if
> >> >>> > > there
> >> >>> > > > might
> >> >>> > > > > be a problem because it’s a VM.
> >> >>> > > > >
> >> >>> > > > > Thanks.
> >> >>> > > > >
> >> >>> > > > > From: Yishay Weiss<mailto:
> >> >>> yishayjobs@hotmail.com
> >> >>> > <ma...@hotmail.com>>
> >> >>> > > > > Sent: Monday, April 13, 2020
> 10:02 AM
> >> >>> > > > > To: dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org>>
> >> >>> > > > > Subject: RE: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > Related, as most (all?) of the
> >> instructions
> >> >>> don’t
> >> >>> > require
> >> >>> > > > anything but
> >> >>> > > > > a shell wouldn’t it be easier and
> faster
> >> to
> >> >>> access the
> >> >>> > machine
> >> >>> > > with
> >> >>> > > > ssh
> >> >>> > > > > [1], rather than using remote
> desktop?
> >> >>> > > > >
> >> >>> > > > > [1]
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=BxL32J7V1cv0P4ZIPfrHkGIcii9lgFYDNMUrR%2BLfgzA%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=BxL32J7V1cv0P4ZIPfrHkGIcii9lgFYDNMUrR%2BLfgzA%3D&reserved=0
> >> >>> > >
> >> >>> > > > >
> >> >>> > > > > From: Yishay Weiss<mailto:
> >> >>> yishayjobs@hotmail.com
> >> >>> > <ma...@hotmail.com>>
> >> >>> > > > > Sent: Monday, April 13, 2020
> 9:55 AM
> >> >>> > > > > To: dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org
> <mailto:
> >> >>> > dev@royale.apache.org>>
> >> >>> > > > > Subject: RE: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > Can’t you do that with remote
> desktop?
> >> >>> > > > >
> >> >>> > > > > ________________________________
> >> >>> > > > > From: OmPrakash Muppirala <
> >> >>> bigosmallm@gmail.com
> >> >>> > <ma...@gmail.com>>
> >> >>> > > > > Sent: Monday, April 13, 2020
> 9:51:25
> >> AM
> >> >>> > > > > To: Apache Royale Development <
> >> >>> dev@royale.apache.org
> >> >>> > <ma...@royale.apache.org>>
> >> >>> > > > > Subject: Re: Prioritize Release
> Jobs
> >> on CI
> >> >>> > > > >
> >> >>> > > > > Alex,
> >> >>> > > > >
> >> >>> > > > > I believe this is your personal
> Azure
> >> >>> subscription
> >> >>> > right?
> >> >>> > > Any
> >> >>> > > > chance
> >> >>> > > > > I can
> >> >>> > > > > get access to it so I can try
> to copy
> >> the
> >> >>> image out
> >> >>> > the
> >> >>> > > machine
> >> >>> > > > and
> >> >>> > > > > redeploy it somewhere else?
> >> >>> > > > >
> >> >>> > > > > Thanks,
> >> >>> > > > > Om
> >> >>> > > > >
> >> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM
> >> OmPrakash
> >> >>> Muppirala <
> >> >>> > > > > bigosmallm@gmail.com<mailto:
> >> bigosmallm@gmail.com
> >> >>> >>
> >> >>> > > > > wrote:
> >> >>> > > > >
> >> >>> > > > > > I can help set this up on
> Azure.
> >> Give me
> >> >>> some
> >> >>> > time to
> >> >>> > > work
> >> >>> > > > out the
> >> >>> > > > > > details?
> >> >>> > > > > >
> >> >>> > > > > > Thanks,
> >> >>> > > > > > Om
> >> >>> > > > > >
> >> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM
> >> Harbs <
> >> >>> > > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>
> >> >>> > > > wrote:
> >> >>> > > > > >
> >> >>> > > > > >> OK. Good to know.
> >> >>> > > > > >>
> >> >>> > > > > >> > On Apr 12, 2020, at 9:45
> PM,
> >> Alex Harui
> >> >>> > > > <aharui@adobe.com.INVALID
> >> >>> > > > > >
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >
> >> >>> > > > > >> > FWIW, I just looked and the
> >> longest job
> >> >>> in the
> >> >>> > release
> >> >>> > > > steps so
> >> >>> > > > > far is
> >> >>> > > > > >> 8 minutes. Most are under 2
> >> minutes.
> >> >>> There
> >> >>> > might be
> >> >>> > > jobs
> >> >>> > > > later
> >> >>> > > > > that take
> >> >>> > > > > >> longer that we haven't run
> yet.
> >> IMO, the
> >> >>> issue
> >> >>> > isn't
> >> >>> > > speed
> >> >>> > > > of the
> >> >>> > > > > machine,
> >> >>> > > > > >> it is just that we are
> sharing the
> >> >>> machine with
> >> >>> > longer
> >> >>> > > jobs
> >> >>> > > > (1 hour
> >> >>> > > > > for
> >> >>> > > > > >> TourDeFlexMigration). And
> again,
> >> the
> >> >>> machine
> >> >>> > will be
> >> >>> > > idle for
> >> >>> > > > > stretches of
> >> >>> > > > > >> time while the RM verifies
> >> artifacts
> >> >>> after each
> >> >>> > step.
> >> >>> > > > > >> >
> >> >>> > > > > >> > -Alex
> >> >>> > > > > >> >
> >> >>> > > > > >> > On 4/12/20, 11:32 AM,
> "Harbs" <
> >> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >> >>> > > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>>> wrote:
> >> >>> > > > > >> >
> >> >>> > > > > >> > Fair enough.
> >> >>> > > > > >> >
> >> >>> > > > > >> > I expect builds to be
> >> somewhere
> >> >>> between 10
> >> >>> > and 20
> >> >>> > > times
> >> >>> > > > faster
> >> >>> > > > > on a
> >> >>> > > > > >> powerful machine.
> >> >>> > > > > >> >
> >> >>> > > > > >> > Yeah. It’s probably
> going to
> >> be a
> >> >>> bit of work
> >> >>> > > changing
> >> >>> > > > the
> >> >>> > > > > server,
> >> >>> > > > > >> but probably worth it in the
> long
> >> run.
> >> >>> > > > > >> >
> >> >>> > > > > >> > I think I’ll try this
> when I
> >> do the
> >> >>> next
> >> >>> > release
> >> >>> > > unless
> >> >>> > > > Yishay
> >> >>> > > > > wants
> >> >>> > > > > >> to work with me on this for
> this
> >> release
> >> >>> — but
> >> >>> > I’m not
> >> >>> > > going
> >> >>> > > > to be
> >> >>> > > > > able to
> >> >>> > > > > >> help until after Passover
> (i.e.
> >> next
> >> >>> week).
> >> >>> > > > > >> >
> >> >>> > > > > >> > Thanks,
> >> >>> > > > > >> > Harbs
> >> >>> > > > > >> >
> >> >>> > > > > >> >> On Apr 12, 2020, at 9:22
> PM,
> >> Alex Harui
> >> >>> > > > <aharui@adobe.com.INVALID
> >> >>> > > > > >
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> The Azure portal says:
> Standard
> >> F2s_v2
> >> >>> (2
> >> >>> > vcpus, 4
> >> >>> > > GiB
> >> >>> > > > memory)
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> I think I am reading
> changes to
> >> the
> >> >>> build
> >> >>> > process in
> >> >>> > > your
> >> >>> > > > > >> suggestions. I do not
> really want
> >> to
> >> >>> spend more
> >> >>> > of my
> >> >>> > > time
> >> >>> > > > on this
> >> >>> > > > > >> process. But if you want to
> do
> >> the work,
> >> >>> that's
> >> >>> > fine
> >> >>> > > with me.
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> -Alex
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> On 4/12/20, 10:57 AM,
> "Harbs" <
> >> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >> >>> > > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com
> >> <mailto:
> >> >>> > harbs.lists@gmail.com>
> >> >>> > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>>>> wrote:
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> What kind of horsepower
> is
> >> included
> >> >>> in the
> >> >>> > free
> >> >>> > > Azure
> >> >>> > > > account?
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> The server I mentioned
> builds
> >> >>> (considerably)
> >> >>> > > faster than
> >> >>> > > > my own
> >> >>> > > > > >> local machine. The ci server
> seems
> >> to
> >> >>> build many
> >> >>> > times
> >> >>> > > slower.
> >> >>> > > > > >> >>
> >> >>> > > > > >> >> One thing we can do to
> >> minimize
> >> >>> running
> >> >>> > server time
> >> >>> > > > would be to
> >> >>> > > > > >> transfer the artifacts to
> storage
> >> instead
> >> >>> of
> >> >>> > keeping
> >> >>> > > them on
> >> >>> > > > the
> >> >>> > > > > server. On
> >> >>> > > > > >> AWS, I’d probably use S3.
> Not sure
> >> what
> >> >>> the
> >> >>> > similar
> >> >>> > > service on
> >> >>> > > > > Azure is
> >> >>> > > > > >> called.
> >> >>> > > > > >> >>
> >> >>> > > > > >> >>> On Apr 12, 2020, at 8:26
> PM,
> >> Alex
> >> >>> Harui
> >> >>> > > > > <aharui@adobe.com.INVALID
> >> >>> > > > > >> <mailto:
> aharui@adobe.com.INVALID
> >> <mailto:
> >> >>> > aharui@adobe.com.INVALID>>> wrote:
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> OK, that's pretty much
> how I
> >> >>> understand Azure
> >> >>> > as
> >> >>> > > well.
> >> >>> > > > The key
> >> >>> > > > > thing
> >> >>> > > > > >> is that "running" includes
> time
> >> where the
> >> >>> CI
> >> >>> > server is
> >> >>> > > not
> >> >>> > > > running
> >> >>> > > > > any
> >> >>> > > > > >> Jenkins jobs. The CI Server
> steps
> >> might
> >> >>> take
> >> >>> > only a few
> >> >>> > > > hours of
> >> >>> > > > > actual
> >> >>> > > > > >> server time, but there is
> time
> >> where the
> >> >>> RM is
> >> >>> > verifying
> >> >>> > > > artifacts
> >> >>> > > > > locally
> >> >>> > > > > >> so you'd be paying for that
> or the
> >> RM
> >> >>> would have
> >> >>> > to keep
> >> >>> > > > shutting
> >> >>> > > > > down and
> >> >>> > > > > >> restarting.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> Seems like it would be
> >> >>> cheaper/simpler to get
> >> >>> > the
> >> >>> > > free
> >> >>> > > > MSDN
> >> >>> > > > > account
> >> >>> > > > > >> and leave it running.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> -Alex
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> On 4/12/20, 10:15 AM,
> "Harbs" <
> >> >>> > > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>
> >> >>> > > > <mailto:
> >> >>> > > > > >> harbs.lists@gmail.com
> <mailto:
> >> >>> > harbs.lists@gmail.com>>> wrote:
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> My experience is with
> AWS.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> I assume Microsoft has
> similar
> >> >>> offerings,
> >> >>> > but I
> >> >>> > > don’t
> >> >>> > > > have
> >> >>> > > > > >> experience with Azure.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> AWS has on-demand EC2
> >> instances
> >> >>> which you
> >> >>> > pay for
> >> >>> > > only
> >> >>> > > > the
> >> >>> > > > > actual
> >> >>> > > > > >> time that they are
> running.[1]
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> Instances can be
> started and
> >> stopped
> >> >>> via
> >> >>> > command
> >> >>> > > line
> >> >>> > > > (or via
> >> >>> > > > > the
> >> >>> > > > > >> web interface) as long as
> you have
> >> valid
> >> >>> > credentials to
> >> >>> > > do so.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> For example: an
> m5.4xlarge
> >> instance
> >> >>> has 16
> >> >>> > cores
> >> >>> > > and
> >> >>> > > > costs
> >> >>> > > > > about
> >> >>> > > > > >> $1.5 per hour. On a machine
> like
> >> that, a
> >> >>> full
> >> >>> > build
> >> >>> > > would
> >> >>> > > > probably
> >> >>> > > > > take
> >> >>> > > > > >> less than 10 minutes. It’s
> probably
> >> >>> possible to
> >> >>> > do a
> >> >>> > > full
> >> >>> > > > release
> >> >>> > > > > with only
> >> >>> > > > > >> a few hours of server time.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> Leaving a server like
> that
> >> running
> >> >>> all the
> >> >>> > time
> >> >>> > > would get
> >> >>> > > > > expensive,
> >> >>> > > > > >> but if it’s just spun up for
> >> releases,
> >> >>> you’d get
> >> >>> > very
> >> >>> > > fast
> >> >>> > > > builds
> >> >>> > > > > at a
> >> >>> > > > > >> reasonable price.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> I’d be happy to pay
> $10-$50
> >> (and
> >> >>> possibly
> >> >>> > more) per
> >> >>> > > > release to
> >> >>> > > > > make
> >> >>> > > > > >> the release process painless
> for
> >> the RM.
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>> [1]
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> ><
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> >><
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> ><
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> <
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > >
> >> >>> > >
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > <
> >> >>> >
> >> >>>
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
> >> >>> > >
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>>
> >> >>> > > > > >> >>>> On Apr 12, 2020, at
> 7:45 PM,
> >> Alex
> >> >>> Harui
> >> >>> > > > > <ah...@adobe.com.INVALID>
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> I'm not very
> experienced with
> >> >>> spinning up
> >> >>> > > servers. The
> >> >>> > > > CI
> >> >>> > > > > server we
> >> >>> > > > > >> are using is effectively
> free,
> >> based on a
> >> >>> generous
> >> >>> > > donation
> >> >>> > > > from
> >> >>> > > > > Microsoft
> >> >>> > > > > >> of MSDN accounts to ASF
> >> committers. So I
> >> >>> leave
> >> >>> > it up
> >> >>> > > 24/7,
> >> >>> > > > and
> >> >>> > > > > share the
> >> >>> > > > > >> RDP access on private@. I
> think
> >> any
> >> >>> other ASF
> >> >>> > > committer
> >> >>> > > > could do
> >> >>> > > > > the
> >> >>> > > > > >> same. IIRC, if that server
> >> actually is
> >> >>> stopped,
> >> >>> > I have
> >> >>> > > to
> >> >>> > > > use my
> >> >>> > > > > personal
> >> >>> > > > > >> (unshared) MSDN credentials
> to
> >> start it
> >> >>> again.
> >> >>> > AIUI,
> >> >>> > > if I
> >> >>> > > > > actually paid
> >> >>> > > > > >> for the server, it would
> cost me
> >> to leave
> >> >>> it
> >> >>> > running
> >> >>> > > even if
> >> >>> > > > it
> >> >>> > > > > didn't run
> >> >>> > > > > >> jobs between releases.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> Is that what you are
> basically
> >> >>> saying? I
> >> >>> > think it
> >> >>> > > might
> >> >>> > > > be
> >> >>> > > > > best if
> >> >>> > > > > >> another committer got a CI
> server
> >> going
> >> >>> via the MS
> >> >>> > > donation
> >> >>> > > > and
> >> >>> > > > > could leave
> >> >>> > > > > >> it up 24/7.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> -Alex
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> On 4/12/20, 9:28 AM,
> "Harbs" <
> >> >>> > > harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>
> >> >>> > > > wrote:
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> I’m willing to do this.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> Considering that the
> release
> >> will be
> >> >>> run
> >> >>> > > infrequently, it
> >> >>> > > > > should be
> >> >>> > > > > >> doable to have a relatively
> >> powerful
> >> >>> server that
> >> >>> > could
> >> >>> > > be
> >> >>> > > > spun up on
> >> >>> > > > > >> demand. This is something I
> have
> >> setup
> >> >>> for my own
> >> >>> > > releases.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> The only complication
> would
> >> be that
> >> >>> each RM
> >> >>> > would
> >> >>> > > need
> >> >>> > > > valid
> >> >>> > > > > >> credentials to spin up the
> server.
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>> Harbs
> >> >>> > > > > >> >>>>
> >> >>> > > > > >> >>>>> On Apr 12, 2020, at
> 7:10 PM,
> >> Alex
> >> >>> Harui
> >> >>> > > > > <ah...@adobe.com.INVALID>
> >> >>> > > > > >> wrote:
> >> >>> > > > > >> >>>>>
> >> >>> > > > > >> >>>>> A better solution,
> IMO, is
> >> for
> >> >>> someone else
> >> >>> > to
> >> >>> > > offer up
> >> >>> > > > a CI
> >> >>> > > > > server
> >> >>> > > > > >> only for release jobs.
> >> >>> > > > > >>
> >> >>> > > > > >>
> >> >>> > > > >
> >> >>> > > > >
> >> >>> > > > >
> >> >>> > > > >
> >> >>> > > >
> >> >>> > > >
> >> >>> > > >
> >> >>> > >
> >> >>> > >
> >> >>> > >
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>>
> >>
> >>
> >>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Royale-compiler has to be built first. This is an example of shared resources that I mentioned upthread. Royale-typedefs is going to look for a sibling workspace folder called royale-compiler with a built of royale-compiler in it. If royale-compiler fails to create all of its binaries or is in the process of building them, royale-typedefs will report an error.
What should probably happen is that royale-typedefs pulls down the lastsuccessfulartifacts from royale-compiler, but I've never found enough time and energy to try to make changes like that since most of us do have all of the folders as siblings.
HTH,
-Alex
On 4/19/20, 11:31 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
I am now getting this error on royale-typedefs build:
BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58: The
following error occurred while executing this line:
c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
doesn't exist.
Where does the ROYALE_TRANSPILER_HOME var come from?
Here is the full console output:
https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2Fview%2FAgent%25202%2520&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=vvN91svHM9UrGH%2FpsQoFdpyHgyVMwatr5NJ9s9%2FUfzc%3D&reserved=0(Om's%20VM)/job/royale-typedefs/552/console
On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> Congratulations! But does that mean that JAVA_HOME is pointing at a JRE
>> instead of a JDK? If you have other issues that might be a factor.
>>
>
> Yeah, I messed up initially by getting the JRE instead of JDK. I have
> since corrected it. But for some reason Ant still thinks that JAVA_HOME is
> the jre directory.
> I don't know how to fix this, hence the hack :-|
>
>
>
>
>>
>> HTH,
>> -Alex
>>
>> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> I copied tools.jar from jdk/lib to the jre/lib. That seems to have
>> fixed
>> the issue.
>> We now have a successful build of the royale-compiler on the new Agent
>> machine!!
>>
>> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> wrote:
>>
>> > Restart dint help. Although Serkan's reply made me look at how Ant
>> was
>> > getting invoked.
>> >
>> > I see this warning that tools.jar is missing:
>> >
>> > [royale-compiler] $ cmd.exe /C
>> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
>> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
>> %%ERRORLEVEL%%"
>> >
>> > Unable to locate tools.jar. Expected to find it in C:\Program
>> Files\Java\jre1.8.0_251\lib\tools.jar
>> >
>> >
>> > I am pretty sure this is related to this issue.
>> >
>> >
>> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> > wrote:
>> >
>> >>
>> >>
>> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> <ah...@adobe.com.invalid>
>> >> wrote:
>> >>
>> >>> Did you reboot your VM? Also, have you checked what user is
>> running
>> >>> Jenkins on your VM? I think that can sometimes be a problem. I
>> might be
>> >>> running Jenkins as the user.
>> >>>
>> >>>
>> >> Agents don't require Jenkins to be running. I will give the
>> rebooting of
>> >> the VM a shot .
>> >>
>> >> Thanks,
>> >> Om
>> >>
>> >>
>> >>> -Alex
>> >>>
>> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
>> >
>> >>> wrote:
>> >>>
>> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
>> <ah...@adobe.com.invalid>
>> >>> wrote:
>> >>>
>> >>> > Should be here:
>> >>> >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=L6YhauHRF8IcSIlLJVFGn%2BPY5Ut%2BC9i2OBaNUF2yX20%3D&reserved=0
>> >>>
>> >>>
>> >>> My git is located in the same exact location as master.
>> >>> Moreover, the git call from the commandline executes fine.
>> The git
>> >>> call
>> >>> from ant exec is what is failing.
>> >>>
>> >>>
>> >>>
>> >>> >
>> >>> >
>> >>> > HTH,
>> >>> > -Alex
>> >>> >
>> >>> > From: OmPrakash Muppirala <bi...@gmail.com>
>> >>> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
>> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> >>> > To: Apache Royale Development <de...@royale.apache.org>
>> >>> > Subject: Re: Prioritize Release Jobs on CI
>> >>> >
>> >>> > I'm a bit stumped here. The royale-compiler is failing
>> with this
>> >>> error:
>> >>> >
>> >>> >
>> >>> > BUILD FAILED
>> >>> >
>> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute
>> >>> failed:
>> >>> > java.io.IOException: Cannot run program "git" (in directory
>> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess
>> error=2,
>> >>> The system
>> >>> > cannot find the file specified
>> >>> >
>> >>> > at java.lang.ProcessBuilder.start(Unknown Source)
>> >>> >
>> >>> >
>> >>> > It is from this part of the jenkins.xml:
>> >>> >
>> >>> >
>> >>> > <target name="closure-lib-download" description="Copies
>> Closure
>> >>> > Library from GitHub">
>> >>> > <echo message="Be patient. This takes a few
>> minutes..." />
>> >>> > <exec executable="git" failifexecutionfails="true">
>> >>> > <arg value="clone" />
>> >>> > <arg value="
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=a99eAxOF3LFn9BDj%2Ba%2FycnfqNWTKoBPMb9zqK37oEoo%3D&reserved=0
>> >>> <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=a99eAxOF3LFn9BDj%2Ba%2FycnfqNWTKoBPMb9zqK37oEoo%3D&reserved=0
>> >>> >"
>> >>> > />
>> >>> > <arg value="${closure.root}" />
>> >>> > </exec>
>> >>> > <echo>Cloned fresh copy of Google Closure
>> Library</echo>
>> >>> > </target>
>> >>> >
>> >>> > I am not sure how this executable call works without the
>> full path.
>> >>> >
>> >>> > I checked the env variables, I do have both the git/bin and
>> git/cmd
>> >>> > directory in the PATH:
>> >>> >
>> >>> > [cid:ii_k97zkk9o0]
>> >>> >
>> >>> > What am I missing?
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> >
>> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>> wrote:
>> >>> > Update - I have successfully attached my VM as a slave
>> agent of our
>> >>> > Jenkins instance.
>> >>> > I am going to pull the job - /royale-asjs_jsonly and tie it
>> to my
>> >>> agent so
>> >>> > I can test it.
>> >>> >
>> >>> > It will fail for a sometime while I go set up my VM with
>> all the
>> >>> > dependencies.
>> >>> >
>> >>> > Once we have the job successfully building on my VM, we can
>> figure
>> >>> out how
>> >>> > to divide the load between the master and agent.
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> >
>> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>> wrote:
>> >>> > We could achieve the same by creating a new agent (separate
>> vm) and
>> >>> > attaching it as a slave to the current Jenkins server.
>> >>> >
>> >>> > Then we can use labels/tags to tie release jobs to one
>> agent and
>> >>> non
>> >>> > release jobs to another agent.
>> >>> >
>> >>> > That way we can maintain everything in one UI, one login
>> while
>> >>> achieving
>> >>> > the concurrent building capabilities we want.
>> >>> >
>> >>> > Jenkins is built for this kind of stuff and I think it
>> would be
>> >>> best we
>> >>> > followed this practice.
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
>> <ah...@adobe.com.invalid>
>> >>> wrote:
>> >>> > Om, I thought you were going to get the image from my VM
>> and run
>> >>> it on
>> >>> > another VM. Then we'd remove all non-release jobs from
>> your VM
>> >>> and all of
>> >>> > the release jobs from my VM. That won't solve the problem
>> of how
>> >>> long it
>> >>> > takes for a commit to be built and tested, but will allow
>> the RM
>> >>> to get a
>> >>> > release out without getting stuck behind the commit jobs.
>> Is that
>> >>> > currently the plan?
>> >>> >
>> >>> > -Alex
>> >>> >
>> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com
>> >>> <mailto:
>> >>> > bigosmallm@gmail.com>> wrote:
>> >>> >
>> >>> > Makes sense to me. I will set parallel executors back
>> to 1.
>> >>> >
>> >>> > And start working on a new Jenkins instance.
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> >
>> >>> >
>> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> >>> <ah...@adobe.com.invalid>
>> >>> > wrote:
>> >>> >
>> >>> > > Are you saying that Java, Ant and Maven do not know
>> how to
>> >>> > distribute work
>> >>> > > to different cores?
>> >>> > >
>> >>> > > To repeat my main concern: our Jenkins jobs often
>> use shared
>> >>> > resources.
>> >>> > > If you want to take the time to fix that, feel free,
>> but I
>> >>> do not
>> >>> > know how
>> >>> > > you are going to keep two jobs from both trying to
>> launch
>> >>> Flash
>> >>> > Player
>> >>> > > Debugger at the same time and open the same socket to
>> >>> communicate
>> >>> > with it,
>> >>> > > or try to parse the flashlog.txt that they have both
>> written
>> >>> to.
>> >>> > >
>> >>> > > The royale-asjs job will use the royale-compiler
>> workspace
>> >>> to get the
>> >>> > > compiler. If the compiler is building, the jars are
>> not
>> >>> there and
>> >>> > the
>> >>> > > royale-asjs build fails.
>> >>> > >
>> >>> > > There is also only so much memory and some of our
>> jobs use
>> >>> all of it
>> >>> > and
>> >>> > > I'm not sure if jobs slowed down due to paging memory
>> and
>> >>> > writing/reading
>> >>> > > from disk, even if it is an SSD.
>> >>> > >
>> >>> > > I'm done for tonight, but that's what I was seeing
>> last time
>> >>> I tried
>> >>> > to
>> >>> > > have both master and an agent running jobs in
>> parallel.
>> >>> > >
>> >>> > > Thanks,
>> >>> > > -Alex
>> >>> > >
>> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>> wrote:
>> >>> > >
>> >>> > > A typical setup would be to have 0 executors on
>> master
>> >>> and at
>> >>> > least n
>> >>> > > number of executors on each agent, where n =
>> number of
>> >>> cpu cores.
>> >>> > > I see that the current VM has 2 cores. So, I
>> started
>> >>> with
>> >>> > setting the
>> >>> > > num
>> >>> > > executors on the current agent to 2.
>> >>> > >
>> >>> > > This should improve things quite a bit. If this
>> doesn't
>> >>> work, I
>> >>> > will
>> >>> > > create a new VM and make it the slave agent of the
>> >>> current
>> >>> > Jenkins
>> >>> > > master.
>> >>> > >
>> >>> > >
>> >>> > > Thanks,
>> >>> > > Om
>> >>> > >
>> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>> >>> > <ah...@adobe.com.invalid>
>> >>> > > wrote:
>> >>> > >
>> >>> > > > On your VM or mine? I don't think mine can
>> handle
>> >>> it. I used
>> >>> > to
>> >>> > > run jobs
>> >>> > > > of master and agent and we got lots of failures
>> and
>> >>> jobs took
>> >>> > > forever. If
>> >>> > > > two jobs are trying to run tests with the
>> shared Flash
>> >>> Player
>> >>> > > Debugger, for
>> >>> > > > example, you won't get consistent results.
>> >>> > > >
>> >>> > > > -Alex
>> >>> > > >
>> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>> >>> > bigosmallm@gmail.com<ma...@gmail.com>>
>> >>> > > wrote:
>> >>> > > >
>> >>> > > > I just realized that we have only one Agent
>> (node)
>> >>> listed
>> >>> > under
>> >>> > > > Jenkins. I
>> >>> > > > am going to add at least one more node to
>> start
>> >>> with.
>> >>> > > >
>> >>> > > > Thanks,
>> >>> > > > Om
>> >>> > > >
>> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>> >>> > > <ah...@adobe.com.invalid>
>> >>> > > > wrote:
>> >>> > > >
>> >>> > > > > I think I followed the instructions and
>> enabled
>> >>> SSH.
>> >>> > > > >
>> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>> >>> > yishayjobs@hotmail.com<ma...@hotmail.com>>
>> >>> > > wrote:
>> >>> > > > >
>> >>> > > > > I haven’t gotten it to work. Could be
>> ssh
>> >>> needs to be
>> >>> > > enabled on
>> >>> > > > the
>> >>> > > > > VM [1]. This is nice to have but not
>> essential.
>> >>> So Alex,
>> >>> > let
>> >>> > > me know
>> >>> > > > if you
>> >>> > > > > want to try that, otherwise I’ll suspend
>> my
>> >>> efforts on
>> >>> > this.
>> >>> > > > >
>> >>> > > > > [1]
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=MmNf%2F613Ns9MQEfBARvB4%2F15hs7UW1MIw6rsFo4EfCg%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695411638&sdata=MmNf%2F613Ns9MQEfBARvB4%2F15hs7UW1MIw6rsFo4EfCg%3D&reserved=0
>> >>> > >
>> >>> > > > >
>> >>> > > > > From: Yishay Weiss<mailto:
>> >>> yishayjobs@hotmail.com
>> >>> > <ma...@hotmail.com>>
>> >>> > > > > Sent: Wednesday, April 15, 2020 5:09
>> PM
>> >>> > > > > To: dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org>>
>> >>> > > > > Subject: RE: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > I’d like to try and install an ssh
>> server.
>> >>> Can anyone
>> >>> > > think of a
>> >>> > > > > reason not to do that? I’m asking in
>> terms of
>> >>> security,
>> >>> > and if
>> >>> > > there
>> >>> > > > might
>> >>> > > > > be a problem because it’s a VM.
>> >>> > > > >
>> >>> > > > > Thanks.
>> >>> > > > >
>> >>> > > > > From: Yishay Weiss<mailto:
>> >>> yishayjobs@hotmail.com
>> >>> > <ma...@hotmail.com>>
>> >>> > > > > Sent: Monday, April 13, 2020 10:02 AM
>> >>> > > > > To: dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org>>
>> >>> > > > > Subject: RE: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > Related, as most (all?) of the
>> instructions
>> >>> don’t
>> >>> > require
>> >>> > > > anything but
>> >>> > > > > a shell wouldn’t it be easier and faster
>> to
>> >>> access the
>> >>> > machine
>> >>> > > with
>> >>> > > > ssh
>> >>> > > > > [1], rather than using remote desktop?
>> >>> > > > >
>> >>> > > > > [1]
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=BxL32J7V1cv0P4ZIPfrHkGIcii9lgFYDNMUrR%2BLfgzA%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=BxL32J7V1cv0P4ZIPfrHkGIcii9lgFYDNMUrR%2BLfgzA%3D&reserved=0
>> >>> > >
>> >>> > > > >
>> >>> > > > > From: Yishay Weiss<mailto:
>> >>> yishayjobs@hotmail.com
>> >>> > <ma...@hotmail.com>>
>> >>> > > > > Sent: Monday, April 13, 2020 9:55 AM
>> >>> > > > > To: dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org>>
>> >>> > > > > Subject: RE: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > Can’t you do that with remote desktop?
>> >>> > > > >
>> >>> > > > > ________________________________
>> >>> > > > > From: OmPrakash Muppirala <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>>
>> >>> > > > > Sent: Monday, April 13, 2020 9:51:25
>> AM
>> >>> > > > > To: Apache Royale Development <
>> >>> dev@royale.apache.org
>> >>> > <ma...@royale.apache.org>>
>> >>> > > > > Subject: Re: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > Alex,
>> >>> > > > >
>> >>> > > > > I believe this is your personal Azure
>> >>> subscription
>> >>> > right?
>> >>> > > Any
>> >>> > > > chance
>> >>> > > > > I can
>> >>> > > > > get access to it so I can try to copy
>> the
>> >>> image out
>> >>> > the
>> >>> > > machine
>> >>> > > > and
>> >>> > > > > redeploy it somewhere else?
>> >>> > > > >
>> >>> > > > > Thanks,
>> >>> > > > > Om
>> >>> > > > >
>> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM
>> OmPrakash
>> >>> Muppirala <
>> >>> > > > > bigosmallm@gmail.com<mailto:
>> bigosmallm@gmail.com
>> >>> >>
>> >>> > > > > wrote:
>> >>> > > > >
>> >>> > > > > > I can help set this up on Azure.
>> Give me
>> >>> some
>> >>> > time to
>> >>> > > work
>> >>> > > > out the
>> >>> > > > > > details?
>> >>> > > > > >
>> >>> > > > > > Thanks,
>> >>> > > > > > Om
>> >>> > > > > >
>> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM
>> Harbs <
>> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>> >>> > > > wrote:
>> >>> > > > > >
>> >>> > > > > >> OK. Good to know.
>> >>> > > > > >>
>> >>> > > > > >> > On Apr 12, 2020, at 9:45 PM,
>> Alex Harui
>> >>> > > > <aharui@adobe.com.INVALID
>> >>> > > > > >
>> >>> > > > > >> wrote:
>> >>> > > > > >> >
>> >>> > > > > >> > FWIW, I just looked and the
>> longest job
>> >>> in the
>> >>> > release
>> >>> > > > steps so
>> >>> > > > > far is
>> >>> > > > > >> 8 minutes. Most are under 2
>> minutes.
>> >>> There
>> >>> > might be
>> >>> > > jobs
>> >>> > > > later
>> >>> > > > > that take
>> >>> > > > > >> longer that we haven't run yet.
>> IMO, the
>> >>> issue
>> >>> > isn't
>> >>> > > speed
>> >>> > > > of the
>> >>> > > > > machine,
>> >>> > > > > >> it is just that we are sharing the
>> >>> machine with
>> >>> > longer
>> >>> > > jobs
>> >>> > > > (1 hour
>> >>> > > > > for
>> >>> > > > > >> TourDeFlexMigration). And again,
>> the
>> >>> machine
>> >>> > will be
>> >>> > > idle for
>> >>> > > > > stretches of
>> >>> > > > > >> time while the RM verifies
>> artifacts
>> >>> after each
>> >>> > step.
>> >>> > > > > >> >
>> >>> > > > > >> > -Alex
>> >>> > > > > >> >
>> >>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>> >>> > harbs.lists@gmail.com<ma...@gmail.com>
>> >>> > > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>>> wrote:
>> >>> > > > > >> >
>> >>> > > > > >> > Fair enough.
>> >>> > > > > >> >
>> >>> > > > > >> > I expect builds to be
>> somewhere
>> >>> between 10
>> >>> > and 20
>> >>> > > times
>> >>> > > > faster
>> >>> > > > > on a
>> >>> > > > > >> powerful machine.
>> >>> > > > > >> >
>> >>> > > > > >> > Yeah. It’s probably going to
>> be a
>> >>> bit of work
>> >>> > > changing
>> >>> > > > the
>> >>> > > > > server,
>> >>> > > > > >> but probably worth it in the long
>> run.
>> >>> > > > > >> >
>> >>> > > > > >> > I think I’ll try this when I
>> do the
>> >>> next
>> >>> > release
>> >>> > > unless
>> >>> > > > Yishay
>> >>> > > > > wants
>> >>> > > > > >> to work with me on this for this
>> release
>> >>> — but
>> >>> > I’m not
>> >>> > > going
>> >>> > > > to be
>> >>> > > > > able to
>> >>> > > > > >> help until after Passover (i.e.
>> next
>> >>> week).
>> >>> > > > > >> >
>> >>> > > > > >> > Thanks,
>> >>> > > > > >> > Harbs
>> >>> > > > > >> >
>> >>> > > > > >> >> On Apr 12, 2020, at 9:22 PM,
>> Alex Harui
>> >>> > > > <aharui@adobe.com.INVALID
>> >>> > > > > >
>> >>> > > > > >> wrote:
>> >>> > > > > >> >>
>> >>> > > > > >> >> The Azure portal says: Standard
>> F2s_v2
>> >>> (2
>> >>> > vcpus, 4
>> >>> > > GiB
>> >>> > > > memory)
>> >>> > > > > >> >>
>> >>> > > > > >> >> I think I am reading changes to
>> the
>> >>> build
>> >>> > process in
>> >>> > > your
>> >>> > > > > >> suggestions. I do not really want
>> to
>> >>> spend more
>> >>> > of my
>> >>> > > time
>> >>> > > > on this
>> >>> > > > > >> process. But if you want to do
>> the work,
>> >>> that's
>> >>> > fine
>> >>> > > with me.
>> >>> > > > > >> >>
>> >>> > > > > >> >> -Alex
>> >>> > > > > >> >>
>> >>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>> >>> > harbs.lists@gmail.com<ma...@gmail.com>
>> >>> > > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com
>> <mailto:
>> >>> > harbs.lists@gmail.com>
>> >>> > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>>>> wrote:
>> >>> > > > > >> >>
>> >>> > > > > >> >> What kind of horsepower is
>> included
>> >>> in the
>> >>> > free
>> >>> > > Azure
>> >>> > > > account?
>> >>> > > > > >> >>
>> >>> > > > > >> >> The server I mentioned builds
>> >>> (considerably)
>> >>> > > faster than
>> >>> > > > my own
>> >>> > > > > >> local machine. The ci server seems
>> to
>> >>> build many
>> >>> > times
>> >>> > > slower.
>> >>> > > > > >> >>
>> >>> > > > > >> >> One thing we can do to
>> minimize
>> >>> running
>> >>> > server time
>> >>> > > > would be to
>> >>> > > > > >> transfer the artifacts to storage
>> instead
>> >>> of
>> >>> > keeping
>> >>> > > them on
>> >>> > > > the
>> >>> > > > > server. On
>> >>> > > > > >> AWS, I’d probably use S3. Not sure
>> what
>> >>> the
>> >>> > similar
>> >>> > > service on
>> >>> > > > > Azure is
>> >>> > > > > >> called.
>> >>> > > > > >> >>
>> >>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM,
>> Alex
>> >>> Harui
>> >>> > > > > <aharui@adobe.com.INVALID
>> >>> > > > > >> <mailto:aharui@adobe.com.INVALID
>> <mailto:
>> >>> > aharui@adobe.com.INVALID>>> wrote:
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> OK, that's pretty much how I
>> >>> understand Azure
>> >>> > as
>> >>> > > well.
>> >>> > > > The key
>> >>> > > > > thing
>> >>> > > > > >> is that "running" includes time
>> where the
>> >>> CI
>> >>> > server is
>> >>> > > not
>> >>> > > > running
>> >>> > > > > any
>> >>> > > > > >> Jenkins jobs. The CI Server steps
>> might
>> >>> take
>> >>> > only a few
>> >>> > > > hours of
>> >>> > > > > actual
>> >>> > > > > >> server time, but there is time
>> where the
>> >>> RM is
>> >>> > verifying
>> >>> > > > artifacts
>> >>> > > > > locally
>> >>> > > > > >> so you'd be paying for that or the
>> RM
>> >>> would have
>> >>> > to keep
>> >>> > > > shutting
>> >>> > > > > down and
>> >>> > > > > >> restarting.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> Seems like it would be
>> >>> cheaper/simpler to get
>> >>> > the
>> >>> > > free
>> >>> > > > MSDN
>> >>> > > > > account
>> >>> > > > > >> and leave it running.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> -Alex
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>> >>> > > harbs.lists@gmail.com<ma...@gmail.com>
>> >>> > > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>>> wrote:
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> My experience is with AWS.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> I assume Microsoft has similar
>> >>> offerings,
>> >>> > but I
>> >>> > > don’t
>> >>> > > > have
>> >>> > > > > >> experience with Azure.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> AWS has on-demand EC2
>> instances
>> >>> which you
>> >>> > pay for
>> >>> > > only
>> >>> > > > the
>> >>> > > > > actual
>> >>> > > > > >> time that they are running.[1]
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> Instances can be started and
>> stopped
>> >>> via
>> >>> > command
>> >>> > > line
>> >>> > > > (or via
>> >>> > > > > the
>> >>> > > > > >> web interface) as long as you have
>> valid
>> >>> > credentials to
>> >>> > > do so.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> For example: an m5.4xlarge
>> instance
>> >>> has 16
>> >>> > cores
>> >>> > > and
>> >>> > > > costs
>> >>> > > > > about
>> >>> > > > > >> $1.5 per hour. On a machine like
>> that, a
>> >>> full
>> >>> > build
>> >>> > > would
>> >>> > > > probably
>> >>> > > > > take
>> >>> > > > > >> less than 10 minutes. It’s probably
>> >>> possible to
>> >>> > do a
>> >>> > > full
>> >>> > > > release
>> >>> > > > > with only
>> >>> > > > > >> a few hours of server time.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> Leaving a server like that
>> running
>> >>> all the
>> >>> > time
>> >>> > > would get
>> >>> > > > > expensive,
>> >>> > > > > >> but if it’s just spun up for
>> releases,
>> >>> you’d get
>> >>> > very
>> >>> > > fast
>> >>> > > > builds
>> >>> > > > > at a
>> >>> > > > > >> reasonable price.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> I’d be happy to pay $10-$50
>> (and
>> >>> possibly
>> >>> > more) per
>> >>> > > > release to
>> >>> > > > > make
>> >>> > > > > >> the release process painless for
>> the RM.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> [1]
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > >
>> >>> > > > > >> ><
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695421633&sdata=PFaVqrroAB5qQrR1obSPRIoIAT7H4U7d0EbxR2Rv11M%3D&reserved=0
>> >>> > >
>> >>> > > > > >> >><
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > >
>> >>> > > > > >> ><
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ca55fd899b7b247fcf6f308d7e4f468a0%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229610695431626&sdata=xlcYgRjDy%2FHeFmoHaFnelNn2zuN6VzTXSH4uz6vnbEk%3D&reserved=0
>> >>> > >
>> >>> > > > > >> >>>
>> >>> > > > > >> >>>
>> >>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM,
>> Alex
>> >>> Harui
>> >>> > > > > <ah...@adobe.com.INVALID>
>> >>> > > > > >> wrote:
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> I'm not very experienced with
>> >>> spinning up
>> >>> > > servers. The
>> >>> > > > CI
>> >>> > > > > server we
>> >>> > > > > >> are using is effectively free,
>> based on a
>> >>> generous
>> >>> > > donation
>> >>> > > > from
>> >>> > > > > Microsoft
>> >>> > > > > >> of MSDN accounts to ASF
>> committers. So I
>> >>> leave
>> >>> > it up
>> >>> > > 24/7,
>> >>> > > > and
>> >>> > > > > share the
>> >>> > > > > >> RDP access on private@. I think
>> any
>> >>> other ASF
>> >>> > > committer
>> >>> > > > could do
>> >>> > > > > the
>> >>> > > > > >> same. IIRC, if that server
>> actually is
>> >>> stopped,
>> >>> > I have
>> >>> > > to
>> >>> > > > use my
>> >>> > > > > personal
>> >>> > > > > >> (unshared) MSDN credentials to
>> start it
>> >>> again.
>> >>> > AIUI,
>> >>> > > if I
>> >>> > > > > actually paid
>> >>> > > > > >> for the server, it would cost me
>> to leave
>> >>> it
>> >>> > running
>> >>> > > even if
>> >>> > > > it
>> >>> > > > > didn't run
>> >>> > > > > >> jobs between releases.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> Is that what you are basically
>> >>> saying? I
>> >>> > think it
>> >>> > > might
>> >>> > > > be
>> >>> > > > > best if
>> >>> > > > > >> another committer got a CI server
>> going
>> >>> via the MS
>> >>> > > donation
>> >>> > > > and
>> >>> > > > > could leave
>> >>> > > > > >> it up 24/7.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> -Alex
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>> >>> > > > wrote:
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> I’m willing to do this.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> Considering that the release
>> will be
>> >>> run
>> >>> > > infrequently, it
>> >>> > > > > should be
>> >>> > > > > >> doable to have a relatively
>> powerful
>> >>> server that
>> >>> > could
>> >>> > > be
>> >>> > > > spun up on
>> >>> > > > > >> demand. This is something I have
>> setup
>> >>> for my own
>> >>> > > releases.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> The only complication would
>> be that
>> >>> each RM
>> >>> > would
>> >>> > > need
>> >>> > > > valid
>> >>> > > > > >> credentials to spin up the server.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> Harbs
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM,
>> Alex
>> >>> Harui
>> >>> > > > > <ah...@adobe.com.INVALID>
>> >>> > > > > >> wrote:
>> >>> > > > > >> >>>>>
>> >>> > > > > >> >>>>> A better solution, IMO, is
>> for
>> >>> someone else
>> >>> > to
>> >>> > > offer up
>> >>> > > > a CI
>> >>> > > > > server
>> >>> > > > > >> only for release jobs.
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > >
>> >>> > > >
>> >>> > > >
>> >>> > >
>> >>> > >
>> >>> > >
>> >>> >
>> >>> >
>> >>>
>> >>>
>> >>>
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
I am now getting this error on royale-typedefs build:
BUILD FAILEDc:\jenkins\workspace\royale-typedefs\build.xml:58: The
following error occurred while executing this line:
c:\jenkins\workspace\royale-typedefs\js\build.xml:91: src
'c:\jenkins\workspace\royale-typedefs\js\${ROYALE_TRANSPILER_HOME}\lib\google\closure-compiler\compiler.jar'
doesn't exist.
Where does the ROYALE_TRANSPILER_HOME var come from?
Here is the full console output:
http://apacheroyaleci2.westus2.cloudapp.azure.com:8080/view/Agent%202%20(Om's%20VM)/job/royale-typedefs/552/console
On Sun, Apr 19, 2020 at 11:24 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> Congratulations! But does that mean that JAVA_HOME is pointing at a JRE
>> instead of a JDK? If you have other issues that might be a factor.
>>
>
> Yeah, I messed up initially by getting the JRE instead of JDK. I have
> since corrected it. But for some reason Ant still thinks that JAVA_HOME is
> the jre directory.
> I don't know how to fix this, hence the hack :-|
>
>
>
>
>>
>> HTH,
>> -Alex
>>
>> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> I copied tools.jar from jdk/lib to the jre/lib. That seems to have
>> fixed
>> the issue.
>> We now have a successful build of the royale-compiler on the new Agent
>> machine!!
>>
>> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> wrote:
>>
>> > Restart dint help. Although Serkan's reply made me look at how Ant
>> was
>> > getting invoked.
>> >
>> > I see this warning that tools.jar is missing:
>> >
>> > [royale-compiler] $ cmd.exe /C
>> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
>> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
>> %%ERRORLEVEL%%"
>> >
>> > Unable to locate tools.jar. Expected to find it in C:\Program
>> Files\Java\jre1.8.0_251\lib\tools.jar
>> >
>> >
>> > I am pretty sure this is related to this issue.
>> >
>> >
>> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
>> bigosmallm@gmail.com>
>> > wrote:
>> >
>> >>
>> >>
>> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
>> <ah...@adobe.com.invalid>
>> >> wrote:
>> >>
>> >>> Did you reboot your VM? Also, have you checked what user is
>> running
>> >>> Jenkins on your VM? I think that can sometimes be a problem. I
>> might be
>> >>> running Jenkins as the user.
>> >>>
>> >>>
>> >> Agents don't require Jenkins to be running. I will give the
>> rebooting of
>> >> the VM a shot .
>> >>
>> >> Thanks,
>> >> Om
>> >>
>> >>
>> >>> -Alex
>> >>>
>> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
>> >
>> >>> wrote:
>> >>>
>> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
>> <ah...@adobe.com.invalid>
>> >>> wrote:
>> >>>
>> >>> > Should be here:
>> >>> >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200405113&sdata=RhBraBN5pQDVrqAbMoXKejWBTwyqtSwd7DURGcQSwUg%3D&reserved=0
>> >>>
>> >>>
>> >>> My git is located in the same exact location as master.
>> >>> Moreover, the git call from the commandline executes fine.
>> The git
>> >>> call
>> >>> from ant exec is what is failing.
>> >>>
>> >>>
>> >>>
>> >>> >
>> >>> >
>> >>> > HTH,
>> >>> > -Alex
>> >>> >
>> >>> > From: OmPrakash Muppirala <bi...@gmail.com>
>> >>> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
>> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> >>> > To: Apache Royale Development <de...@royale.apache.org>
>> >>> > Subject: Re: Prioritize Release Jobs on CI
>> >>> >
>> >>> > I'm a bit stumped here. The royale-compiler is failing
>> with this
>> >>> error:
>> >>> >
>> >>> >
>> >>> > BUILD FAILED
>> >>> >
>> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute
>> >>> failed:
>> >>> > java.io.IOException: Cannot run program "git" (in directory
>> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess
>> error=2,
>> >>> The system
>> >>> > cannot find the file specified
>> >>> >
>> >>> > at java.lang.ProcessBuilder.start(Unknown Source)
>> >>> >
>> >>> >
>> >>> > It is from this part of the jenkins.xml:
>> >>> >
>> >>> >
>> >>> > <target name="closure-lib-download" description="Copies
>> Closure
>> >>> > Library from GitHub">
>> >>> > <echo message="Be patient. This takes a few
>> minutes..." />
>> >>> > <exec executable="git" failifexecutionfails="true">
>> >>> > <arg value="clone" />
>> >>> > <arg value="
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200405113&sdata=AJO8lF1H7VG%2Fy9T1I9p0%2Fsqjh8cQ8U8exbInYHyuch0%3D&reserved=0
>> >>> <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=2%2BG3WpItozbraXCp2Q4XACBXizsHNZQYMAgiSaaPXwo%3D&reserved=0
>> >>> >"
>> >>> > />
>> >>> > <arg value="${closure.root}" />
>> >>> > </exec>
>> >>> > <echo>Cloned fresh copy of Google Closure
>> Library</echo>
>> >>> > </target>
>> >>> >
>> >>> > I am not sure how this executable call works without the
>> full path.
>> >>> >
>> >>> > I checked the env variables, I do have both the git/bin and
>> git/cmd
>> >>> > directory in the PATH:
>> >>> >
>> >>> > [cid:ii_k97zkk9o0]
>> >>> >
>> >>> > What am I missing?
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> >
>> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>> wrote:
>> >>> > Update - I have successfully attached my VM as a slave
>> agent of our
>> >>> > Jenkins instance.
>> >>> > I am going to pull the job - /royale-asjs_jsonly and tie it
>> to my
>> >>> agent so
>> >>> > I can test it.
>> >>> >
>> >>> > It will fail for a sometime while I go set up my VM with
>> all the
>> >>> > dependencies.
>> >>> >
>> >>> > Once we have the job successfully building on my VM, we can
>> figure
>> >>> out how
>> >>> > to divide the load between the master and agent.
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> >
>> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>> wrote:
>> >>> > We could achieve the same by creating a new agent (separate
>> vm) and
>> >>> > attaching it as a slave to the current Jenkins server.
>> >>> >
>> >>> > Then we can use labels/tags to tie release jobs to one
>> agent and
>> >>> non
>> >>> > release jobs to another agent.
>> >>> >
>> >>> > That way we can maintain everything in one UI, one login
>> while
>> >>> achieving
>> >>> > the concurrent building capabilities we want.
>> >>> >
>> >>> > Jenkins is built for this kind of stuff and I think it
>> would be
>> >>> best we
>> >>> > followed this practice.
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
>> <ah...@adobe.com.invalid>
>> >>> wrote:
>> >>> > Om, I thought you were going to get the image from my VM
>> and run
>> >>> it on
>> >>> > another VM. Then we'd remove all non-release jobs from
>> your VM
>> >>> and all of
>> >>> > the release jobs from my VM. That won't solve the problem
>> of how
>> >>> long it
>> >>> > takes for a commit to be built and tested, but will allow
>> the RM
>> >>> to get a
>> >>> > release out without getting stuck behind the commit jobs.
>> Is that
>> >>> > currently the plan?
>> >>> >
>> >>> > -Alex
>> >>> >
>> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com
>> >>> <mailto:
>> >>> > bigosmallm@gmail.com>> wrote:
>> >>> >
>> >>> > Makes sense to me. I will set parallel executors back
>> to 1.
>> >>> >
>> >>> > And start working on a new Jenkins instance.
>> >>> >
>> >>> > Thanks,
>> >>> > Om
>> >>> >
>> >>> >
>> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> >>> <ah...@adobe.com.invalid>
>> >>> > wrote:
>> >>> >
>> >>> > > Are you saying that Java, Ant and Maven do not know
>> how to
>> >>> > distribute work
>> >>> > > to different cores?
>> >>> > >
>> >>> > > To repeat my main concern: our Jenkins jobs often
>> use shared
>> >>> > resources.
>> >>> > > If you want to take the time to fix that, feel free,
>> but I
>> >>> do not
>> >>> > know how
>> >>> > > you are going to keep two jobs from both trying to
>> launch
>> >>> Flash
>> >>> > Player
>> >>> > > Debugger at the same time and open the same socket to
>> >>> communicate
>> >>> > with it,
>> >>> > > or try to parse the flashlog.txt that they have both
>> written
>> >>> to.
>> >>> > >
>> >>> > > The royale-asjs job will use the royale-compiler
>> workspace
>> >>> to get the
>> >>> > > compiler. If the compiler is building, the jars are
>> not
>> >>> there and
>> >>> > the
>> >>> > > royale-asjs build fails.
>> >>> > >
>> >>> > > There is also only so much memory and some of our
>> jobs use
>> >>> all of it
>> >>> > and
>> >>> > > I'm not sure if jobs slowed down due to paging memory
>> and
>> >>> > writing/reading
>> >>> > > from disk, even if it is an SSD.
>> >>> > >
>> >>> > > I'm done for tonight, but that's what I was seeing
>> last time
>> >>> I tried
>> >>> > to
>> >>> > > have both master and an agent running jobs in
>> parallel.
>> >>> > >
>> >>> > > Thanks,
>> >>> > > -Alex
>> >>> > >
>> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>> wrote:
>> >>> > >
>> >>> > > A typical setup would be to have 0 executors on
>> master
>> >>> and at
>> >>> > least n
>> >>> > > number of executors on each agent, where n =
>> number of
>> >>> cpu cores.
>> >>> > > I see that the current VM has 2 cores. So, I
>> started
>> >>> with
>> >>> > setting the
>> >>> > > num
>> >>> > > executors on the current agent to 2.
>> >>> > >
>> >>> > > This should improve things quite a bit. If this
>> doesn't
>> >>> work, I
>> >>> > will
>> >>> > > create a new VM and make it the slave agent of the
>> >>> current
>> >>> > Jenkins
>> >>> > > master.
>> >>> > >
>> >>> > >
>> >>> > > Thanks,
>> >>> > > Om
>> >>> > >
>> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>> >>> > <ah...@adobe.com.invalid>
>> >>> > > wrote:
>> >>> > >
>> >>> > > > On your VM or mine? I don't think mine can
>> handle
>> >>> it. I used
>> >>> > to
>> >>> > > run jobs
>> >>> > > > of master and agent and we got lots of failures
>> and
>> >>> jobs took
>> >>> > > forever. If
>> >>> > > > two jobs are trying to run tests with the
>> shared Flash
>> >>> Player
>> >>> > > Debugger, for
>> >>> > > > example, you won't get consistent results.
>> >>> > > >
>> >>> > > > -Alex
>> >>> > > >
>> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>> >>> > bigosmallm@gmail.com<ma...@gmail.com>>
>> >>> > > wrote:
>> >>> > > >
>> >>> > > > I just realized that we have only one Agent
>> (node)
>> >>> listed
>> >>> > under
>> >>> > > > Jenkins. I
>> >>> > > > am going to add at least one more node to
>> start
>> >>> with.
>> >>> > > >
>> >>> > > > Thanks,
>> >>> > > > Om
>> >>> > > >
>> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>> >>> > > <ah...@adobe.com.invalid>
>> >>> > > > wrote:
>> >>> > > >
>> >>> > > > > I think I followed the instructions and
>> enabled
>> >>> SSH.
>> >>> > > > >
>> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>> >>> > yishayjobs@hotmail.com<ma...@hotmail.com>>
>> >>> > > wrote:
>> >>> > > > >
>> >>> > > > > I haven’t gotten it to work. Could be
>> ssh
>> >>> needs to be
>> >>> > > enabled on
>> >>> > > > the
>> >>> > > > > VM [1]. This is nice to have but not
>> essential.
>> >>> So Alex,
>> >>> > let
>> >>> > > me know
>> >>> > > > if you
>> >>> > > > > want to try that, otherwise I’ll suspend
>> my
>> >>> efforts on
>> >>> > this.
>> >>> > > > >
>> >>> > > > > [1]
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=iTpXVF%2FutxSXTYw3soghKAmTu3Ysp5J75aOyIHJjxCo%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=iTpXVF%2FutxSXTYw3soghKAmTu3Ysp5J75aOyIHJjxCo%3D&reserved=0
>> >>> > >
>> >>> > > > >
>> >>> > > > > From: Yishay Weiss<mailto:
>> >>> yishayjobs@hotmail.com
>> >>> > <ma...@hotmail.com>>
>> >>> > > > > Sent: Wednesday, April 15, 2020 5:09
>> PM
>> >>> > > > > To: dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org>>
>> >>> > > > > Subject: RE: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > I’d like to try and install an ssh
>> server.
>> >>> Can anyone
>> >>> > > think of a
>> >>> > > > > reason not to do that? I’m asking in
>> terms of
>> >>> security,
>> >>> > and if
>> >>> > > there
>> >>> > > > might
>> >>> > > > > be a problem because it’s a VM.
>> >>> > > > >
>> >>> > > > > Thanks.
>> >>> > > > >
>> >>> > > > > From: Yishay Weiss<mailto:
>> >>> yishayjobs@hotmail.com
>> >>> > <ma...@hotmail.com>>
>> >>> > > > > Sent: Monday, April 13, 2020 10:02 AM
>> >>> > > > > To: dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org>>
>> >>> > > > > Subject: RE: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > Related, as most (all?) of the
>> instructions
>> >>> don’t
>> >>> > require
>> >>> > > > anything but
>> >>> > > > > a shell wouldn’t it be easier and faster
>> to
>> >>> access the
>> >>> > machine
>> >>> > > with
>> >>> > > > ssh
>> >>> > > > > [1], rather than using remote desktop?
>> >>> > > > >
>> >>> > > > > [1]
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=1aVR8ZhJ5a82g3v%2FNfYYUxX5fhVZqLkvKb%2BpFS0xeEg%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=1aVR8ZhJ5a82g3v%2FNfYYUxX5fhVZqLkvKb%2BpFS0xeEg%3D&reserved=0
>> >>> > >
>> >>> > > > >
>> >>> > > > > From: Yishay Weiss<mailto:
>> >>> yishayjobs@hotmail.com
>> >>> > <ma...@hotmail.com>>
>> >>> > > > > Sent: Monday, April 13, 2020 9:55 AM
>> >>> > > > > To: dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> >>> > dev@royale.apache.org>>
>> >>> > > > > Subject: RE: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > Can’t you do that with remote desktop?
>> >>> > > > >
>> >>> > > > > ________________________________
>> >>> > > > > From: OmPrakash Muppirala <
>> >>> bigosmallm@gmail.com
>> >>> > <ma...@gmail.com>>
>> >>> > > > > Sent: Monday, April 13, 2020 9:51:25
>> AM
>> >>> > > > > To: Apache Royale Development <
>> >>> dev@royale.apache.org
>> >>> > <ma...@royale.apache.org>>
>> >>> > > > > Subject: Re: Prioritize Release Jobs
>> on CI
>> >>> > > > >
>> >>> > > > > Alex,
>> >>> > > > >
>> >>> > > > > I believe this is your personal Azure
>> >>> subscription
>> >>> > right?
>> >>> > > Any
>> >>> > > > chance
>> >>> > > > > I can
>> >>> > > > > get access to it so I can try to copy
>> the
>> >>> image out
>> >>> > the
>> >>> > > machine
>> >>> > > > and
>> >>> > > > > redeploy it somewhere else?
>> >>> > > > >
>> >>> > > > > Thanks,
>> >>> > > > > Om
>> >>> > > > >
>> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM
>> OmPrakash
>> >>> Muppirala <
>> >>> > > > > bigosmallm@gmail.com<mailto:
>> bigosmallm@gmail.com
>> >>> >>
>> >>> > > > > wrote:
>> >>> > > > >
>> >>> > > > > > I can help set this up on Azure.
>> Give me
>> >>> some
>> >>> > time to
>> >>> > > work
>> >>> > > > out the
>> >>> > > > > > details?
>> >>> > > > > >
>> >>> > > > > > Thanks,
>> >>> > > > > > Om
>> >>> > > > > >
>> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM
>> Harbs <
>> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>> >>> > > > wrote:
>> >>> > > > > >
>> >>> > > > > >> OK. Good to know.
>> >>> > > > > >>
>> >>> > > > > >> > On Apr 12, 2020, at 9:45 PM,
>> Alex Harui
>> >>> > > > <aharui@adobe.com.INVALID
>> >>> > > > > >
>> >>> > > > > >> wrote:
>> >>> > > > > >> >
>> >>> > > > > >> > FWIW, I just looked and the
>> longest job
>> >>> in the
>> >>> > release
>> >>> > > > steps so
>> >>> > > > > far is
>> >>> > > > > >> 8 minutes. Most are under 2
>> minutes.
>> >>> There
>> >>> > might be
>> >>> > > jobs
>> >>> > > > later
>> >>> > > > > that take
>> >>> > > > > >> longer that we haven't run yet.
>> IMO, the
>> >>> issue
>> >>> > isn't
>> >>> > > speed
>> >>> > > > of the
>> >>> > > > > machine,
>> >>> > > > > >> it is just that we are sharing the
>> >>> machine with
>> >>> > longer
>> >>> > > jobs
>> >>> > > > (1 hour
>> >>> > > > > for
>> >>> > > > > >> TourDeFlexMigration). And again,
>> the
>> >>> machine
>> >>> > will be
>> >>> > > idle for
>> >>> > > > > stretches of
>> >>> > > > > >> time while the RM verifies
>> artifacts
>> >>> after each
>> >>> > step.
>> >>> > > > > >> >
>> >>> > > > > >> > -Alex
>> >>> > > > > >> >
>> >>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>> >>> > harbs.lists@gmail.com<ma...@gmail.com>
>> >>> > > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>>> wrote:
>> >>> > > > > >> >
>> >>> > > > > >> > Fair enough.
>> >>> > > > > >> >
>> >>> > > > > >> > I expect builds to be
>> somewhere
>> >>> between 10
>> >>> > and 20
>> >>> > > times
>> >>> > > > faster
>> >>> > > > > on a
>> >>> > > > > >> powerful machine.
>> >>> > > > > >> >
>> >>> > > > > >> > Yeah. It’s probably going to
>> be a
>> >>> bit of work
>> >>> > > changing
>> >>> > > > the
>> >>> > > > > server,
>> >>> > > > > >> but probably worth it in the long
>> run.
>> >>> > > > > >> >
>> >>> > > > > >> > I think I’ll try this when I
>> do the
>> >>> next
>> >>> > release
>> >>> > > unless
>> >>> > > > Yishay
>> >>> > > > > wants
>> >>> > > > > >> to work with me on this for this
>> release
>> >>> — but
>> >>> > I’m not
>> >>> > > going
>> >>> > > > to be
>> >>> > > > > able to
>> >>> > > > > >> help until after Passover (i.e.
>> next
>> >>> week).
>> >>> > > > > >> >
>> >>> > > > > >> > Thanks,
>> >>> > > > > >> > Harbs
>> >>> > > > > >> >
>> >>> > > > > >> >> On Apr 12, 2020, at 9:22 PM,
>> Alex Harui
>> >>> > > > <aharui@adobe.com.INVALID
>> >>> > > > > >
>> >>> > > > > >> wrote:
>> >>> > > > > >> >>
>> >>> > > > > >> >> The Azure portal says: Standard
>> F2s_v2
>> >>> (2
>> >>> > vcpus, 4
>> >>> > > GiB
>> >>> > > > memory)
>> >>> > > > > >> >>
>> >>> > > > > >> >> I think I am reading changes to
>> the
>> >>> build
>> >>> > process in
>> >>> > > your
>> >>> > > > > >> suggestions. I do not really want
>> to
>> >>> spend more
>> >>> > of my
>> >>> > > time
>> >>> > > > on this
>> >>> > > > > >> process. But if you want to do
>> the work,
>> >>> that's
>> >>> > fine
>> >>> > > with me.
>> >>> > > > > >> >>
>> >>> > > > > >> >> -Alex
>> >>> > > > > >> >>
>> >>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>> >>> > harbs.lists@gmail.com<ma...@gmail.com>
>> >>> > > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com
>> <mailto:
>> >>> > harbs.lists@gmail.com>
>> >>> > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>>>> wrote:
>> >>> > > > > >> >>
>> >>> > > > > >> >> What kind of horsepower is
>> included
>> >>> in the
>> >>> > free
>> >>> > > Azure
>> >>> > > > account?
>> >>> > > > > >> >>
>> >>> > > > > >> >> The server I mentioned builds
>> >>> (considerably)
>> >>> > > faster than
>> >>> > > > my own
>> >>> > > > > >> local machine. The ci server seems
>> to
>> >>> build many
>> >>> > times
>> >>> > > slower.
>> >>> > > > > >> >>
>> >>> > > > > >> >> One thing we can do to
>> minimize
>> >>> running
>> >>> > server time
>> >>> > > > would be to
>> >>> > > > > >> transfer the artifacts to storage
>> instead
>> >>> of
>> >>> > keeping
>> >>> > > them on
>> >>> > > > the
>> >>> > > > > server. On
>> >>> > > > > >> AWS, I’d probably use S3. Not sure
>> what
>> >>> the
>> >>> > similar
>> >>> > > service on
>> >>> > > > > Azure is
>> >>> > > > > >> called.
>> >>> > > > > >> >>
>> >>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM,
>> Alex
>> >>> Harui
>> >>> > > > > <aharui@adobe.com.INVALID
>> >>> > > > > >> <mailto:aharui@adobe.com.INVALID
>> <mailto:
>> >>> > aharui@adobe.com.INVALID>>> wrote:
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> OK, that's pretty much how I
>> >>> understand Azure
>> >>> > as
>> >>> > > well.
>> >>> > > > The key
>> >>> > > > > thing
>> >>> > > > > >> is that "running" includes time
>> where the
>> >>> CI
>> >>> > server is
>> >>> > > not
>> >>> > > > running
>> >>> > > > > any
>> >>> > > > > >> Jenkins jobs. The CI Server steps
>> might
>> >>> take
>> >>> > only a few
>> >>> > > > hours of
>> >>> > > > > actual
>> >>> > > > > >> server time, but there is time
>> where the
>> >>> RM is
>> >>> > verifying
>> >>> > > > artifacts
>> >>> > > > > locally
>> >>> > > > > >> so you'd be paying for that or the
>> RM
>> >>> would have
>> >>> > to keep
>> >>> > > > shutting
>> >>> > > > > down and
>> >>> > > > > >> restarting.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> Seems like it would be
>> >>> cheaper/simpler to get
>> >>> > the
>> >>> > > free
>> >>> > > > MSDN
>> >>> > > > > account
>> >>> > > > > >> and leave it running.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> -Alex
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>> >>> > > harbs.lists@gmail.com<ma...@gmail.com>
>> >>> > > > <mailto:
>> >>> > > > > >> harbs.lists@gmail.com<mailto:
>> >>> > harbs.lists@gmail.com>>> wrote:
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> My experience is with AWS.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> I assume Microsoft has similar
>> >>> offerings,
>> >>> > but I
>> >>> > > don’t
>> >>> > > > have
>> >>> > > > > >> experience with Azure.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> AWS has on-demand EC2
>> instances
>> >>> which you
>> >>> > pay for
>> >>> > > only
>> >>> > > > the
>> >>> > > > > actual
>> >>> > > > > >> time that they are running.[1]
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> Instances can be started and
>> stopped
>> >>> via
>> >>> > command
>> >>> > > line
>> >>> > > > (or via
>> >>> > > > > the
>> >>> > > > > >> web interface) as long as you have
>> valid
>> >>> > credentials to
>> >>> > > do so.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> For example: an m5.4xlarge
>> instance
>> >>> has 16
>> >>> > cores
>> >>> > > and
>> >>> > > > costs
>> >>> > > > > about
>> >>> > > > > >> $1.5 per hour. On a machine like
>> that, a
>> >>> full
>> >>> > build
>> >>> > > would
>> >>> > > > probably
>> >>> > > > > take
>> >>> > > > > >> less than 10 minutes. It’s probably
>> >>> possible to
>> >>> > do a
>> >>> > > full
>> >>> > > > release
>> >>> > > > > with only
>> >>> > > > > >> a few hours of server time.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> Leaving a server like that
>> running
>> >>> all the
>> >>> > time
>> >>> > > would get
>> >>> > > > > expensive,
>> >>> > > > > >> but if it’s just spun up for
>> releases,
>> >>> you’d get
>> >>> > very
>> >>> > > fast
>> >>> > > > builds
>> >>> > > > > at a
>> >>> > > > > >> reasonable price.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> I’d be happy to pay $10-$50
>> (and
>> >>> possibly
>> >>> > more) per
>> >>> > > > release to
>> >>> > > > > make
>> >>> > > > > >> the release process painless for
>> the RM.
>> >>> > > > > >> >>>
>> >>> > > > > >> >>> [1]
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
>> >>> > >
>> >>> > > > > >> ><
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > >
>> >>> > > > > >> >><
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > >
>> >>> > > > > >> ><
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
>> >>> > >
>> >>> > > > > >> <
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200435096&sdata=3udZW1XC05li0TnS4FzrmnHmtJ0H7S1Mz%2FF%2FhAYinXk%3D&reserved=0
>> >>> > <
>> >>> >
>> >>>
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200435096&sdata=3udZW1XC05li0TnS4FzrmnHmtJ0H7S1Mz%2FF%2FhAYinXk%3D&reserved=0
>> >>> > >
>> >>> > > > > >> >>>
>> >>> > > > > >> >>>
>> >>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM,
>> Alex
>> >>> Harui
>> >>> > > > > <ah...@adobe.com.INVALID>
>> >>> > > > > >> wrote:
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> I'm not very experienced with
>> >>> spinning up
>> >>> > > servers. The
>> >>> > > > CI
>> >>> > > > > server we
>> >>> > > > > >> are using is effectively free,
>> based on a
>> >>> generous
>> >>> > > donation
>> >>> > > > from
>> >>> > > > > Microsoft
>> >>> > > > > >> of MSDN accounts to ASF
>> committers. So I
>> >>> leave
>> >>> > it up
>> >>> > > 24/7,
>> >>> > > > and
>> >>> > > > > share the
>> >>> > > > > >> RDP access on private@. I think
>> any
>> >>> other ASF
>> >>> > > committer
>> >>> > > > could do
>> >>> > > > > the
>> >>> > > > > >> same. IIRC, if that server
>> actually is
>> >>> stopped,
>> >>> > I have
>> >>> > > to
>> >>> > > > use my
>> >>> > > > > personal
>> >>> > > > > >> (unshared) MSDN credentials to
>> start it
>> >>> again.
>> >>> > AIUI,
>> >>> > > if I
>> >>> > > > > actually paid
>> >>> > > > > >> for the server, it would cost me
>> to leave
>> >>> it
>> >>> > running
>> >>> > > even if
>> >>> > > > it
>> >>> > > > > didn't run
>> >>> > > > > >> jobs between releases.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> Is that what you are basically
>> >>> saying? I
>> >>> > think it
>> >>> > > might
>> >>> > > > be
>> >>> > > > > best if
>> >>> > > > > >> another committer got a CI server
>> going
>> >>> via the MS
>> >>> > > donation
>> >>> > > > and
>> >>> > > > > could leave
>> >>> > > > > >> it up 24/7.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> -Alex
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>> >>> > > > wrote:
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> I’m willing to do this.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> Considering that the release
>> will be
>> >>> run
>> >>> > > infrequently, it
>> >>> > > > > should be
>> >>> > > > > >> doable to have a relatively
>> powerful
>> >>> server that
>> >>> > could
>> >>> > > be
>> >>> > > > spun up on
>> >>> > > > > >> demand. This is something I have
>> setup
>> >>> for my own
>> >>> > > releases.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> The only complication would
>> be that
>> >>> each RM
>> >>> > would
>> >>> > > need
>> >>> > > > valid
>> >>> > > > > >> credentials to spin up the server.
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>> Harbs
>> >>> > > > > >> >>>>
>> >>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM,
>> Alex
>> >>> Harui
>> >>> > > > > <ah...@adobe.com.INVALID>
>> >>> > > > > >> wrote:
>> >>> > > > > >> >>>>>
>> >>> > > > > >> >>>>> A better solution, IMO, is
>> for
>> >>> someone else
>> >>> > to
>> >>> > > offer up
>> >>> > > > a CI
>> >>> > > > > server
>> >>> > > > > >> only for release jobs.
>> >>> > > > > >>
>> >>> > > > > >>
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > > >
>> >>> > > >
>> >>> > > >
>> >>> > > >
>> >>> > >
>> >>> > >
>> >>> > >
>> >>> >
>> >>> >
>> >>>
>> >>>
>> >>>
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Sun, Apr 19, 2020 at 11:08 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Congratulations! But does that mean that JAVA_HOME is pointing at a JRE
> instead of a JDK? If you have other issues that might be a factor.
>
Yeah, I messed up initially by getting the JRE instead of JDK. I have
since corrected it. But for some reason Ant still thinks that JAVA_HOME is
the jre directory.
I don't know how to fix this, hence the hack :-|
>
> HTH,
> -Alex
>
> On 4/19/20, 10:50 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> I copied tools.jar from jdk/lib to the jre/lib. That seems to have
> fixed
> the issue.
> We now have a successful build of the royale-compiler on the new Agent
> machine!!
>
> On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > Restart dint help. Although Serkan's reply made me look at how Ant
> was
> > getting invoked.
> >
> > I see this warning that tools.jar is missing:
> >
> > [royale-compiler] $ cmd.exe /C
> "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml
> -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit
> %%ERRORLEVEL%%"
> >
> > Unable to locate tools.jar. Expected to find it in C:\Program
> Files\Java\jre1.8.0_251\lib\tools.jar
> >
> >
> > I am pretty sure this is related to this issue.
> >
> >
> > On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> > wrote:
> >
> >>
> >>
> >> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui
> <ah...@adobe.com.invalid>
> >> wrote:
> >>
> >>> Did you reboot your VM? Also, have you checked what user is
> running
> >>> Jenkins on your VM? I think that can sometimes be a problem. I
> might be
> >>> running Jenkins as the user.
> >>>
> >>>
> >> Agents don't require Jenkins to be running. I will give the
> rebooting of
> >> the VM a shot .
> >>
> >> Thanks,
> >> Om
> >>
> >>
> >>> -Alex
> >>>
> >>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> >>> wrote:
> >>>
> >>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui
> <ah...@adobe.com.invalid>
> >>> wrote:
> >>>
> >>> > Should be here:
> >>> >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200405113&sdata=RhBraBN5pQDVrqAbMoXKejWBTwyqtSwd7DURGcQSwUg%3D&reserved=0
> >>>
> >>>
> >>> My git is located in the same exact location as master.
> >>> Moreover, the git call from the commandline executes fine.
> The git
> >>> call
> >>> from ant exec is what is failing.
> >>>
> >>>
> >>>
> >>> >
> >>> >
> >>> > HTH,
> >>> > -Alex
> >>> >
> >>> > From: OmPrakash Muppirala <bi...@gmail.com>
> >>> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
> >>> > Date: Sunday, April 19, 2020 at 9:37 PM
> >>> > To: Apache Royale Development <de...@royale.apache.org>
> >>> > Subject: Re: Prioritize Release Jobs on CI
> >>> >
> >>> > I'm a bit stumped here. The royale-compiler is failing with
> this
> >>> error:
> >>> >
> >>> >
> >>> > BUILD FAILED
> >>> >
> >>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute
> >>> failed:
> >>> > java.io.IOException: Cannot run program "git" (in directory
> >>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess
> error=2,
> >>> The system
> >>> > cannot find the file specified
> >>> >
> >>> > at java.lang.ProcessBuilder.start(Unknown Source)
> >>> >
> >>> >
> >>> > It is from this part of the jenkins.xml:
> >>> >
> >>> >
> >>> > <target name="closure-lib-download" description="Copies
> Closure
> >>> > Library from GitHub">
> >>> > <echo message="Be patient. This takes a few
> minutes..." />
> >>> > <exec executable="git" failifexecutionfails="true">
> >>> > <arg value="clone" />
> >>> > <arg value="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200405113&sdata=AJO8lF1H7VG%2Fy9T1I9p0%2Fsqjh8cQ8U8exbInYHyuch0%3D&reserved=0
> >>> <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=2%2BG3WpItozbraXCp2Q4XACBXizsHNZQYMAgiSaaPXwo%3D&reserved=0
> >>> >"
> >>> > />
> >>> > <arg value="${closure.root}" />
> >>> > </exec>
> >>> > <echo>Cloned fresh copy of Google Closure
> Library</echo>
> >>> > </target>
> >>> >
> >>> > I am not sure how this executable call works without the
> full path.
> >>> >
> >>> > I checked the env variables, I do have both the git/bin and
> git/cmd
> >>> > directory in the PATH:
> >>> >
> >>> > [cid:ii_k97zkk9o0]
> >>> >
> >>> > What am I missing?
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> >
> >>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>> wrote:
> >>> > Update - I have successfully attached my VM as a slave agent
> of our
> >>> > Jenkins instance.
> >>> > I am going to pull the job - /royale-asjs_jsonly and tie it
> to my
> >>> agent so
> >>> > I can test it.
> >>> >
> >>> > It will fail for a sometime while I go set up my VM with all
> the
> >>> > dependencies.
> >>> >
> >>> > Once we have the job successfully building on my VM, we can
> figure
> >>> out how
> >>> > to divide the load between the master and agent.
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> >
> >>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>> wrote:
> >>> > We could achieve the same by creating a new agent (separate
> vm) and
> >>> > attaching it as a slave to the current Jenkins server.
> >>> >
> >>> > Then we can use labels/tags to tie release jobs to one agent
> and
> >>> non
> >>> > release jobs to another agent.
> >>> >
> >>> > That way we can maintain everything in one UI, one login
> while
> >>> achieving
> >>> > the concurrent building capabilities we want.
> >>> >
> >>> > Jenkins is built for this kind of stuff and I think it would
> be
> >>> best we
> >>> > followed this practice.
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui
> <ah...@adobe.com.invalid>
> >>> wrote:
> >>> > Om, I thought you were going to get the image from my VM and
> run
> >>> it on
> >>> > another VM. Then we'd remove all non-release jobs from your
> VM
> >>> and all of
> >>> > the release jobs from my VM. That won't solve the problem
> of how
> >>> long it
> >>> > takes for a commit to be built and tested, but will allow
> the RM
> >>> to get a
> >>> > release out without getting stuck behind the commit jobs.
> Is that
> >>> > currently the plan?
> >>> >
> >>> > -Alex
> >>> >
> >>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com
> >>> <mailto:
> >>> > bigosmallm@gmail.com>> wrote:
> >>> >
> >>> > Makes sense to me. I will set parallel executors back
> to 1.
> >>> >
> >>> > And start working on a new Jenkins instance.
> >>> >
> >>> > Thanks,
> >>> > Om
> >>> >
> >>> >
> >>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> >>> <ah...@adobe.com.invalid>
> >>> > wrote:
> >>> >
> >>> > > Are you saying that Java, Ant and Maven do not know
> how to
> >>> > distribute work
> >>> > > to different cores?
> >>> > >
> >>> > > To repeat my main concern: our Jenkins jobs often use
> shared
> >>> > resources.
> >>> > > If you want to take the time to fix that, feel free,
> but I
> >>> do not
> >>> > know how
> >>> > > you are going to keep two jobs from both trying to
> launch
> >>> Flash
> >>> > Player
> >>> > > Debugger at the same time and open the same socket to
> >>> communicate
> >>> > with it,
> >>> > > or try to parse the flashlog.txt that they have both
> written
> >>> to.
> >>> > >
> >>> > > The royale-asjs job will use the royale-compiler
> workspace
> >>> to get the
> >>> > > compiler. If the compiler is building, the jars are
> not
> >>> there and
> >>> > the
> >>> > > royale-asjs build fails.
> >>> > >
> >>> > > There is also only so much memory and some of our jobs
> use
> >>> all of it
> >>> > and
> >>> > > I'm not sure if jobs slowed down due to paging memory
> and
> >>> > writing/reading
> >>> > > from disk, even if it is an SSD.
> >>> > >
> >>> > > I'm done for tonight, but that's what I was seeing
> last time
> >>> I tried
> >>> > to
> >>> > > have both master and an agent running jobs in parallel.
> >>> > >
> >>> > > Thanks,
> >>> > > -Alex
> >>> > >
> >>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>> wrote:
> >>> > >
> >>> > > A typical setup would be to have 0 executors on
> master
> >>> and at
> >>> > least n
> >>> > > number of executors on each agent, where n =
> number of
> >>> cpu cores.
> >>> > > I see that the current VM has 2 cores. So, I
> started
> >>> with
> >>> > setting the
> >>> > > num
> >>> > > executors on the current agent to 2.
> >>> > >
> >>> > > This should improve things quite a bit. If this
> doesn't
> >>> work, I
> >>> > will
> >>> > > create a new VM and make it the slave agent of the
> >>> current
> >>> > Jenkins
> >>> > > master.
> >>> > >
> >>> > >
> >>> > > Thanks,
> >>> > > Om
> >>> > >
> >>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> >>> > <ah...@adobe.com.invalid>
> >>> > > wrote:
> >>> > >
> >>> > > > On your VM or mine? I don't think mine can
> handle
> >>> it. I used
> >>> > to
> >>> > > run jobs
> >>> > > > of master and agent and we got lots of failures
> and
> >>> jobs took
> >>> > > forever. If
> >>> > > > two jobs are trying to run tests with the shared
> Flash
> >>> Player
> >>> > > Debugger, for
> >>> > > > example, you won't get consistent results.
> >>> > > >
> >>> > > > -Alex
> >>> > > >
> >>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
> >>> > bigosmallm@gmail.com<ma...@gmail.com>>
> >>> > > wrote:
> >>> > > >
> >>> > > > I just realized that we have only one Agent
> (node)
> >>> listed
> >>> > under
> >>> > > > Jenkins. I
> >>> > > > am going to add at least one more node to
> start
> >>> with.
> >>> > > >
> >>> > > > Thanks,
> >>> > > > Om
> >>> > > >
> >>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> >>> > > <ah...@adobe.com.invalid>
> >>> > > > wrote:
> >>> > > >
> >>> > > > > I think I followed the instructions and
> enabled
> >>> SSH.
> >>> > > > >
> >>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
> >>> > yishayjobs@hotmail.com<ma...@hotmail.com>>
> >>> > > wrote:
> >>> > > > >
> >>> > > > > I haven’t gotten it to work. Could be
> ssh
> >>> needs to be
> >>> > > enabled on
> >>> > > > the
> >>> > > > > VM [1]. This is nice to have but not
> essential.
> >>> So Alex,
> >>> > let
> >>> > > me know
> >>> > > > if you
> >>> > > > > want to try that, otherwise I’ll suspend my
> >>> efforts on
> >>> > this.
> >>> > > > >
> >>> > > > > [1]
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=iTpXVF%2FutxSXTYw3soghKAmTu3Ysp5J75aOyIHJjxCo%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=iTpXVF%2FutxSXTYw3soghKAmTu3Ysp5J75aOyIHJjxCo%3D&reserved=0
> >>> > >
> >>> > > > >
> >>> > > > > From: Yishay Weiss<mailto:
> >>> yishayjobs@hotmail.com
> >>> > <ma...@hotmail.com>>
> >>> > > > > Sent: Wednesday, April 15, 2020 5:09 PM
> >>> > > > > To: dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org>>
> >>> > > > > Subject: RE: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > I’d like to try and install an ssh
> server.
> >>> Can anyone
> >>> > > think of a
> >>> > > > > reason not to do that? I’m asking in terms
> of
> >>> security,
> >>> > and if
> >>> > > there
> >>> > > > might
> >>> > > > > be a problem because it’s a VM.
> >>> > > > >
> >>> > > > > Thanks.
> >>> > > > >
> >>> > > > > From: Yishay Weiss<mailto:
> >>> yishayjobs@hotmail.com
> >>> > <ma...@hotmail.com>>
> >>> > > > > Sent: Monday, April 13, 2020 10:02 AM
> >>> > > > > To: dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org>>
> >>> > > > > Subject: RE: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > Related, as most (all?) of the
> instructions
> >>> don’t
> >>> > require
> >>> > > > anything but
> >>> > > > > a shell wouldn’t it be easier and faster to
> >>> access the
> >>> > machine
> >>> > > with
> >>> > > > ssh
> >>> > > > > [1], rather than using remote desktop?
> >>> > > > >
> >>> > > > > [1]
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=1aVR8ZhJ5a82g3v%2FNfYYUxX5fhVZqLkvKb%2BpFS0xeEg%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=1aVR8ZhJ5a82g3v%2FNfYYUxX5fhVZqLkvKb%2BpFS0xeEg%3D&reserved=0
> >>> > >
> >>> > > > >
> >>> > > > > From: Yishay Weiss<mailto:
> >>> yishayjobs@hotmail.com
> >>> > <ma...@hotmail.com>>
> >>> > > > > Sent: Monday, April 13, 2020 9:55 AM
> >>> > > > > To: dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> >>> > dev@royale.apache.org>>
> >>> > > > > Subject: RE: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > Can’t you do that with remote desktop?
> >>> > > > >
> >>> > > > > ________________________________
> >>> > > > > From: OmPrakash Muppirala <
> >>> bigosmallm@gmail.com
> >>> > <ma...@gmail.com>>
> >>> > > > > Sent: Monday, April 13, 2020 9:51:25 AM
> >>> > > > > To: Apache Royale Development <
> >>> dev@royale.apache.org
> >>> > <ma...@royale.apache.org>>
> >>> > > > > Subject: Re: Prioritize Release Jobs
> on CI
> >>> > > > >
> >>> > > > > Alex,
> >>> > > > >
> >>> > > > > I believe this is your personal Azure
> >>> subscription
> >>> > right?
> >>> > > Any
> >>> > > > chance
> >>> > > > > I can
> >>> > > > > get access to it so I can try to copy
> the
> >>> image out
> >>> > the
> >>> > > machine
> >>> > > > and
> >>> > > > > redeploy it somewhere else?
> >>> > > > >
> >>> > > > > Thanks,
> >>> > > > > Om
> >>> > > > >
> >>> > > > > On Sun, Apr 12, 2020 at 6:18 PM
> OmPrakash
> >>> Muppirala <
> >>> > > > > bigosmallm@gmail.com<mailto:
> bigosmallm@gmail.com
> >>> >>
> >>> > > > > wrote:
> >>> > > > >
> >>> > > > > > I can help set this up on Azure.
> Give me
> >>> some
> >>> > time to
> >>> > > work
> >>> > > > out the
> >>> > > > > > details?
> >>> > > > > >
> >>> > > > > > Thanks,
> >>> > > > > > Om
> >>> > > > > >
> >>> > > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs
> <
> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
> >>> > > > wrote:
> >>> > > > > >
> >>> > > > > >> OK. Good to know.
> >>> > > > > >>
> >>> > > > > >> > On Apr 12, 2020, at 9:45 PM, Alex
> Harui
> >>> > > > <aharui@adobe.com.INVALID
> >>> > > > > >
> >>> > > > > >> wrote:
> >>> > > > > >> >
> >>> > > > > >> > FWIW, I just looked and the
> longest job
> >>> in the
> >>> > release
> >>> > > > steps so
> >>> > > > > far is
> >>> > > > > >> 8 minutes. Most are under 2
> minutes.
> >>> There
> >>> > might be
> >>> > > jobs
> >>> > > > later
> >>> > > > > that take
> >>> > > > > >> longer that we haven't run yet.
> IMO, the
> >>> issue
> >>> > isn't
> >>> > > speed
> >>> > > > of the
> >>> > > > > machine,
> >>> > > > > >> it is just that we are sharing the
> >>> machine with
> >>> > longer
> >>> > > jobs
> >>> > > > (1 hour
> >>> > > > > for
> >>> > > > > >> TourDeFlexMigration). And again,
> the
> >>> machine
> >>> > will be
> >>> > > idle for
> >>> > > > > stretches of
> >>> > > > > >> time while the RM verifies artifacts
> >>> after each
> >>> > step.
> >>> > > > > >> >
> >>> > > > > >> > -Alex
> >>> > > > > >> >
> >>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >>> > > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>>> wrote:
> >>> > > > > >> >
> >>> > > > > >> > Fair enough.
> >>> > > > > >> >
> >>> > > > > >> > I expect builds to be somewhere
> >>> between 10
> >>> > and 20
> >>> > > times
> >>> > > > faster
> >>> > > > > on a
> >>> > > > > >> powerful machine.
> >>> > > > > >> >
> >>> > > > > >> > Yeah. It’s probably going to
> be a
> >>> bit of work
> >>> > > changing
> >>> > > > the
> >>> > > > > server,
> >>> > > > > >> but probably worth it in the long
> run.
> >>> > > > > >> >
> >>> > > > > >> > I think I’ll try this when I
> do the
> >>> next
> >>> > release
> >>> > > unless
> >>> > > > Yishay
> >>> > > > > wants
> >>> > > > > >> to work with me on this for this
> release
> >>> — but
> >>> > I’m not
> >>> > > going
> >>> > > > to be
> >>> > > > > able to
> >>> > > > > >> help until after Passover (i.e. next
> >>> week).
> >>> > > > > >> >
> >>> > > > > >> > Thanks,
> >>> > > > > >> > Harbs
> >>> > > > > >> >
> >>> > > > > >> >> On Apr 12, 2020, at 9:22 PM,
> Alex Harui
> >>> > > > <aharui@adobe.com.INVALID
> >>> > > > > >
> >>> > > > > >> wrote:
> >>> > > > > >> >>
> >>> > > > > >> >> The Azure portal says: Standard
> F2s_v2
> >>> (2
> >>> > vcpus, 4
> >>> > > GiB
> >>> > > > memory)
> >>> > > > > >> >>
> >>> > > > > >> >> I think I am reading changes to
> the
> >>> build
> >>> > process in
> >>> > > your
> >>> > > > > >> suggestions. I do not really want
> to
> >>> spend more
> >>> > of my
> >>> > > time
> >>> > > > on this
> >>> > > > > >> process. But if you want to do the
> work,
> >>> that's
> >>> > fine
> >>> > > with me.
> >>> > > > > >> >>
> >>> > > > > >> >> -Alex
> >>> > > > > >> >>
> >>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
> >>> > harbs.lists@gmail.com<ma...@gmail.com>
> >>> > > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com
> <mailto:
> >>> > harbs.lists@gmail.com>
> >>> > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>>>> wrote:
> >>> > > > > >> >>
> >>> > > > > >> >> What kind of horsepower is
> included
> >>> in the
> >>> > free
> >>> > > Azure
> >>> > > > account?
> >>> > > > > >> >>
> >>> > > > > >> >> The server I mentioned builds
> >>> (considerably)
> >>> > > faster than
> >>> > > > my own
> >>> > > > > >> local machine. The ci server seems
> to
> >>> build many
> >>> > times
> >>> > > slower.
> >>> > > > > >> >>
> >>> > > > > >> >> One thing we can do to minimize
> >>> running
> >>> > server time
> >>> > > > would be to
> >>> > > > > >> transfer the artifacts to storage
> instead
> >>> of
> >>> > keeping
> >>> > > them on
> >>> > > > the
> >>> > > > > server. On
> >>> > > > > >> AWS, I’d probably use S3. Not sure
> what
> >>> the
> >>> > similar
> >>> > > service on
> >>> > > > > Azure is
> >>> > > > > >> called.
> >>> > > > > >> >>
> >>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM,
> Alex
> >>> Harui
> >>> > > > > <aharui@adobe.com.INVALID
> >>> > > > > >> <mailto:aharui@adobe.com.INVALID
> <mailto:
> >>> > aharui@adobe.com.INVALID>>> wrote:
> >>> > > > > >> >>>
> >>> > > > > >> >>> OK, that's pretty much how I
> >>> understand Azure
> >>> > as
> >>> > > well.
> >>> > > > The key
> >>> > > > > thing
> >>> > > > > >> is that "running" includes time
> where the
> >>> CI
> >>> > server is
> >>> > > not
> >>> > > > running
> >>> > > > > any
> >>> > > > > >> Jenkins jobs. The CI Server steps
> might
> >>> take
> >>> > only a few
> >>> > > > hours of
> >>> > > > > actual
> >>> > > > > >> server time, but there is time
> where the
> >>> RM is
> >>> > verifying
> >>> > > > artifacts
> >>> > > > > locally
> >>> > > > > >> so you'd be paying for that or the
> RM
> >>> would have
> >>> > to keep
> >>> > > > shutting
> >>> > > > > down and
> >>> > > > > >> restarting.
> >>> > > > > >> >>>
> >>> > > > > >> >>> Seems like it would be
> >>> cheaper/simpler to get
> >>> > the
> >>> > > free
> >>> > > > MSDN
> >>> > > > > account
> >>> > > > > >> and leave it running.
> >>> > > > > >> >>>
> >>> > > > > >> >>> -Alex
> >>> > > > > >> >>>
> >>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> >>> > > harbs.lists@gmail.com<ma...@gmail.com>
> >>> > > > <mailto:
> >>> > > > > >> harbs.lists@gmail.com<mailto:
> >>> > harbs.lists@gmail.com>>> wrote:
> >>> > > > > >> >>>
> >>> > > > > >> >>> My experience is with AWS.
> >>> > > > > >> >>>
> >>> > > > > >> >>> I assume Microsoft has similar
> >>> offerings,
> >>> > but I
> >>> > > don’t
> >>> > > > have
> >>> > > > > >> experience with Azure.
> >>> > > > > >> >>>
> >>> > > > > >> >>> AWS has on-demand EC2 instances
> >>> which you
> >>> > pay for
> >>> > > only
> >>> > > > the
> >>> > > > > actual
> >>> > > > > >> time that they are running.[1]
> >>> > > > > >> >>>
> >>> > > > > >> >>> Instances can be started and
> stopped
> >>> via
> >>> > command
> >>> > > line
> >>> > > > (or via
> >>> > > > > the
> >>> > > > > >> web interface) as long as you have
> valid
> >>> > credentials to
> >>> > > do so.
> >>> > > > > >> >>>
> >>> > > > > >> >>> For example: an m5.4xlarge
> instance
> >>> has 16
> >>> > cores
> >>> > > and
> >>> > > > costs
> >>> > > > > about
> >>> > > > > >> $1.5 per hour. On a machine like
> that, a
> >>> full
> >>> > build
> >>> > > would
> >>> > > > probably
> >>> > > > > take
> >>> > > > > >> less than 10 minutes. It’s probably
> >>> possible to
> >>> > do a
> >>> > > full
> >>> > > > release
> >>> > > > > with only
> >>> > > > > >> a few hours of server time.
> >>> > > > > >> >>>
> >>> > > > > >> >>> Leaving a server like that
> running
> >>> all the
> >>> > time
> >>> > > would get
> >>> > > > > expensive,
> >>> > > > > >> but if it’s just spun up for
> releases,
> >>> you’d get
> >>> > very
> >>> > > fast
> >>> > > > builds
> >>> > > > > at a
> >>> > > > > >> reasonable price.
> >>> > > > > >> >>>
> >>> > > > > >> >>> I’d be happy to pay $10-$50
> (and
> >>> possibly
> >>> > more) per
> >>> > > > release to
> >>> > > > > make
> >>> > > > > >> the release process painless for
> the RM.
> >>> > > > > >> >>>
> >>> > > > > >> >>> [1]
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200415104&sdata=A23xroGBFlPRUqG9usq9MI0uNI8PwtYllOzWzH0nqiU%3D&reserved=0
> >>> > >
> >>> > > > > >> ><
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > >
> >>> > > > > >> >><
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > >
> >>> > > > > >> ><
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200425097&sdata=9AJSOb49kOzP%2B8CHTR6cfjctpmFWabeonhVE2hHdndc%3D&reserved=0
> >>> > >
> >>> > > > > >> <
> >>> > > > > >>
> >>> > > > >
> >>> > > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200435096&sdata=3udZW1XC05li0TnS4FzrmnHmtJ0H7S1Mz%2FF%2FhAYinXk%3D&reserved=0
> >>> > <
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cae66be53fa804cc3c74108d7e4eeb2a3%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229586200435096&sdata=3udZW1XC05li0TnS4FzrmnHmtJ0H7S1Mz%2FF%2FhAYinXk%3D&reserved=0
> >>> > >
> >>> > > > > >> >>>
> >>> > > > > >> >>>
> >>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM,
> Alex
> >>> Harui
> >>> > > > > <ah...@adobe.com.INVALID>
> >>> > > > > >> wrote:
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> I'm not very experienced with
> >>> spinning up
> >>> > > servers. The
> >>> > > > CI
> >>> > > > > server we
> >>> > > > > >> are using is effectively free,
> based on a
> >>> generous
> >>> > > donation
> >>> > > > from
> >>> > > > > Microsoft
> >>> > > > > >> of MSDN accounts to ASF
> committers. So I
> >>> leave
> >>> > it up
> >>> > > 24/7,
> >>> > > > and
> >>> > > > > share the
> >>> > > > > >> RDP access on private@. I think
> any
> >>> other ASF
> >>> > > committer
> >>> > > > could do
> >>> > > > > the
> >>> > > > > >> same. IIRC, if that server
> actually is
> >>> stopped,
> >>> > I have
> >>> > > to
> >>> > > > use my
> >>> > > > > personal
> >>> > > > > >> (unshared) MSDN credentials to
> start it
> >>> again.
> >>> > AIUI,
> >>> > > if I
> >>> > > > > actually paid
> >>> > > > > >> for the server, it would cost me to
> leave
> >>> it
> >>> > running
> >>> > > even if
> >>> > > > it
> >>> > > > > didn't run
> >>> > > > > >> jobs between releases.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> Is that what you are basically
> >>> saying? I
> >>> > think it
> >>> > > might
> >>> > > > be
> >>> > > > > best if
> >>> > > > > >> another committer got a CI server
> going
> >>> via the MS
> >>> > > donation
> >>> > > > and
> >>> > > > > could leave
> >>> > > > > >> it up 24/7.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> -Alex
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> >>> > > harbs.lists@gmail.com<ma...@gmail.com>>
> >>> > > > wrote:
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> I’m willing to do this.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> Considering that the release
> will be
> >>> run
> >>> > > infrequently, it
> >>> > > > > should be
> >>> > > > > >> doable to have a relatively powerful
> >>> server that
> >>> > could
> >>> > > be
> >>> > > > spun up on
> >>> > > > > >> demand. This is something I have
> setup
> >>> for my own
> >>> > > releases.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> The only complication would be
> that
> >>> each RM
> >>> > would
> >>> > > need
> >>> > > > valid
> >>> > > > > >> credentials to spin up the server.
> >>> > > > > >> >>>>
> >>> > > > > >> >>>> Harbs
> >>> > > > > >> >>>>
> >>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM,
> Alex
> >>> Harui
> >>> > > > > <ah...@adobe.com.INVALID>
> >>> > > > > >> wrote:
> >>> > > > > >> >>>>>
> >>> > > > > >> >>>>> A better solution, IMO, is for
> >>> someone else
> >>> > to
> >>> > > offer up
> >>> > > > a CI
> >>> > > > > server
> >>> > > > > >> only for release jobs.
> >>> > > > > >>
> >>> > > > > >>
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > >
> >>> > > >
> >>> > > >
> >>> > >
> >>> > >
> >>> > >
> >>> >
> >>> >
> >>>
> >>>
> >>>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
I copied tools.jar from jdk/lib to the jre/lib. That seems to have fixed
the issue.
We now have a successful build of the royale-compiler on the new Agent
machine!!
On Sun, Apr 19, 2020 at 10:44 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> Restart dint help. Although Serkan's reply made me look at how Ant was
> getting invoked.
>
> I see this warning that tools.jar is missing:
>
> [royale-compiler] $ cmd.exe /C "C:\apache\apache-ant-1.9.9\bin\ant.bat -file jenkins.xml -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs main && exit %%ERRORLEVEL%%"
>
> Unable to locate tools.jar. Expected to find it in C:\Program Files\Java\jre1.8.0_251\lib\tools.jar
>
>
> I am pretty sure this is related to this issue.
>
>
> On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <bi...@gmail.com>
> wrote:
>
>>
>>
>> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui <ah...@adobe.com.invalid>
>> wrote:
>>
>>> Did you reboot your VM? Also, have you checked what user is running
>>> Jenkins on your VM? I think that can sometimes be a problem. I might be
>>> running Jenkins as the user.
>>>
>>>
>> Agents don't require Jenkins to be running. I will give the rebooting of
>> the VM a shot .
>>
>> Thanks,
>> Om
>>
>>
>>> -Alex
>>>
>>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>>> wrote:
>>>
>>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui <ah...@adobe.com.invalid>
>>> wrote:
>>>
>>> > Should be here:
>>> >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=YJq3Ac1xpVWwyQDyFRgYmlcrGXs10W04hhON5QE0%2B90%3D&reserved=0
>>>
>>>
>>> My git is located in the same exact location as master.
>>> Moreover, the git call from the commandline executes fine. The git
>>> call
>>> from ant exec is what is failing.
>>>
>>>
>>>
>>> >
>>> >
>>> > HTH,
>>> > -Alex
>>> >
>>> > From: OmPrakash Muppirala <bi...@gmail.com>
>>> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
>>> > Date: Sunday, April 19, 2020 at 9:37 PM
>>> > To: Apache Royale Development <de...@royale.apache.org>
>>> > Subject: Re: Prioritize Release Jobs on CI
>>> >
>>> > I'm a bit stumped here. The royale-compiler is failing with this
>>> error:
>>> >
>>> >
>>> > BUILD FAILED
>>> >
>>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute
>>> failed:
>>> > java.io.IOException: Cannot run program "git" (in directory
>>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2,
>>> The system
>>> > cannot find the file specified
>>> >
>>> > at java.lang.ProcessBuilder.start(Unknown Source)
>>> >
>>> >
>>> > It is from this part of the jenkins.xml:
>>> >
>>> >
>>> > <target name="closure-lib-download" description="Copies Closure
>>> > Library from GitHub">
>>> > <echo message="Be patient. This takes a few minutes..." />
>>> > <exec executable="git" failifexecutionfails="true">
>>> > <arg value="clone" />
>>> > <arg value="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0
>>> <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0
>>> >"
>>> > />
>>> > <arg value="${closure.root}" />
>>> > </exec>
>>> > <echo>Cloned fresh copy of Google Closure Library</echo>
>>> > </target>
>>> >
>>> > I am not sure how this executable call works without the full path.
>>> >
>>> > I checked the env variables, I do have both the git/bin and git/cmd
>>> > directory in the PATH:
>>> >
>>> > [cid:ii_k97zkk9o0]
>>> >
>>> > What am I missing?
>>> >
>>> > Thanks,
>>> > Om
>>> >
>>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
>>> bigosmallm@gmail.com
>>> > <ma...@gmail.com>> wrote:
>>> > Update - I have successfully attached my VM as a slave agent of our
>>> > Jenkins instance.
>>> > I am going to pull the job - /royale-asjs_jsonly and tie it to my
>>> agent so
>>> > I can test it.
>>> >
>>> > It will fail for a sometime while I go set up my VM with all the
>>> > dependencies.
>>> >
>>> > Once we have the job successfully building on my VM, we can figure
>>> out how
>>> > to divide the load between the master and agent.
>>> >
>>> > Thanks,
>>> > Om
>>> >
>>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
>>> bigosmallm@gmail.com
>>> > <ma...@gmail.com>> wrote:
>>> > We could achieve the same by creating a new agent (separate vm) and
>>> > attaching it as a slave to the current Jenkins server.
>>> >
>>> > Then we can use labels/tags to tie release jobs to one agent and
>>> non
>>> > release jobs to another agent.
>>> >
>>> > That way we can maintain everything in one UI, one login while
>>> achieving
>>> > the concurrent building capabilities we want.
>>> >
>>> > Jenkins is built for this kind of stuff and I think it would be
>>> best we
>>> > followed this practice.
>>> >
>>> > Thanks,
>>> > Om
>>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid>
>>> wrote:
>>> > Om, I thought you were going to get the image from my VM and run
>>> it on
>>> > another VM. Then we'd remove all non-release jobs from your VM
>>> and all of
>>> > the release jobs from my VM. That won't solve the problem of how
>>> long it
>>> > takes for a commit to be built and tested, but will allow the RM
>>> to get a
>>> > release out without getting stuck behind the commit jobs. Is that
>>> > currently the plan?
>>> >
>>> > -Alex
>>> >
>>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bigosmallm@gmail.com
>>> <mailto:
>>> > bigosmallm@gmail.com>> wrote:
>>> >
>>> > Makes sense to me. I will set parallel executors back to 1.
>>> >
>>> > And start working on a new Jenkins instance.
>>> >
>>> > Thanks,
>>> > Om
>>> >
>>> >
>>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>>> <ah...@adobe.com.invalid>
>>> > wrote:
>>> >
>>> > > Are you saying that Java, Ant and Maven do not know how to
>>> > distribute work
>>> > > to different cores?
>>> > >
>>> > > To repeat my main concern: our Jenkins jobs often use shared
>>> > resources.
>>> > > If you want to take the time to fix that, feel free, but I
>>> do not
>>> > know how
>>> > > you are going to keep two jobs from both trying to launch
>>> Flash
>>> > Player
>>> > > Debugger at the same time and open the same socket to
>>> communicate
>>> > with it,
>>> > > or try to parse the flashlog.txt that they have both written
>>> to.
>>> > >
>>> > > The royale-asjs job will use the royale-compiler workspace
>>> to get the
>>> > > compiler. If the compiler is building, the jars are not
>>> there and
>>> > the
>>> > > royale-asjs build fails.
>>> > >
>>> > > There is also only so much memory and some of our jobs use
>>> all of it
>>> > and
>>> > > I'm not sure if jobs slowed down due to paging memory and
>>> > writing/reading
>>> > > from disk, even if it is an SSD.
>>> > >
>>> > > I'm done for tonight, but that's what I was seeing last time
>>> I tried
>>> > to
>>> > > have both master and an agent running jobs in parallel.
>>> > >
>>> > > Thanks,
>>> > > -Alex
>>> > >
>>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
>>> bigosmallm@gmail.com
>>> > <ma...@gmail.com>> wrote:
>>> > >
>>> > > A typical setup would be to have 0 executors on master
>>> and at
>>> > least n
>>> > > number of executors on each agent, where n = number of
>>> cpu cores.
>>> > > I see that the current VM has 2 cores. So, I started
>>> with
>>> > setting the
>>> > > num
>>> > > executors on the current agent to 2.
>>> > >
>>> > > This should improve things quite a bit. If this doesn't
>>> work, I
>>> > will
>>> > > create a new VM and make it the slave agent of the
>>> current
>>> > Jenkins
>>> > > master.
>>> > >
>>> > >
>>> > > Thanks,
>>> > > Om
>>> > >
>>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>>> > <ah...@adobe.com.invalid>
>>> > > wrote:
>>> > >
>>> > > > On your VM or mine? I don't think mine can handle
>>> it. I used
>>> > to
>>> > > run jobs
>>> > > > of master and agent and we got lots of failures and
>>> jobs took
>>> > > forever. If
>>> > > > two jobs are trying to run tests with the shared Flash
>>> Player
>>> > > Debugger, for
>>> > > > example, you won't get consistent results.
>>> > > >
>>> > > > -Alex
>>> > > >
>>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>>> > bigosmallm@gmail.com<ma...@gmail.com>>
>>> > > wrote:
>>> > > >
>>> > > > I just realized that we have only one Agent (node)
>>> listed
>>> > under
>>> > > > Jenkins. I
>>> > > > am going to add at least one more node to start
>>> with.
>>> > > >
>>> > > > Thanks,
>>> > > > Om
>>> > > >
>>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>>> > > <ah...@adobe.com.invalid>
>>> > > > wrote:
>>> > > >
>>> > > > > I think I followed the instructions and enabled
>>> SSH.
>>> > > > >
>>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>>> > yishayjobs@hotmail.com<ma...@hotmail.com>>
>>> > > wrote:
>>> > > > >
>>> > > > > I haven’t gotten it to work. Could be ssh
>>> needs to be
>>> > > enabled on
>>> > > > the
>>> > > > > VM [1]. This is nice to have but not essential.
>>> So Alex,
>>> > let
>>> > > me know
>>> > > > if you
>>> > > > > want to try that, otherwise I’ll suspend my
>>> efforts on
>>> > this.
>>> > > > >
>>> > > > > [1]
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
>>> > >
>>> > > > >
>>> > > > > From: Yishay Weiss<mailto:
>>> yishayjobs@hotmail.com
>>> > <ma...@hotmail.com>>
>>> > > > > Sent: Wednesday, April 15, 2020 5:09 PM
>>> > > > > To: dev@royale.apache.org<mailto:
>>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>>> > dev@royale.apache.org>>
>>> > > > > Subject: RE: Prioritize Release Jobs on CI
>>> > > > >
>>> > > > > I’d like to try and install an ssh server.
>>> Can anyone
>>> > > think of a
>>> > > > > reason not to do that? I’m asking in terms of
>>> security,
>>> > and if
>>> > > there
>>> > > > might
>>> > > > > be a problem because it’s a VM.
>>> > > > >
>>> > > > > Thanks.
>>> > > > >
>>> > > > > From: Yishay Weiss<mailto:
>>> yishayjobs@hotmail.com
>>> > <ma...@hotmail.com>>
>>> > > > > Sent: Monday, April 13, 2020 10:02 AM
>>> > > > > To: dev@royale.apache.org<mailto:
>>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>>> > dev@royale.apache.org>>
>>> > > > > Subject: RE: Prioritize Release Jobs on CI
>>> > > > >
>>> > > > > Related, as most (all?) of the instructions
>>> don’t
>>> > require
>>> > > > anything but
>>> > > > > a shell wouldn’t it be easier and faster to
>>> access the
>>> > machine
>>> > > with
>>> > > > ssh
>>> > > > > [1], rather than using remote desktop?
>>> > > > >
>>> > > > > [1]
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=eaL4SoRKuYDqpNaeLvhnQPiYfTULGYD0JEhBK2mm4a4%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=pkKsiZJqksZGMRqgam8yWQU5q4XB78QVI2hFuJj4hbI%3D&reserved=0
>>> > >
>>> > > > >
>>> > > > > From: Yishay Weiss<mailto:
>>> yishayjobs@hotmail.com
>>> > <ma...@hotmail.com>>
>>> > > > > Sent: Monday, April 13, 2020 9:55 AM
>>> > > > > To: dev@royale.apache.org<mailto:
>>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>>> > dev@royale.apache.org>>
>>> > > > > Subject: RE: Prioritize Release Jobs on CI
>>> > > > >
>>> > > > > Can’t you do that with remote desktop?
>>> > > > >
>>> > > > > ________________________________
>>> > > > > From: OmPrakash Muppirala <
>>> bigosmallm@gmail.com
>>> > <ma...@gmail.com>>
>>> > > > > Sent: Monday, April 13, 2020 9:51:25 AM
>>> > > > > To: Apache Royale Development <
>>> dev@royale.apache.org
>>> > <ma...@royale.apache.org>>
>>> > > > > Subject: Re: Prioritize Release Jobs on CI
>>> > > > >
>>> > > > > Alex,
>>> > > > >
>>> > > > > I believe this is your personal Azure
>>> subscription
>>> > right?
>>> > > Any
>>> > > > chance
>>> > > > > I can
>>> > > > > get access to it so I can try to copy the
>>> image out
>>> > the
>>> > > machine
>>> > > > and
>>> > > > > redeploy it somewhere else?
>>> > > > >
>>> > > > > Thanks,
>>> > > > > Om
>>> > > > >
>>> > > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash
>>> Muppirala <
>>> > > > > bigosmallm@gmail.com<mailto:bigosmallm@gmail.com
>>> >>
>>> > > > > wrote:
>>> > > > >
>>> > > > > > I can help set this up on Azure. Give me
>>> some
>>> > time to
>>> > > work
>>> > > > out the
>>> > > > > > details?
>>> > > > > >
>>> > > > > > Thanks,
>>> > > > > > Om
>>> > > > > >
>>> > > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
>>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>>> > > > wrote:
>>> > > > > >
>>> > > > > >> OK. Good to know.
>>> > > > > >>
>>> > > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
>>> > > > <aharui@adobe.com.INVALID
>>> > > > > >
>>> > > > > >> wrote:
>>> > > > > >> >
>>> > > > > >> > FWIW, I just looked and the longest job
>>> in the
>>> > release
>>> > > > steps so
>>> > > > > far is
>>> > > > > >> 8 minutes. Most are under 2 minutes.
>>> There
>>> > might be
>>> > > jobs
>>> > > > later
>>> > > > > that take
>>> > > > > >> longer that we haven't run yet. IMO, the
>>> issue
>>> > isn't
>>> > > speed
>>> > > > of the
>>> > > > > machine,
>>> > > > > >> it is just that we are sharing the
>>> machine with
>>> > longer
>>> > > jobs
>>> > > > (1 hour
>>> > > > > for
>>> > > > > >> TourDeFlexMigration). And again, the
>>> machine
>>> > will be
>>> > > idle for
>>> > > > > stretches of
>>> > > > > >> time while the RM verifies artifacts
>>> after each
>>> > step.
>>> > > > > >> >
>>> > > > > >> > -Alex
>>> > > > > >> >
>>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>>> > harbs.lists@gmail.com<ma...@gmail.com>
>>> > > > <mailto:
>>> > > > > >> harbs.lists@gmail.com<mailto:
>>> > harbs.lists@gmail.com>>> wrote:
>>> > > > > >> >
>>> > > > > >> > Fair enough.
>>> > > > > >> >
>>> > > > > >> > I expect builds to be somewhere
>>> between 10
>>> > and 20
>>> > > times
>>> > > > faster
>>> > > > > on a
>>> > > > > >> powerful machine.
>>> > > > > >> >
>>> > > > > >> > Yeah. It’s probably going to be a
>>> bit of work
>>> > > changing
>>> > > > the
>>> > > > > server,
>>> > > > > >> but probably worth it in the long run.
>>> > > > > >> >
>>> > > > > >> > I think I’ll try this when I do the
>>> next
>>> > release
>>> > > unless
>>> > > > Yishay
>>> > > > > wants
>>> > > > > >> to work with me on this for this release
>>> — but
>>> > I’m not
>>> > > going
>>> > > > to be
>>> > > > > able to
>>> > > > > >> help until after Passover (i.e. next
>>> week).
>>> > > > > >> >
>>> > > > > >> > Thanks,
>>> > > > > >> > Harbs
>>> > > > > >> >
>>> > > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
>>> > > > <aharui@adobe.com.INVALID
>>> > > > > >
>>> > > > > >> wrote:
>>> > > > > >> >>
>>> > > > > >> >> The Azure portal says: Standard F2s_v2
>>> (2
>>> > vcpus, 4
>>> > > GiB
>>> > > > memory)
>>> > > > > >> >>
>>> > > > > >> >> I think I am reading changes to the
>>> build
>>> > process in
>>> > > your
>>> > > > > >> suggestions. I do not really want to
>>> spend more
>>> > of my
>>> > > time
>>> > > > on this
>>> > > > > >> process. But if you want to do the work,
>>> that's
>>> > fine
>>> > > with me.
>>> > > > > >> >>
>>> > > > > >> >> -Alex
>>> > > > > >> >>
>>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>>> > harbs.lists@gmail.com<ma...@gmail.com>
>>> > > > <mailto:
>>> > > > > >> harbs.lists@gmail.com<mailto:
>>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com<mailto:
>>> > harbs.lists@gmail.com>
>>> > > <mailto:
>>> > > > > >> harbs.lists@gmail.com<mailto:
>>> > harbs.lists@gmail.com>>>> wrote:
>>> > > > > >> >>
>>> > > > > >> >> What kind of horsepower is included
>>> in the
>>> > free
>>> > > Azure
>>> > > > account?
>>> > > > > >> >>
>>> > > > > >> >> The server I mentioned builds
>>> (considerably)
>>> > > faster than
>>> > > > my own
>>> > > > > >> local machine. The ci server seems to
>>> build many
>>> > times
>>> > > slower.
>>> > > > > >> >>
>>> > > > > >> >> One thing we can do to minimize
>>> running
>>> > server time
>>> > > > would be to
>>> > > > > >> transfer the artifacts to storage instead
>>> of
>>> > keeping
>>> > > them on
>>> > > > the
>>> > > > > server. On
>>> > > > > >> AWS, I’d probably use S3. Not sure what
>>> the
>>> > similar
>>> > > service on
>>> > > > > Azure is
>>> > > > > >> called.
>>> > > > > >> >>
>>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex
>>> Harui
>>> > > > > <aharui@adobe.com.INVALID
>>> > > > > >> <mailto:aharui@adobe.com.INVALID<mailto:
>>> > aharui@adobe.com.INVALID>>> wrote:
>>> > > > > >> >>>
>>> > > > > >> >>> OK, that's pretty much how I
>>> understand Azure
>>> > as
>>> > > well.
>>> > > > The key
>>> > > > > thing
>>> > > > > >> is that "running" includes time where the
>>> CI
>>> > server is
>>> > > not
>>> > > > running
>>> > > > > any
>>> > > > > >> Jenkins jobs. The CI Server steps might
>>> take
>>> > only a few
>>> > > > hours of
>>> > > > > actual
>>> > > > > >> server time, but there is time where the
>>> RM is
>>> > verifying
>>> > > > artifacts
>>> > > > > locally
>>> > > > > >> so you'd be paying for that or the RM
>>> would have
>>> > to keep
>>> > > > shutting
>>> > > > > down and
>>> > > > > >> restarting.
>>> > > > > >> >>>
>>> > > > > >> >>> Seems like it would be
>>> cheaper/simpler to get
>>> > the
>>> > > free
>>> > > > MSDN
>>> > > > > account
>>> > > > > >> and leave it running.
>>> > > > > >> >>>
>>> > > > > >> >>> -Alex
>>> > > > > >> >>>
>>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>>> > > harbs.lists@gmail.com<ma...@gmail.com>
>>> > > > <mailto:
>>> > > > > >> harbs.lists@gmail.com<mailto:
>>> > harbs.lists@gmail.com>>> wrote:
>>> > > > > >> >>>
>>> > > > > >> >>> My experience is with AWS.
>>> > > > > >> >>>
>>> > > > > >> >>> I assume Microsoft has similar
>>> offerings,
>>> > but I
>>> > > don’t
>>> > > > have
>>> > > > > >> experience with Azure.
>>> > > > > >> >>>
>>> > > > > >> >>> AWS has on-demand EC2 instances
>>> which you
>>> > pay for
>>> > > only
>>> > > > the
>>> > > > > actual
>>> > > > > >> time that they are running.[1]
>>> > > > > >> >>>
>>> > > > > >> >>> Instances can be started and stopped
>>> via
>>> > command
>>> > > line
>>> > > > (or via
>>> > > > > the
>>> > > > > >> web interface) as long as you have valid
>>> > credentials to
>>> > > do so.
>>> > > > > >> >>>
>>> > > > > >> >>> For example: an m5.4xlarge instance
>>> has 16
>>> > cores
>>> > > and
>>> > > > costs
>>> > > > > about
>>> > > > > >> $1.5 per hour. On a machine like that, a
>>> full
>>> > build
>>> > > would
>>> > > > probably
>>> > > > > take
>>> > > > > >> less than 10 minutes. It’s probably
>>> possible to
>>> > do a
>>> > > full
>>> > > > release
>>> > > > > with only
>>> > > > > >> a few hours of server time.
>>> > > > > >> >>>
>>> > > > > >> >>> Leaving a server like that running
>>> all the
>>> > time
>>> > > would get
>>> > > > > expensive,
>>> > > > > >> but if it’s just spun up for releases,
>>> you’d get
>>> > very
>>> > > fast
>>> > > > builds
>>> > > > > at a
>>> > > > > >> reasonable price.
>>> > > > > >> >>>
>>> > > > > >> >>> I’d be happy to pay $10-$50 (and
>>> possibly
>>> > more) per
>>> > > > release to
>>> > > > > make
>>> > > > > >> the release process painless for the RM.
>>> > > > > >> >>>
>>> > > > > >> >>> [1]
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > >
>>> > > > > >> <
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > >
>>> > > > > >> ><
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > >
>>> > > > > >> <
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>>> > >
>>> > > > > >> >><
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > >
>>> > > > > >> <
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > >
>>> > > > > >> ><
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > >
>>> > > > > >> <
>>> > > > > >>
>>> > > > >
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > <
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>>> > >
>>> > > > > >> >>>
>>> > > > > >> >>>
>>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex
>>> Harui
>>> > > > > <ah...@adobe.com.INVALID>
>>> > > > > >> wrote:
>>> > > > > >> >>>>
>>> > > > > >> >>>> I'm not very experienced with
>>> spinning up
>>> > > servers. The
>>> > > > CI
>>> > > > > server we
>>> > > > > >> are using is effectively free, based on a
>>> generous
>>> > > donation
>>> > > > from
>>> > > > > Microsoft
>>> > > > > >> of MSDN accounts to ASF committers. So I
>>> leave
>>> > it up
>>> > > 24/7,
>>> > > > and
>>> > > > > share the
>>> > > > > >> RDP access on private@. I think any
>>> other ASF
>>> > > committer
>>> > > > could do
>>> > > > > the
>>> > > > > >> same. IIRC, if that server actually is
>>> stopped,
>>> > I have
>>> > > to
>>> > > > use my
>>> > > > > personal
>>> > > > > >> (unshared) MSDN credentials to start it
>>> again.
>>> > AIUI,
>>> > > if I
>>> > > > > actually paid
>>> > > > > >> for the server, it would cost me to leave
>>> it
>>> > running
>>> > > even if
>>> > > > it
>>> > > > > didn't run
>>> > > > > >> jobs between releases.
>>> > > > > >> >>>>
>>> > > > > >> >>>> Is that what you are basically
>>> saying? I
>>> > think it
>>> > > might
>>> > > > be
>>> > > > > best if
>>> > > > > >> another committer got a CI server going
>>> via the MS
>>> > > donation
>>> > > > and
>>> > > > > could leave
>>> > > > > >> it up 24/7.
>>> > > > > >> >>>>
>>> > > > > >> >>>> -Alex
>>> > > > > >> >>>>
>>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>>> > > > wrote:
>>> > > > > >> >>>>
>>> > > > > >> >>>> I’m willing to do this.
>>> > > > > >> >>>>
>>> > > > > >> >>>> Considering that the release will be
>>> run
>>> > > infrequently, it
>>> > > > > should be
>>> > > > > >> doable to have a relatively powerful
>>> server that
>>> > could
>>> > > be
>>> > > > spun up on
>>> > > > > >> demand. This is something I have setup
>>> for my own
>>> > > releases.
>>> > > > > >> >>>>
>>> > > > > >> >>>> The only complication would be that
>>> each RM
>>> > would
>>> > > need
>>> > > > valid
>>> > > > > >> credentials to spin up the server.
>>> > > > > >> >>>>
>>> > > > > >> >>>> Harbs
>>> > > > > >> >>>>
>>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex
>>> Harui
>>> > > > > <ah...@adobe.com.INVALID>
>>> > > > > >> wrote:
>>> > > > > >> >>>>>
>>> > > > > >> >>>>> A better solution, IMO, is for
>>> someone else
>>> > to
>>> > > offer up
>>> > > > a CI
>>> > > > > server
>>> > > > > >> only for release jobs.
>>> > > > > >>
>>> > > > > >>
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > >
>>> > > >
>>> > > >
>>> > >
>>> > >
>>> > >
>>> >
>>> >
>>>
>>>
>>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
Restart dint help. Although Serkan's reply made me look at how Ant was
getting invoked.
I see this warning that tools.jar is missing:
[royale-compiler] $ cmd.exe /C "C:\apache\apache-ant-1.9.9\bin\ant.bat
-file jenkins.xml -Denv.ASJS_HOME=C:\jenkins\workspace\royale-asjs
main && exit %%ERRORLEVEL%%"
Unable to locate tools.jar. Expected to find it in C:\Program
Files\Java\jre1.8.0_251\lib\tools.jar
I am pretty sure this is related to this issue.
On Sun, Apr 19, 2020 at 10:29 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
>
>
> On Sun, Apr 19, 2020 at 10:15 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
>> Did you reboot your VM? Also, have you checked what user is running
>> Jenkins on your VM? I think that can sometimes be a problem. I might be
>> running Jenkins as the user.
>>
>>
> Agents don't require Jenkins to be running. I will give the rebooting of
> the VM a shot .
>
> Thanks,
> Om
>
>
>> -Alex
>>
>> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui <ah...@adobe.com.invalid>
>> wrote:
>>
>> > Should be here:
>> >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=YJq3Ac1xpVWwyQDyFRgYmlcrGXs10W04hhON5QE0%2B90%3D&reserved=0
>>
>>
>> My git is located in the same exact location as master.
>> Moreover, the git call from the commandline executes fine. The git
>> call
>> from ant exec is what is failing.
>>
>>
>>
>> >
>> >
>> > HTH,
>> > -Alex
>> >
>> > From: OmPrakash Muppirala <bi...@gmail.com>
>> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
>> > Date: Sunday, April 19, 2020 at 9:37 PM
>> > To: Apache Royale Development <de...@royale.apache.org>
>> > Subject: Re: Prioritize Release Jobs on CI
>> >
>> > I'm a bit stumped here. The royale-compiler is failing with this
>> error:
>> >
>> >
>> > BUILD FAILED
>> >
>> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed:
>> > java.io.IOException: Cannot run program "git" (in directory
>> > "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The
>> system
>> > cannot find the file specified
>> >
>> > at java.lang.ProcessBuilder.start(Unknown Source)
>> >
>> >
>> > It is from this part of the jenkins.xml:
>> >
>> >
>> > <target name="closure-lib-download" description="Copies Closure
>> > Library from GitHub">
>> > <echo message="Be patient. This takes a few minutes..." />
>> > <exec executable="git" failifexecutionfails="true">
>> > <arg value="clone" />
>> > <arg value="
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0
>> <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0
>> >"
>> > />
>> > <arg value="${closure.root}" />
>> > </exec>
>> > <echo>Cloned fresh copy of Google Closure Library</echo>
>> > </target>
>> >
>> > I am not sure how this executable call works without the full path.
>> >
>> > I checked the env variables, I do have both the git/bin and git/cmd
>> > directory in the PATH:
>> >
>> > [cid:ii_k97zkk9o0]
>> >
>> > What am I missing?
>> >
>> > Thanks,
>> > Om
>> >
>> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
>> bigosmallm@gmail.com
>> > <ma...@gmail.com>> wrote:
>> > Update - I have successfully attached my VM as a slave agent of our
>> > Jenkins instance.
>> > I am going to pull the job - /royale-asjs_jsonly and tie it to my
>> agent so
>> > I can test it.
>> >
>> > It will fail for a sometime while I go set up my VM with all the
>> > dependencies.
>> >
>> > Once we have the job successfully building on my VM, we can figure
>> out how
>> > to divide the load between the master and agent.
>> >
>> > Thanks,
>> > Om
>> >
>> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
>> bigosmallm@gmail.com
>> > <ma...@gmail.com>> wrote:
>> > We could achieve the same by creating a new agent (separate vm) and
>> > attaching it as a slave to the current Jenkins server.
>> >
>> > Then we can use labels/tags to tie release jobs to one agent and non
>> > release jobs to another agent.
>> >
>> > That way we can maintain everything in one UI, one login while
>> achieving
>> > the concurrent building capabilities we want.
>> >
>> > Jenkins is built for this kind of stuff and I think it would be
>> best we
>> > followed this practice.
>> >
>> > Thanks,
>> > Om
>> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid>
>> wrote:
>> > Om, I thought you were going to get the image from my VM and run it
>> on
>> > another VM. Then we'd remove all non-release jobs from your VM and
>> all of
>> > the release jobs from my VM. That won't solve the problem of how
>> long it
>> > takes for a commit to be built and tested, but will allow the RM to
>> get a
>> > release out without getting stuck behind the commit jobs. Is that
>> > currently the plan?
>> >
>> > -Alex
>> >
>> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bigosmallm@gmail.com
>> <mailto:
>> > bigosmallm@gmail.com>> wrote:
>> >
>> > Makes sense to me. I will set parallel executors back to 1.
>> >
>> > And start working on a new Jenkins instance.
>> >
>> > Thanks,
>> > Om
>> >
>> >
>> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
>> <ah...@adobe.com.invalid>
>> > wrote:
>> >
>> > > Are you saying that Java, Ant and Maven do not know how to
>> > distribute work
>> > > to different cores?
>> > >
>> > > To repeat my main concern: our Jenkins jobs often use shared
>> > resources.
>> > > If you want to take the time to fix that, feel free, but I do
>> not
>> > know how
>> > > you are going to keep two jobs from both trying to launch
>> Flash
>> > Player
>> > > Debugger at the same time and open the same socket to
>> communicate
>> > with it,
>> > > or try to parse the flashlog.txt that they have both written
>> to.
>> > >
>> > > The royale-asjs job will use the royale-compiler workspace to
>> get the
>> > > compiler. If the compiler is building, the jars are not
>> there and
>> > the
>> > > royale-asjs build fails.
>> > >
>> > > There is also only so much memory and some of our jobs use
>> all of it
>> > and
>> > > I'm not sure if jobs slowed down due to paging memory and
>> > writing/reading
>> > > from disk, even if it is an SSD.
>> > >
>> > > I'm done for tonight, but that's what I was seeing last time
>> I tried
>> > to
>> > > have both master and an agent running jobs in parallel.
>> > >
>> > > Thanks,
>> > > -Alex
>> > >
>> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com
>> > <ma...@gmail.com>> wrote:
>> > >
>> > > A typical setup would be to have 0 executors on master
>> and at
>> > least n
>> > > number of executors on each agent, where n = number of
>> cpu cores.
>> > > I see that the current VM has 2 cores. So, I started with
>> > setting the
>> > > num
>> > > executors on the current agent to 2.
>> > >
>> > > This should improve things quite a bit. If this doesn't
>> work, I
>> > will
>> > > create a new VM and make it the slave agent of the current
>> > Jenkins
>> > > master.
>> > >
>> > >
>> > > Thanks,
>> > > Om
>> > >
>> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>> > <ah...@adobe.com.invalid>
>> > > wrote:
>> > >
>> > > > On your VM or mine? I don't think mine can handle it.
>> I used
>> > to
>> > > run jobs
>> > > > of master and agent and we got lots of failures and
>> jobs took
>> > > forever. If
>> > > > two jobs are trying to run tests with the shared Flash
>> Player
>> > > Debugger, for
>> > > > example, you won't get consistent results.
>> > > >
>> > > > -Alex
>> > > >
>> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>> > bigosmallm@gmail.com<ma...@gmail.com>>
>> > > wrote:
>> > > >
>> > > > I just realized that we have only one Agent (node)
>> listed
>> > under
>> > > > Jenkins. I
>> > > > am going to add at least one more node to start
>> with.
>> > > >
>> > > > Thanks,
>> > > > Om
>> > > >
>> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>> > > <ah...@adobe.com.invalid>
>> > > > wrote:
>> > > >
>> > > > > I think I followed the instructions and enabled
>> SSH.
>> > > > >
>> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>> > yishayjobs@hotmail.com<ma...@hotmail.com>>
>> > > wrote:
>> > > > >
>> > > > > I haven’t gotten it to work. Could be ssh
>> needs to be
>> > > enabled on
>> > > > the
>> > > > > VM [1]. This is nice to have but not essential.
>> So Alex,
>> > let
>> > > me know
>> > > > if you
>> > > > > want to try that, otherwise I’ll suspend my
>> efforts on
>> > this.
>> > > > >
>> > > > > [1]
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
>> > >
>> > > > >
>> > > > > From: Yishay Weiss<mailto:
>> yishayjobs@hotmail.com
>> > <ma...@hotmail.com>>
>> > > > > Sent: Wednesday, April 15, 2020 5:09 PM
>> > > > > To: dev@royale.apache.org<mailto:
>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> > dev@royale.apache.org>>
>> > > > > Subject: RE: Prioritize Release Jobs on CI
>> > > > >
>> > > > > I’d like to try and install an ssh server.
>> Can anyone
>> > > think of a
>> > > > > reason not to do that? I’m asking in terms of
>> security,
>> > and if
>> > > there
>> > > > might
>> > > > > be a problem because it’s a VM.
>> > > > >
>> > > > > Thanks.
>> > > > >
>> > > > > From: Yishay Weiss<mailto:
>> yishayjobs@hotmail.com
>> > <ma...@hotmail.com>>
>> > > > > Sent: Monday, April 13, 2020 10:02 AM
>> > > > > To: dev@royale.apache.org<mailto:
>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> > dev@royale.apache.org>>
>> > > > > Subject: RE: Prioritize Release Jobs on CI
>> > > > >
>> > > > > Related, as most (all?) of the instructions
>> don’t
>> > require
>> > > > anything but
>> > > > > a shell wouldn’t it be easier and faster to
>> access the
>> > machine
>> > > with
>> > > > ssh
>> > > > > [1], rather than using remote desktop?
>> > > > >
>> > > > > [1]
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=eaL4SoRKuYDqpNaeLvhnQPiYfTULGYD0JEhBK2mm4a4%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=pkKsiZJqksZGMRqgam8yWQU5q4XB78QVI2hFuJj4hbI%3D&reserved=0
>> > >
>> > > > >
>> > > > > From: Yishay Weiss<mailto:
>> yishayjobs@hotmail.com
>> > <ma...@hotmail.com>>
>> > > > > Sent: Monday, April 13, 2020 9:55 AM
>> > > > > To: dev@royale.apache.org<mailto:
>> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
>> > dev@royale.apache.org>>
>> > > > > Subject: RE: Prioritize Release Jobs on CI
>> > > > >
>> > > > > Can’t you do that with remote desktop?
>> > > > >
>> > > > > ________________________________
>> > > > > From: OmPrakash Muppirala <
>> bigosmallm@gmail.com
>> > <ma...@gmail.com>>
>> > > > > Sent: Monday, April 13, 2020 9:51:25 AM
>> > > > > To: Apache Royale Development <
>> dev@royale.apache.org
>> > <ma...@royale.apache.org>>
>> > > > > Subject: Re: Prioritize Release Jobs on CI
>> > > > >
>> > > > > Alex,
>> > > > >
>> > > > > I believe this is your personal Azure
>> subscription
>> > right?
>> > > Any
>> > > > chance
>> > > > > I can
>> > > > > get access to it so I can try to copy the
>> image out
>> > the
>> > > machine
>> > > > and
>> > > > > redeploy it somewhere else?
>> > > > >
>> > > > > Thanks,
>> > > > > Om
>> > > > >
>> > > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash
>> Muppirala <
>> > > > > bigosmallm@gmail.com<mailto:bigosmallm@gmail.com
>> >>
>> > > > > wrote:
>> > > > >
>> > > > > > I can help set this up on Azure. Give me
>> some
>> > time to
>> > > work
>> > > > out the
>> > > > > > details?
>> > > > > >
>> > > > > > Thanks,
>> > > > > > Om
>> > > > > >
>> > > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>> > > > wrote:
>> > > > > >
>> > > > > >> OK. Good to know.
>> > > > > >>
>> > > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
>> > > > <aharui@adobe.com.INVALID
>> > > > > >
>> > > > > >> wrote:
>> > > > > >> >
>> > > > > >> > FWIW, I just looked and the longest job
>> in the
>> > release
>> > > > steps so
>> > > > > far is
>> > > > > >> 8 minutes. Most are under 2 minutes.
>> There
>> > might be
>> > > jobs
>> > > > later
>> > > > > that take
>> > > > > >> longer that we haven't run yet. IMO, the
>> issue
>> > isn't
>> > > speed
>> > > > of the
>> > > > > machine,
>> > > > > >> it is just that we are sharing the machine
>> with
>> > longer
>> > > jobs
>> > > > (1 hour
>> > > > > for
>> > > > > >> TourDeFlexMigration). And again, the
>> machine
>> > will be
>> > > idle for
>> > > > > stretches of
>> > > > > >> time while the RM verifies artifacts after
>> each
>> > step.
>> > > > > >> >
>> > > > > >> > -Alex
>> > > > > >> >
>> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>> > harbs.lists@gmail.com<ma...@gmail.com>
>> > > > <mailto:
>> > > > > >> harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>> wrote:
>> > > > > >> >
>> > > > > >> > Fair enough.
>> > > > > >> >
>> > > > > >> > I expect builds to be somewhere
>> between 10
>> > and 20
>> > > times
>> > > > faster
>> > > > > on a
>> > > > > >> powerful machine.
>> > > > > >> >
>> > > > > >> > Yeah. It’s probably going to be a bit
>> of work
>> > > changing
>> > > > the
>> > > > > server,
>> > > > > >> but probably worth it in the long run.
>> > > > > >> >
>> > > > > >> > I think I’ll try this when I do the
>> next
>> > release
>> > > unless
>> > > > Yishay
>> > > > > wants
>> > > > > >> to work with me on this for this release —
>> but
>> > I’m not
>> > > going
>> > > > to be
>> > > > > able to
>> > > > > >> help until after Passover (i.e. next week).
>> > > > > >> >
>> > > > > >> > Thanks,
>> > > > > >> > Harbs
>> > > > > >> >
>> > > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
>> > > > <aharui@adobe.com.INVALID
>> > > > > >
>> > > > > >> wrote:
>> > > > > >> >>
>> > > > > >> >> The Azure portal says: Standard F2s_v2
>> (2
>> > vcpus, 4
>> > > GiB
>> > > > memory)
>> > > > > >> >>
>> > > > > >> >> I think I am reading changes to the
>> build
>> > process in
>> > > your
>> > > > > >> suggestions. I do not really want to
>> spend more
>> > of my
>> > > time
>> > > > on this
>> > > > > >> process. But if you want to do the work,
>> that's
>> > fine
>> > > with me.
>> > > > > >> >>
>> > > > > >> >> -Alex
>> > > > > >> >>
>> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>> > harbs.lists@gmail.com<ma...@gmail.com>
>> > > > <mailto:
>> > > > > >> harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>
>> > > <mailto:
>> > > > > >> harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>>> wrote:
>> > > > > >> >>
>> > > > > >> >> What kind of horsepower is included
>> in the
>> > free
>> > > Azure
>> > > > account?
>> > > > > >> >>
>> > > > > >> >> The server I mentioned builds
>> (considerably)
>> > > faster than
>> > > > my own
>> > > > > >> local machine. The ci server seems to
>> build many
>> > times
>> > > slower.
>> > > > > >> >>
>> > > > > >> >> One thing we can do to minimize
>> running
>> > server time
>> > > > would be to
>> > > > > >> transfer the artifacts to storage instead
>> of
>> > keeping
>> > > them on
>> > > > the
>> > > > > server. On
>> > > > > >> AWS, I’d probably use S3. Not sure what the
>> > similar
>> > > service on
>> > > > > Azure is
>> > > > > >> called.
>> > > > > >> >>
>> > > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
>> > > > > <aharui@adobe.com.INVALID
>> > > > > >> <mailto:aharui@adobe.com.INVALID<mailto:
>> > aharui@adobe.com.INVALID>>> wrote:
>> > > > > >> >>>
>> > > > > >> >>> OK, that's pretty much how I
>> understand Azure
>> > as
>> > > well.
>> > > > The key
>> > > > > thing
>> > > > > >> is that "running" includes time where the
>> CI
>> > server is
>> > > not
>> > > > running
>> > > > > any
>> > > > > >> Jenkins jobs. The CI Server steps might
>> take
>> > only a few
>> > > > hours of
>> > > > > actual
>> > > > > >> server time, but there is time where the
>> RM is
>> > verifying
>> > > > artifacts
>> > > > > locally
>> > > > > >> so you'd be paying for that or the RM
>> would have
>> > to keep
>> > > > shutting
>> > > > > down and
>> > > > > >> restarting.
>> > > > > >> >>>
>> > > > > >> >>> Seems like it would be cheaper/simpler
>> to get
>> > the
>> > > free
>> > > > MSDN
>> > > > > account
>> > > > > >> and leave it running.
>> > > > > >> >>>
>> > > > > >> >>> -Alex
>> > > > > >> >>>
>> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>> > > harbs.lists@gmail.com<ma...@gmail.com>
>> > > > <mailto:
>> > > > > >> harbs.lists@gmail.com<mailto:
>> > harbs.lists@gmail.com>>> wrote:
>> > > > > >> >>>
>> > > > > >> >>> My experience is with AWS.
>> > > > > >> >>>
>> > > > > >> >>> I assume Microsoft has similar
>> offerings,
>> > but I
>> > > don’t
>> > > > have
>> > > > > >> experience with Azure.
>> > > > > >> >>>
>> > > > > >> >>> AWS has on-demand EC2 instances which
>> you
>> > pay for
>> > > only
>> > > > the
>> > > > > actual
>> > > > > >> time that they are running.[1]
>> > > > > >> >>>
>> > > > > >> >>> Instances can be started and stopped
>> via
>> > command
>> > > line
>> > > > (or via
>> > > > > the
>> > > > > >> web interface) as long as you have valid
>> > credentials to
>> > > do so.
>> > > > > >> >>>
>> > > > > >> >>> For example: an m5.4xlarge instance
>> has 16
>> > cores
>> > > and
>> > > > costs
>> > > > > about
>> > > > > >> $1.5 per hour. On a machine like that, a
>> full
>> > build
>> > > would
>> > > > probably
>> > > > > take
>> > > > > >> less than 10 minutes. It’s probably
>> possible to
>> > do a
>> > > full
>> > > > release
>> > > > > with only
>> > > > > >> a few hours of server time.
>> > > > > >> >>>
>> > > > > >> >>> Leaving a server like that running
>> all the
>> > time
>> > > would get
>> > > > > expensive,
>> > > > > >> but if it’s just spun up for releases,
>> you’d get
>> > very
>> > > fast
>> > > > builds
>> > > > > at a
>> > > > > >> reasonable price.
>> > > > > >> >>>
>> > > > > >> >>> I’d be happy to pay $10-$50 (and
>> possibly
>> > more) per
>> > > > release to
>> > > > > make
>> > > > > >> the release process painless for the RM.
>> > > > > >> >>>
>> > > > > >> >>> [1]
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > >
>> > > > > >> <
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > >
>> > > > > >> ><
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > >
>> > > > > >> <
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
>> > >
>> > > > > >> >><
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > >
>> > > > > >> <
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > >
>> > > > > >> ><
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > >
>> > > > > >> <
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > <
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
>> > >
>> > > > > >> >>>
>> > > > > >> >>>
>> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex
>> Harui
>> > > > > <ah...@adobe.com.INVALID>
>> > > > > >> wrote:
>> > > > > >> >>>>
>> > > > > >> >>>> I'm not very experienced with
>> spinning up
>> > > servers. The
>> > > > CI
>> > > > > server we
>> > > > > >> are using is effectively free, based on a
>> generous
>> > > donation
>> > > > from
>> > > > > Microsoft
>> > > > > >> of MSDN accounts to ASF committers. So I
>> leave
>> > it up
>> > > 24/7,
>> > > > and
>> > > > > share the
>> > > > > >> RDP access on private@. I think any
>> other ASF
>> > > committer
>> > > > could do
>> > > > > the
>> > > > > >> same. IIRC, if that server actually is
>> stopped,
>> > I have
>> > > to
>> > > > use my
>> > > > > personal
>> > > > > >> (unshared) MSDN credentials to start it
>> again.
>> > AIUI,
>> > > if I
>> > > > > actually paid
>> > > > > >> for the server, it would cost me to leave
>> it
>> > running
>> > > even if
>> > > > it
>> > > > > didn't run
>> > > > > >> jobs between releases.
>> > > > > >> >>>>
>> > > > > >> >>>> Is that what you are basically
>> saying? I
>> > think it
>> > > might
>> > > > be
>> > > > > best if
>> > > > > >> another committer got a CI server going
>> via the MS
>> > > donation
>> > > > and
>> > > > > could leave
>> > > > > >> it up 24/7.
>> > > > > >> >>>>
>> > > > > >> >>>> -Alex
>> > > > > >> >>>>
>> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>> > > harbs.lists@gmail.com<ma...@gmail.com>>
>> > > > wrote:
>> > > > > >> >>>>
>> > > > > >> >>>> I’m willing to do this.
>> > > > > >> >>>>
>> > > > > >> >>>> Considering that the release will be
>> run
>> > > infrequently, it
>> > > > > should be
>> > > > > >> doable to have a relatively powerful
>> server that
>> > could
>> > > be
>> > > > spun up on
>> > > > > >> demand. This is something I have setup for
>> my own
>> > > releases.
>> > > > > >> >>>>
>> > > > > >> >>>> The only complication would be that
>> each RM
>> > would
>> > > need
>> > > > valid
>> > > > > >> credentials to spin up the server.
>> > > > > >> >>>>
>> > > > > >> >>>> Harbs
>> > > > > >> >>>>
>> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex
>> Harui
>> > > > > <ah...@adobe.com.INVALID>
>> > > > > >> wrote:
>> > > > > >> >>>>>
>> > > > > >> >>>>> A better solution, IMO, is for
>> someone else
>> > to
>> > > offer up
>> > > > a CI
>> > > > > server
>> > > > > >> only for release jobs.
>> > > > > >>
>> > > > > >>
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> > >
>> >
>> >
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Sun, Apr 19, 2020 at 10:15 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> Did you reboot your VM? Also, have you checked what user is running
> Jenkins on your VM? I think that can sometimes be a problem. I might be
> running Jenkins as the user.
>
>
Agents don't require Jenkins to be running. I will give the rebooting of
the VM a shot .
Thanks,
Om
> -Alex
>
> On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> On Sun, Apr 19, 2020 at 9:55 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > Should be here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=YJq3Ac1xpVWwyQDyFRgYmlcrGXs10W04hhON5QE0%2B90%3D&reserved=0
>
>
> My git is located in the same exact location as master.
> Moreover, the git call from the commandline executes fine. The git
> call
> from ant exec is what is failing.
>
>
>
> >
> >
> > HTH,
> > -Alex
> >
> > From: OmPrakash Muppirala <bi...@gmail.com>
> > Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
> > Date: Sunday, April 19, 2020 at 9:37 PM
> > To: Apache Royale Development <de...@royale.apache.org>
> > Subject: Re: Prioritize Release Jobs on CI
> >
> > I'm a bit stumped here. The royale-compiler is failing with this
> error:
> >
> >
> > BUILD FAILED
> >
> > c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed:
> > java.io.IOException: Cannot run program "git" (in directory
> > "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The
> system
> > cannot find the file specified
> >
> > at java.lang.ProcessBuilder.start(Unknown Source)
> >
> >
> > It is from this part of the jenkins.xml:
> >
> >
> > <target name="closure-lib-download" description="Copies Closure
> > Library from GitHub">
> > <echo message="Be patient. This takes a few minutes..." />
> > <exec executable="git" failifexecutionfails="true">
> > <arg value="clone" />
> > <arg value="
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0
> <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0
> >"
> > />
> > <arg value="${closure.root}" />
> > </exec>
> > <echo>Cloned fresh copy of Google Closure Library</echo>
> > </target>
> >
> > I am not sure how this executable call works without the full path.
> >
> > I checked the env variables, I do have both the git/bin and git/cmd
> > directory in the PATH:
> >
> > [cid:ii_k97zkk9o0]
> >
> > What am I missing?
> >
> > Thanks,
> > Om
> >
> > On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <
> bigosmallm@gmail.com
> > <ma...@gmail.com>> wrote:
> > Update - I have successfully attached my VM as a slave agent of our
> > Jenkins instance.
> > I am going to pull the job - /royale-asjs_jsonly and tie it to my
> agent so
> > I can test it.
> >
> > It will fail for a sometime while I go set up my VM with all the
> > dependencies.
> >
> > Once we have the job successfully building on my VM, we can figure
> out how
> > to divide the load between the master and agent.
> >
> > Thanks,
> > Om
> >
> > On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <
> bigosmallm@gmail.com
> > <ma...@gmail.com>> wrote:
> > We could achieve the same by creating a new agent (separate vm) and
> > attaching it as a slave to the current Jenkins server.
> >
> > Then we can use labels/tags to tie release jobs to one agent and non
> > release jobs to another agent.
> >
> > That way we can maintain everything in one UI, one login while
> achieving
> > the concurrent building capabilities we want.
> >
> > Jenkins is built for this kind of stuff and I think it would be best
> we
> > followed this practice.
> >
> > Thanks,
> > Om
> > On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
> > Om, I thought you were going to get the image from my VM and run it
> on
> > another VM. Then we'd remove all non-release jobs from your VM and
> all of
> > the release jobs from my VM. That won't solve the problem of how
> long it
> > takes for a commit to be built and tested, but will allow the RM to
> get a
> > release out without getting stuck behind the commit jobs. Is that
> > currently the plan?
> >
> > -Alex
> >
> > On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> <mailto:
> > bigosmallm@gmail.com>> wrote:
> >
> > Makes sense to me. I will set parallel executors back to 1.
> >
> > And start working on a new Jenkins instance.
> >
> > Thanks,
> > Om
> >
> >
> > On Sat, Apr 18, 2020, 12:28 AM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > Are you saying that Java, Ant and Maven do not know how to
> > distribute work
> > > to different cores?
> > >
> > > To repeat my main concern: our Jenkins jobs often use shared
> > resources.
> > > If you want to take the time to fix that, feel free, but I do
> not
> > know how
> > > you are going to keep two jobs from both trying to launch Flash
> > Player
> > > Debugger at the same time and open the same socket to
> communicate
> > with it,
> > > or try to parse the flashlog.txt that they have both written
> to.
> > >
> > > The royale-asjs job will use the royale-compiler workspace to
> get the
> > > compiler. If the compiler is building, the jars are not there
> and
> > the
> > > royale-asjs build fails.
> > >
> > > There is also only so much memory and some of our jobs use all
> of it
> > and
> > > I'm not sure if jobs slowed down due to paging memory and
> > writing/reading
> > > from disk, even if it is an SSD.
> > >
> > > I'm done for tonight, but that's what I was seeing last time I
> tried
> > to
> > > have both master and an agent running jobs in parallel.
> > >
> > > Thanks,
> > > -Alex
> > >
> > > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com
> > <ma...@gmail.com>> wrote:
> > >
> > > A typical setup would be to have 0 executors on master and
> at
> > least n
> > > number of executors on each agent, where n = number of cpu
> cores.
> > > I see that the current VM has 2 cores. So, I started with
> > setting the
> > > num
> > > executors on the current agent to 2.
> > >
> > > This should improve things quite a bit. If this doesn't
> work, I
> > will
> > > create a new VM and make it the slave agent of the current
> > Jenkins
> > > master.
> > >
> > >
> > > Thanks,
> > > Om
> > >
> > > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> > <ah...@adobe.com.invalid>
> > > wrote:
> > >
> > > > On your VM or mine? I don't think mine can handle it.
> I used
> > to
> > > run jobs
> > > > of master and agent and we got lots of failures and jobs
> took
> > > forever. If
> > > > two jobs are trying to run tests with the shared Flash
> Player
> > > Debugger, for
> > > > example, you won't get consistent results.
> > > >
> > > > -Alex
> > > >
> > > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
> > bigosmallm@gmail.com<ma...@gmail.com>>
> > > wrote:
> > > >
> > > > I just realized that we have only one Agent (node)
> listed
> > under
> > > > Jenkins. I
> > > > am going to add at least one more node to start with.
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> > > <ah...@adobe.com.invalid>
> > > > wrote:
> > > >
> > > > > I think I followed the instructions and enabled
> SSH.
> > > > >
> > > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
> > yishayjobs@hotmail.com<ma...@hotmail.com>>
> > > wrote:
> > > > >
> > > > > I haven’t gotten it to work. Could be ssh
> needs to be
> > > enabled on
> > > > the
> > > > > VM [1]. This is nice to have but not essential. So
> Alex,
> > let
> > > me know
> > > > if you
> > > > > want to try that, otherwise I’ll suspend my
> efforts on
> > this.
> > > > >
> > > > > [1]
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
> > >
> > > > >
> > > > > From: Yishay Weiss<mailto:
> yishayjobs@hotmail.com
> > <ma...@hotmail.com>>
> > > > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > > > To: dev@royale.apache.org<mailto:
> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> > dev@royale.apache.org>>
> > > > > Subject: RE: Prioritize Release Jobs on CI
> > > > >
> > > > > I’d like to try and install an ssh server. Can
> anyone
> > > think of a
> > > > > reason not to do that? I’m asking in terms of
> security,
> > and if
> > > there
> > > > might
> > > > > be a problem because it’s a VM.
> > > > >
> > > > > Thanks.
> > > > >
> > > > > From: Yishay Weiss<mailto:
> yishayjobs@hotmail.com
> > <ma...@hotmail.com>>
> > > > > Sent: Monday, April 13, 2020 10:02 AM
> > > > > To: dev@royale.apache.org<mailto:
> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> > dev@royale.apache.org>>
> > > > > Subject: RE: Prioritize Release Jobs on CI
> > > > >
> > > > > Related, as most (all?) of the instructions
> don’t
> > require
> > > > anything but
> > > > > a shell wouldn’t it be easier and faster to access
> the
> > machine
> > > with
> > > > ssh
> > > > > [1], rather than using remote desktop?
> > > > >
> > > > > [1]
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=eaL4SoRKuYDqpNaeLvhnQPiYfTULGYD0JEhBK2mm4a4%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=pkKsiZJqksZGMRqgam8yWQU5q4XB78QVI2hFuJj4hbI%3D&reserved=0
> > >
> > > > >
> > > > > From: Yishay Weiss<mailto:
> yishayjobs@hotmail.com
> > <ma...@hotmail.com>>
> > > > > Sent: Monday, April 13, 2020 9:55 AM
> > > > > To: dev@royale.apache.org<mailto:
> > dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> > dev@royale.apache.org>>
> > > > > Subject: RE: Prioritize Release Jobs on CI
> > > > >
> > > > > Can’t you do that with remote desktop?
> > > > >
> > > > > ________________________________
> > > > > From: OmPrakash Muppirala <
> bigosmallm@gmail.com
> > <ma...@gmail.com>>
> > > > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > > > To: Apache Royale Development <
> dev@royale.apache.org
> > <ma...@royale.apache.org>>
> > > > > Subject: Re: Prioritize Release Jobs on CI
> > > > >
> > > > > Alex,
> > > > >
> > > > > I believe this is your personal Azure
> subscription
> > right?
> > > Any
> > > > chance
> > > > > I can
> > > > > get access to it so I can try to copy the
> image out
> > the
> > > machine
> > > > and
> > > > > redeploy it somewhere else?
> > > > >
> > > > > Thanks,
> > > > > Om
> > > > >
> > > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash
> Muppirala <
> > > > > bigosmallm@gmail.com<ma...@gmail.com>>
> > > > > wrote:
> > > > >
> > > > > > I can help set this up on Azure. Give me
> some
> > time to
> > > work
> > > > out the
> > > > > > details?
> > > > > >
> > > > > > Thanks,
> > > > > > Om
> > > > > >
> > > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> > > harbs.lists@gmail.com<ma...@gmail.com>>
> > > > wrote:
> > > > > >
> > > > > >> OK. Good to know.
> > > > > >>
> > > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > > > <aharui@adobe.com.INVALID
> > > > > >
> > > > > >> wrote:
> > > > > >> >
> > > > > >> > FWIW, I just looked and the longest job
> in the
> > release
> > > > steps so
> > > > > far is
> > > > > >> 8 minutes. Most are under 2 minutes. There
> > might be
> > > jobs
> > > > later
> > > > > that take
> > > > > >> longer that we haven't run yet. IMO, the
> issue
> > isn't
> > > speed
> > > > of the
> > > > > machine,
> > > > > >> it is just that we are sharing the machine
> with
> > longer
> > > jobs
> > > > (1 hour
> > > > > for
> > > > > >> TourDeFlexMigration). And again, the
> machine
> > will be
> > > idle for
> > > > > stretches of
> > > > > >> time while the RM verifies artifacts after
> each
> > step.
> > > > > >> >
> > > > > >> > -Alex
> > > > > >> >
> > > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
> > harbs.lists@gmail.com<ma...@gmail.com>
> > > > <mailto:
> > > > > >> harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>>> wrote:
> > > > > >> >
> > > > > >> > Fair enough.
> > > > > >> >
> > > > > >> > I expect builds to be somewhere
> between 10
> > and 20
> > > times
> > > > faster
> > > > > on a
> > > > > >> powerful machine.
> > > > > >> >
> > > > > >> > Yeah. It’s probably going to be a bit
> of work
> > > changing
> > > > the
> > > > > server,
> > > > > >> but probably worth it in the long run.
> > > > > >> >
> > > > > >> > I think I’ll try this when I do the
> next
> > release
> > > unless
> > > > Yishay
> > > > > wants
> > > > > >> to work with me on this for this release —
> but
> > I’m not
> > > going
> > > > to be
> > > > > able to
> > > > > >> help until after Passover (i.e. next week).
> > > > > >> >
> > > > > >> > Thanks,
> > > > > >> > Harbs
> > > > > >> >
> > > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > > > <aharui@adobe.com.INVALID
> > > > > >
> > > > > >> wrote:
> > > > > >> >>
> > > > > >> >> The Azure portal says: Standard F2s_v2 (2
> > vcpus, 4
> > > GiB
> > > > memory)
> > > > > >> >>
> > > > > >> >> I think I am reading changes to the build
> > process in
> > > your
> > > > > >> suggestions. I do not really want to spend
> more
> > of my
> > > time
> > > > on this
> > > > > >> process. But if you want to do the work,
> that's
> > fine
> > > with me.
> > > > > >> >>
> > > > > >> >> -Alex
> > > > > >> >>
> > > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
> > harbs.lists@gmail.com<ma...@gmail.com>
> > > > <mailto:
> > > > > >> harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>
> > > <mailto:
> > > > > >> harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>>>> wrote:
> > > > > >> >>
> > > > > >> >> What kind of horsepower is included in
> the
> > free
> > > Azure
> > > > account?
> > > > > >> >>
> > > > > >> >> The server I mentioned builds
> (considerably)
> > > faster than
> > > > my own
> > > > > >> local machine. The ci server seems to build
> many
> > times
> > > slower.
> > > > > >> >>
> > > > > >> >> One thing we can do to minimize running
> > server time
> > > > would be to
> > > > > >> transfer the artifacts to storage instead of
> > keeping
> > > them on
> > > > the
> > > > > server. On
> > > > > >> AWS, I’d probably use S3. Not sure what the
> > similar
> > > service on
> > > > > Azure is
> > > > > >> called.
> > > > > >> >>
> > > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > > > <aharui@adobe.com.INVALID
> > > > > >> <mailto:aharui@adobe.com.INVALID<mailto:
> > aharui@adobe.com.INVALID>>> wrote:
> > > > > >> >>>
> > > > > >> >>> OK, that's pretty much how I understand
> Azure
> > as
> > > well.
> > > > The key
> > > > > thing
> > > > > >> is that "running" includes time where the CI
> > server is
> > > not
> > > > running
> > > > > any
> > > > > >> Jenkins jobs. The CI Server steps might
> take
> > only a few
> > > > hours of
> > > > > actual
> > > > > >> server time, but there is time where the RM
> is
> > verifying
> > > > artifacts
> > > > > locally
> > > > > >> so you'd be paying for that or the RM would
> have
> > to keep
> > > > shutting
> > > > > down and
> > > > > >> restarting.
> > > > > >> >>>
> > > > > >> >>> Seems like it would be cheaper/simpler
> to get
> > the
> > > free
> > > > MSDN
> > > > > account
> > > > > >> and leave it running.
> > > > > >> >>>
> > > > > >> >>> -Alex
> > > > > >> >>>
> > > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> > > harbs.lists@gmail.com<ma...@gmail.com>
> > > > <mailto:
> > > > > >> harbs.lists@gmail.com<mailto:
> > harbs.lists@gmail.com>>> wrote:
> > > > > >> >>>
> > > > > >> >>> My experience is with AWS.
> > > > > >> >>>
> > > > > >> >>> I assume Microsoft has similar
> offerings,
> > but I
> > > don’t
> > > > have
> > > > > >> experience with Azure.
> > > > > >> >>>
> > > > > >> >>> AWS has on-demand EC2 instances which
> you
> > pay for
> > > only
> > > > the
> > > > > actual
> > > > > >> time that they are running.[1]
> > > > > >> >>>
> > > > > >> >>> Instances can be started and stopped
> via
> > command
> > > line
> > > > (or via
> > > > > the
> > > > > >> web interface) as long as you have valid
> > credentials to
> > > do so.
> > > > > >> >>>
> > > > > >> >>> For example: an m5.4xlarge instance
> has 16
> > cores
> > > and
> > > > costs
> > > > > about
> > > > > >> $1.5 per hour. On a machine like that, a
> full
> > build
> > > would
> > > > probably
> > > > > take
> > > > > >> less than 10 minutes. It’s probably
> possible to
> > do a
> > > full
> > > > release
> > > > > with only
> > > > > >> a few hours of server time.
> > > > > >> >>>
> > > > > >> >>> Leaving a server like that running all
> the
> > time
> > > would get
> > > > > expensive,
> > > > > >> but if it’s just spun up for releases,
> you’d get
> > very
> > > fast
> > > > builds
> > > > > at a
> > > > > >> reasonable price.
> > > > > >> >>>
> > > > > >> >>> I’d be happy to pay $10-$50 (and
> possibly
> > more) per
> > > > release to
> > > > > make
> > > > > >> the release process painless for the RM.
> > > > > >> >>>
> > > > > >> >>> [1]
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > >
> > > > > >> <
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > >
> > > > > >> ><
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > >
> > > > > >> <
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> > >
> > > > > >> >><
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > >
> > > > > >> <
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > >
> > > > > >> ><
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > >
> > > > > >> <
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > <
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> > >
> > > > > >> >>>
> > > > > >> >>>
> > > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > > > <ah...@adobe.com.INVALID>
> > > > > >> wrote:
> > > > > >> >>>>
> > > > > >> >>>> I'm not very experienced with spinning
> up
> > > servers. The
> > > > CI
> > > > > server we
> > > > > >> are using is effectively free, based on a
> generous
> > > donation
> > > > from
> > > > > Microsoft
> > > > > >> of MSDN accounts to ASF committers. So I
> leave
> > it up
> > > 24/7,
> > > > and
> > > > > share the
> > > > > >> RDP access on private@. I think any other
> ASF
> > > committer
> > > > could do
> > > > > the
> > > > > >> same. IIRC, if that server actually is
> stopped,
> > I have
> > > to
> > > > use my
> > > > > personal
> > > > > >> (unshared) MSDN credentials to start it
> again.
> > AIUI,
> > > if I
> > > > > actually paid
> > > > > >> for the server, it would cost me to leave it
> > running
> > > even if
> > > > it
> > > > > didn't run
> > > > > >> jobs between releases.
> > > > > >> >>>>
> > > > > >> >>>> Is that what you are basically
> saying? I
> > think it
> > > might
> > > > be
> > > > > best if
> > > > > >> another committer got a CI server going via
> the MS
> > > donation
> > > > and
> > > > > could leave
> > > > > >> it up 24/7.
> > > > > >> >>>>
> > > > > >> >>>> -Alex
> > > > > >> >>>>
> > > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> > > harbs.lists@gmail.com<ma...@gmail.com>>
> > > > wrote:
> > > > > >> >>>>
> > > > > >> >>>> I’m willing to do this.
> > > > > >> >>>>
> > > > > >> >>>> Considering that the release will be
> run
> > > infrequently, it
> > > > > should be
> > > > > >> doable to have a relatively powerful server
> that
> > could
> > > be
> > > > spun up on
> > > > > >> demand. This is something I have setup for
> my own
> > > releases.
> > > > > >> >>>>
> > > > > >> >>>> The only complication would be that
> each RM
> > would
> > > need
> > > > valid
> > > > > >> credentials to spin up the server.
> > > > > >> >>>>
> > > > > >> >>>> Harbs
> > > > > >> >>>>
> > > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex
> Harui
> > > > > <ah...@adobe.com.INVALID>
> > > > > >> wrote:
> > > > > >> >>>>>
> > > > > >> >>>>> A better solution, IMO, is for
> someone else
> > to
> > > offer up
> > > > a CI
> > > > > server
> > > > > >> only for release jobs.
> > > > > >>
> > > > > >>
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Did you reboot your VM? Also, have you checked what user is running Jenkins on your VM? I think that can sometimes be a problem. I might be running Jenkins as the user.
-Alex
On 4/19/20, 10:01 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
On Sun, Apr 19, 2020 at 9:55 PM Alex Harui <ah...@adobe.com.invalid> wrote:
> Should be here:
>
> https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapacheroyaleci2.westus2.cloudapp.azure.com%3A8080%2FconfigureTools%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=YJq3Ac1xpVWwyQDyFRgYmlcrGXs10W04hhON5QE0%2B90%3D&reserved=0
My git is located in the same exact location as master.
Moreover, the git call from the commandline executes fine. The git call
from ant exec is what is failing.
>
>
> HTH,
> -Alex
>
> From: OmPrakash Muppirala <bi...@gmail.com>
> Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
> Date: Sunday, April 19, 2020 at 9:37 PM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> I'm a bit stumped here. The royale-compiler is failing with this error:
>
>
> BUILD FAILED
>
> c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed:
> java.io.IOException: Cannot run program "git" (in directory
> "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The system
> cannot find the file specified
>
> at java.lang.ProcessBuilder.start(Unknown Source)
>
>
> It is from this part of the jenkins.xml:
>
>
> <target name="closure-lib-download" description="Copies Closure
> Library from GitHub">
> <echo message="Be patient. This takes a few minutes..." />
> <exec executable="git" failifexecutionfails="true">
> <arg value="clone" />
> <arg value="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0<
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=9fgEZdqrtoj75jvA8i0Yi%2FZj6X2rjgIkuShBpIv4Z1I%3D&reserved=0>"
> />
> <arg value="${closure.root}" />
> </exec>
> <echo>Cloned fresh copy of Google Closure Library</echo>
> </target>
>
> I am not sure how this executable call works without the full path.
>
> I checked the env variables, I do have both the git/bin and git/cmd
> directory in the PATH:
>
> [cid:ii_k97zkk9o0]
>
> What am I missing?
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <bigosmallm@gmail.com
> <ma...@gmail.com>> wrote:
> Update - I have successfully attached my VM as a slave agent of our
> Jenkins instance.
> I am going to pull the job - /royale-asjs_jsonly and tie it to my agent so
> I can test it.
>
> It will fail for a sometime while I go set up my VM with all the
> dependencies.
>
> Once we have the job successfully building on my VM, we can figure out how
> to divide the load between the master and agent.
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <bigosmallm@gmail.com
> <ma...@gmail.com>> wrote:
> We could achieve the same by creating a new agent (separate vm) and
> attaching it as a slave to the current Jenkins server.
>
> Then we can use labels/tags to tie release jobs to one agent and non
> release jobs to another agent.
>
> That way we can maintain everything in one UI, one login while achieving
> the concurrent building capabilities we want.
>
> Jenkins is built for this kind of stuff and I think it would be best we
> followed this practice.
>
> Thanks,
> Om
> On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> Om, I thought you were going to get the image from my VM and run it on
> another VM. Then we'd remove all non-release jobs from your VM and all of
> the release jobs from my VM. That won't solve the problem of how long it
> takes for a commit to be built and tested, but will allow the RM to get a
> release out without getting stuck behind the commit jobs. Is that
> currently the plan?
>
> -Alex
>
> On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bigosmallm@gmail.com<mailto:
> bigosmallm@gmail.com>> wrote:
>
> Makes sense to me. I will set parallel executors back to 1.
>
> And start working on a new Jenkins instance.
>
> Thanks,
> Om
>
>
> On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > Are you saying that Java, Ant and Maven do not know how to
> distribute work
> > to different cores?
> >
> > To repeat my main concern: our Jenkins jobs often use shared
> resources.
> > If you want to take the time to fix that, feel free, but I do not
> know how
> > you are going to keep two jobs from both trying to launch Flash
> Player
> > Debugger at the same time and open the same socket to communicate
> with it,
> > or try to parse the flashlog.txt that they have both written to.
> >
> > The royale-asjs job will use the royale-compiler workspace to get the
> > compiler. If the compiler is building, the jars are not there and
> the
> > royale-asjs build fails.
> >
> > There is also only so much memory and some of our jobs use all of it
> and
> > I'm not sure if jobs slowed down due to paging memory and
> writing/reading
> > from disk, even if it is an SSD.
> >
> > I'm done for tonight, but that's what I was seeing last time I tried
> to
> > have both master and an agent running jobs in parallel.
> >
> > Thanks,
> > -Alex
> >
> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> <ma...@gmail.com>> wrote:
> >
> > A typical setup would be to have 0 executors on master and at
> least n
> > number of executors on each agent, where n = number of cpu cores.
> > I see that the current VM has 2 cores. So, I started with
> setting the
> > num
> > executors on the current agent to 2.
> >
> > This should improve things quite a bit. If this doesn't work, I
> will
> > create a new VM and make it the slave agent of the current
> Jenkins
> > master.
> >
> >
> > Thanks,
> > Om
> >
> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > On your VM or mine? I don't think mine can handle it. I used
> to
> > run jobs
> > > of master and agent and we got lots of failures and jobs took
> > forever. If
> > > two jobs are trying to run tests with the shared Flash Player
> > Debugger, for
> > > example, you won't get consistent results.
> > >
> > > -Alex
> > >
> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com<ma...@gmail.com>>
> > wrote:
> > >
> > > I just realized that we have only one Agent (node) listed
> under
> > > Jenkins. I
> > > am going to add at least one more node to start with.
> > >
> > > Thanks,
> > > Om
> > >
> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> > <ah...@adobe.com.invalid>
> > > wrote:
> > >
> > > > I think I followed the instructions and enabled SSH.
> > > >
> > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
> yishayjobs@hotmail.com<ma...@hotmail.com>>
> > wrote:
> > > >
> > > > I haven’t gotten it to work. Could be ssh needs to be
> > enabled on
> > > the
> > > > VM [1]. This is nice to have but not essential. So Alex,
> let
> > me know
> > > if you
> > > > want to try that, otherwise I’ll suspend my efforts on
> this.
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=hB66ZhyhDqOPTp0PTxtPV4kzE2iI3TG9ERJCjkCwSaI%3D&reserved=0
> >
> > > >
> > > > From: Yishay Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> dev@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > I’d like to try and install an ssh server. Can anyone
> > think of a
> > > > reason not to do that? I’m asking in terms of security,
> and if
> > there
> > > might
> > > > be a problem because it’s a VM.
> > > >
> > > > Thanks.
> > > >
> > > > From: Yishay Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Monday, April 13, 2020 10:02 AM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> dev@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > Related, as most (all?) of the instructions don’t
> require
> > > anything but
> > > > a shell wouldn’t it be easier and faster to access the
> machine
> > with
> > > ssh
> > > > [1], rather than using remote desktop?
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003118752&sdata=eaL4SoRKuYDqpNaeLvhnQPiYfTULGYD0JEhBK2mm4a4%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=pkKsiZJqksZGMRqgam8yWQU5q4XB78QVI2hFuJj4hbI%3D&reserved=0
> >
> > > >
> > > > From: Yishay Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Monday, April 13, 2020 9:55 AM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> dev@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > Can’t you do that with remote desktop?
> > > >
> > > > ________________________________
> > > > From: OmPrakash Muppirala <bigosmallm@gmail.com
> <ma...@gmail.com>>
> > > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > > To: Apache Royale Development <dev@royale.apache.org
> <ma...@royale.apache.org>>
> > > > Subject: Re: Prioritize Release Jobs on CI
> > > >
> > > > Alex,
> > > >
> > > > I believe this is your personal Azure subscription
> right?
> > Any
> > > chance
> > > > I can
> > > > get access to it so I can try to copy the image out
> the
> > machine
> > > and
> > > > redeploy it somewhere else?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > > > bigosmallm@gmail.com<ma...@gmail.com>>
> > > > wrote:
> > > >
> > > > > I can help set this up on Azure. Give me some
> time to
> > work
> > > out the
> > > > > details?
> > > > >
> > > > > Thanks,
> > > > > Om
> > > > >
> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> > harbs.lists@gmail.com<ma...@gmail.com>>
> > > wrote:
> > > > >
> > > > >> OK. Good to know.
> > > > >>
> > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >
> > > > >> > FWIW, I just looked and the longest job in the
> release
> > > steps so
> > > > far is
> > > > >> 8 minutes. Most are under 2 minutes. There
> might be
> > jobs
> > > later
> > > > that take
> > > > >> longer that we haven't run yet. IMO, the issue
> isn't
> > speed
> > > of the
> > > > machine,
> > > > >> it is just that we are sharing the machine with
> longer
> > jobs
> > > (1 hour
> > > > for
> > > > >> TourDeFlexMigration). And again, the machine
> will be
> > idle for
> > > > stretches of
> > > > >> time while the RM verifies artifacts after each
> step.
> > > > >> >
> > > > >> > -Alex
> > > > >> >
> > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
> harbs.lists@gmail.com<ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>> wrote:
> > > > >> >
> > > > >> > Fair enough.
> > > > >> >
> > > > >> > I expect builds to be somewhere between 10
> and 20
> > times
> > > faster
> > > > on a
> > > > >> powerful machine.
> > > > >> >
> > > > >> > Yeah. It’s probably going to be a bit of work
> > changing
> > > the
> > > > server,
> > > > >> but probably worth it in the long run.
> > > > >> >
> > > > >> > I think I’ll try this when I do the next
> release
> > unless
> > > Yishay
> > > > wants
> > > > >> to work with me on this for this release — but
> I’m not
> > going
> > > to be
> > > > able to
> > > > >> help until after Passover (i.e. next week).
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Harbs
> > > > >> >
> > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >>
> > > > >> >> The Azure portal says: Standard F2s_v2 (2
> vcpus, 4
> > GiB
> > > memory)
> > > > >> >>
> > > > >> >> I think I am reading changes to the build
> process in
> > your
> > > > >> suggestions. I do not really want to spend more
> of my
> > time
> > > on this
> > > > >> process. But if you want to do the work, that's
> fine
> > with me.
> > > > >> >>
> > > > >> >> -Alex
> > > > >> >>
> > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
> harbs.lists@gmail.com<ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>
> > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>>> wrote:
> > > > >> >>
> > > > >> >> What kind of horsepower is included in the
> free
> > Azure
> > > account?
> > > > >> >>
> > > > >> >> The server I mentioned builds (considerably)
> > faster than
> > > my own
> > > > >> local machine. The ci server seems to build many
> times
> > slower.
> > > > >> >>
> > > > >> >> One thing we can do to minimize running
> server time
> > > would be to
> > > > >> transfer the artifacts to storage instead of
> keeping
> > them on
> > > the
> > > > server. On
> > > > >> AWS, I’d probably use S3. Not sure what the
> similar
> > service on
> > > > Azure is
> > > > >> called.
> > > > >> >>
> > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > > <aharui@adobe.com.INVALID
> > > > >> <mailto:aharui@adobe.com.INVALID<mailto:
> aharui@adobe.com.INVALID>>> wrote:
> > > > >> >>>
> > > > >> >>> OK, that's pretty much how I understand Azure
> as
> > well.
> > > The key
> > > > thing
> > > > >> is that "running" includes time where the CI
> server is
> > not
> > > running
> > > > any
> > > > >> Jenkins jobs. The CI Server steps might take
> only a few
> > > hours of
> > > > actual
> > > > >> server time, but there is time where the RM is
> verifying
> > > artifacts
> > > > locally
> > > > >> so you'd be paying for that or the RM would have
> to keep
> > > shutting
> > > > down and
> > > > >> restarting.
> > > > >> >>>
> > > > >> >>> Seems like it would be cheaper/simpler to get
> the
> > free
> > > MSDN
> > > > account
> > > > >> and leave it running.
> > > > >> >>>
> > > > >> >>> -Alex
> > > > >> >>>
> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> > harbs.lists@gmail.com<ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>> wrote:
> > > > >> >>>
> > > > >> >>> My experience is with AWS.
> > > > >> >>>
> > > > >> >>> I assume Microsoft has similar offerings,
> but I
> > don’t
> > > have
> > > > >> experience with Azure.
> > > > >> >>>
> > > > >> >>> AWS has on-demand EC2 instances which you
> pay for
> > only
> > > the
> > > > actual
> > > > >> time that they are running.[1]
> > > > >> >>>
> > > > >> >>> Instances can be started and stopped via
> command
> > line
> > > (or via
> > > > the
> > > > >> web interface) as long as you have valid
> credentials to
> > do so.
> > > > >> >>>
> > > > >> >>> For example: an m5.4xlarge instance has 16
> cores
> > and
> > > costs
> > > > about
> > > > >> $1.5 per hour. On a machine like that, a full
> build
> > would
> > > probably
> > > > take
> > > > >> less than 10 minutes. It’s probably possible to
> do a
> > full
> > > release
> > > > with only
> > > > >> a few hours of server time.
> > > > >> >>>
> > > > >> >>> Leaving a server like that running all the
> time
> > would get
> > > > expensive,
> > > > >> but if it’s just spun up for releases, you’d get
> very
> > fast
> > > builds
> > > > at a
> > > > >> reasonable price.
> > > > >> >>>
> > > > >> >>> I’d be happy to pay $10-$50 (and possibly
> more) per
> > > release to
> > > > make
> > > > >> the release process painless for the RM.
> > > > >> >>>
> > > > >> >>> [1]
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> >
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003128743&sdata=iT0SjMYkQ7EQY7jG2fwkz%2Bjh%2FWTSXdnzALBAeyooXz0%3D&reserved=0
> >
> > > > >> >><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> >
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce57b89ef99cd486fd83508d7e4e7e84d%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229557003138737&sdata=lYoWGyhdvlZ4Z0Qgoap%2FgDxOwlHgEtu6r9gwxVCSfg4%3D&reserved=0
> >
> > > > >> >>>
> > > > >> >>>
> > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>
> > > > >> >>>> I'm not very experienced with spinning up
> > servers. The
> > > CI
> > > > server we
> > > > >> are using is effectively free, based on a generous
> > donation
> > > from
> > > > Microsoft
> > > > >> of MSDN accounts to ASF committers. So I leave
> it up
> > 24/7,
> > > and
> > > > share the
> > > > >> RDP access on private@. I think any other ASF
> > committer
> > > could do
> > > > the
> > > > >> same. IIRC, if that server actually is stopped,
> I have
> > to
> > > use my
> > > > personal
> > > > >> (unshared) MSDN credentials to start it again.
> AIUI,
> > if I
> > > > actually paid
> > > > >> for the server, it would cost me to leave it
> running
> > even if
> > > it
> > > > didn't run
> > > > >> jobs between releases.
> > > > >> >>>>
> > > > >> >>>> Is that what you are basically saying? I
> think it
> > might
> > > be
> > > > best if
> > > > >> another committer got a CI server going via the MS
> > donation
> > > and
> > > > could leave
> > > > >> it up 24/7.
> > > > >> >>>>
> > > > >> >>>> -Alex
> > > > >> >>>>
> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> > harbs.lists@gmail.com<ma...@gmail.com>>
> > > wrote:
> > > > >> >>>>
> > > > >> >>>> I’m willing to do this.
> > > > >> >>>>
> > > > >> >>>> Considering that the release will be run
> > infrequently, it
> > > > should be
> > > > >> doable to have a relatively powerful server that
> could
> > be
> > > spun up on
> > > > >> demand. This is something I have setup for my own
> > releases.
> > > > >> >>>>
> > > > >> >>>> The only complication would be that each RM
> would
> > need
> > > valid
> > > > >> credentials to spin up the server.
> > > > >> >>>>
> > > > >> >>>> Harbs
> > > > >> >>>>
> > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>>
> > > > >> >>>>> A better solution, IMO, is for someone else
> to
> > offer up
> > > a CI
> > > > server
> > > > >> only for release jobs.
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
On Sun, Apr 19, 2020 at 9:55 PM Alex Harui <ah...@adobe.com.invalid> wrote:
> Should be here:
>
> http://apacheroyaleci2.westus2.cloudapp.azure.com:8080/configureTools/
My git is located in the same exact location as master.
Moreover, the git call from the commandline executes fine. The git call
from ant exec is what is failing.
>
>
> HTH,
> -Alex
>
> From: OmPrakash Muppirala <bi...@gmail.com>
> Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
> Date: Sunday, April 19, 2020 at 9:37 PM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> I'm a bit stumped here. The royale-compiler is failing with this error:
>
>
> BUILD FAILED
>
> c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed:
> java.io.IOException: Cannot run program "git" (in directory
> "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The system
> cannot find the file specified
>
> at java.lang.ProcessBuilder.start(Unknown Source)
>
>
> It is from this part of the jenkins.xml:
>
>
> <target name="closure-lib-download" description="Copies Closure
> Library from GitHub">
> <echo message="Be patient. This takes a few minutes..." />
> <exec executable="git" failifexecutionfails="true">
> <arg value="clone" />
> <arg value="https://github.com/google/closure-library<
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364320116&sdata=yH8RnSomTWYMU5qKf%2FnQhztdjHhVRIb%2BdtmaU6cIUzQ%3D&reserved=0>"
> />
> <arg value="${closure.root}" />
> </exec>
> <echo>Cloned fresh copy of Google Closure Library</echo>
> </target>
>
> I am not sure how this executable call works without the full path.
>
> I checked the env variables, I do have both the git/bin and git/cmd
> directory in the PATH:
>
> [cid:ii_k97zkk9o0]
>
> What am I missing?
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <bigosmallm@gmail.com
> <ma...@gmail.com>> wrote:
> Update - I have successfully attached my VM as a slave agent of our
> Jenkins instance.
> I am going to pull the job - /royale-asjs_jsonly and tie it to my agent so
> I can test it.
>
> It will fail for a sometime while I go set up my VM with all the
> dependencies.
>
> Once we have the job successfully building on my VM, we can figure out how
> to divide the load between the master and agent.
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <bigosmallm@gmail.com
> <ma...@gmail.com>> wrote:
> We could achieve the same by creating a new agent (separate vm) and
> attaching it as a slave to the current Jenkins server.
>
> Then we can use labels/tags to tie release jobs to one agent and non
> release jobs to another agent.
>
> That way we can maintain everything in one UI, one login while achieving
> the concurrent building capabilities we want.
>
> Jenkins is built for this kind of stuff and I think it would be best we
> followed this practice.
>
> Thanks,
> Om
> On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> Om, I thought you were going to get the image from my VM and run it on
> another VM. Then we'd remove all non-release jobs from your VM and all of
> the release jobs from my VM. That won't solve the problem of how long it
> takes for a commit to be built and tested, but will allow the RM to get a
> release out without getting stuck behind the commit jobs. Is that
> currently the plan?
>
> -Alex
>
> On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bigosmallm@gmail.com<mailto:
> bigosmallm@gmail.com>> wrote:
>
> Makes sense to me. I will set parallel executors back to 1.
>
> And start working on a new Jenkins instance.
>
> Thanks,
> Om
>
>
> On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > Are you saying that Java, Ant and Maven do not know how to
> distribute work
> > to different cores?
> >
> > To repeat my main concern: our Jenkins jobs often use shared
> resources.
> > If you want to take the time to fix that, feel free, but I do not
> know how
> > you are going to keep two jobs from both trying to launch Flash
> Player
> > Debugger at the same time and open the same socket to communicate
> with it,
> > or try to parse the flashlog.txt that they have both written to.
> >
> > The royale-asjs job will use the royale-compiler workspace to get the
> > compiler. If the compiler is building, the jars are not there and
> the
> > royale-asjs build fails.
> >
> > There is also only so much memory and some of our jobs use all of it
> and
> > I'm not sure if jobs slowed down due to paging memory and
> writing/reading
> > from disk, even if it is an SSD.
> >
> > I'm done for tonight, but that's what I was seeing last time I tried
> to
> > have both master and an agent running jobs in parallel.
> >
> > Thanks,
> > -Alex
> >
> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bigosmallm@gmail.com
> <ma...@gmail.com>> wrote:
> >
> > A typical setup would be to have 0 executors on master and at
> least n
> > number of executors on each agent, where n = number of cpu cores.
> > I see that the current VM has 2 cores. So, I started with
> setting the
> > num
> > executors on the current agent to 2.
> >
> > This should improve things quite a bit. If this doesn't work, I
> will
> > create a new VM and make it the slave agent of the current
> Jenkins
> > master.
> >
> >
> > Thanks,
> > Om
> >
> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > On your VM or mine? I don't think mine can handle it. I used
> to
> > run jobs
> > > of master and agent and we got lots of failures and jobs took
> > forever. If
> > > two jobs are trying to run tests with the shared Flash Player
> > Debugger, for
> > > example, you won't get consistent results.
> > >
> > > -Alex
> > >
> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com<ma...@gmail.com>>
> > wrote:
> > >
> > > I just realized that we have only one Agent (node) listed
> under
> > > Jenkins. I
> > > am going to add at least one more node to start with.
> > >
> > > Thanks,
> > > Om
> > >
> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> > <ah...@adobe.com.invalid>
> > > wrote:
> > >
> > > > I think I followed the instructions and enabled SSH.
> > > >
> > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
> yishayjobs@hotmail.com<ma...@hotmail.com>>
> > wrote:
> > > >
> > > > I haven’t gotten it to work. Could be ssh needs to be
> > enabled on
> > > the
> > > > VM [1]. This is nice to have but not essential. So Alex,
> let
> > me know
> > > if you
> > > > want to try that, otherwise I’ll suspend my efforts on
> this.
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364330112&sdata=7px%2Fi%2FK64cMzUmtgJXgLikG3iBXXpmp1LT6YZmZk%2FpU%3D&reserved=0
> >
> > > >
> > > > From: Yishay Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> dev@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > I’d like to try and install an ssh server. Can anyone
> > think of a
> > > > reason not to do that? I’m asking in terms of security,
> and if
> > there
> > > might
> > > > be a problem because it’s a VM.
> > > >
> > > > Thanks.
> > > >
> > > > From: Yishay Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Monday, April 13, 2020 10:02 AM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> dev@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > Related, as most (all?) of the instructions don’t
> require
> > > anything but
> > > > a shell wouldn’t it be easier and faster to access the
> machine
> > with
> > > ssh
> > > > [1], rather than using remote desktop?
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364340114&sdata=wefrwBy0B5PnAklSrSYqF5VzRtCXYOmV70vGipgK%2B%2F4%3D&reserved=0
> >
> > > >
> > > > From: Yishay Weiss<mailto:yishayjobs@hotmail.com
> <ma...@hotmail.com>>
> > > > Sent: Monday, April 13, 2020 9:55 AM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org><mailto:dev@royale.apache.org<mailto:
> dev@royale.apache.org>>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > Can’t you do that with remote desktop?
> > > >
> > > > ________________________________
> > > > From: OmPrakash Muppirala <bigosmallm@gmail.com
> <ma...@gmail.com>>
> > > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > > To: Apache Royale Development <dev@royale.apache.org
> <ma...@royale.apache.org>>
> > > > Subject: Re: Prioritize Release Jobs on CI
> > > >
> > > > Alex,
> > > >
> > > > I believe this is your personal Azure subscription
> right?
> > Any
> > > chance
> > > > I can
> > > > get access to it so I can try to copy the image out
> the
> > machine
> > > and
> > > > redeploy it somewhere else?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > > > bigosmallm@gmail.com<ma...@gmail.com>>
> > > > wrote:
> > > >
> > > > > I can help set this up on Azure. Give me some
> time to
> > work
> > > out the
> > > > > details?
> > > > >
> > > > > Thanks,
> > > > > Om
> > > > >
> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> > harbs.lists@gmail.com<ma...@gmail.com>>
> > > wrote:
> > > > >
> > > > >> OK. Good to know.
> > > > >>
> > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >
> > > > >> > FWIW, I just looked and the longest job in the
> release
> > > steps so
> > > > far is
> > > > >> 8 minutes. Most are under 2 minutes. There
> might be
> > jobs
> > > later
> > > > that take
> > > > >> longer that we haven't run yet. IMO, the issue
> isn't
> > speed
> > > of the
> > > > machine,
> > > > >> it is just that we are sharing the machine with
> longer
> > jobs
> > > (1 hour
> > > > for
> > > > >> TourDeFlexMigration). And again, the machine
> will be
> > idle for
> > > > stretches of
> > > > >> time while the RM verifies artifacts after each
> step.
> > > > >> >
> > > > >> > -Alex
> > > > >> >
> > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
> harbs.lists@gmail.com<ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>> wrote:
> > > > >> >
> > > > >> > Fair enough.
> > > > >> >
> > > > >> > I expect builds to be somewhere between 10
> and 20
> > times
> > > faster
> > > > on a
> > > > >> powerful machine.
> > > > >> >
> > > > >> > Yeah. It’s probably going to be a bit of work
> > changing
> > > the
> > > > server,
> > > > >> but probably worth it in the long run.
> > > > >> >
> > > > >> > I think I’ll try this when I do the next
> release
> > unless
> > > Yishay
> > > > wants
> > > > >> to work with me on this for this release — but
> I’m not
> > going
> > > to be
> > > > able to
> > > > >> help until after Passover (i.e. next week).
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Harbs
> > > > >> >
> > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >>
> > > > >> >> The Azure portal says: Standard F2s_v2 (2
> vcpus, 4
> > GiB
> > > memory)
> > > > >> >>
> > > > >> >> I think I am reading changes to the build
> process in
> > your
> > > > >> suggestions. I do not really want to spend more
> of my
> > time
> > > on this
> > > > >> process. But if you want to do the work, that's
> fine
> > with me.
> > > > >> >>
> > > > >> >> -Alex
> > > > >> >>
> > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
> harbs.lists@gmail.com<ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>> <mailto:harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>
> > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>>> wrote:
> > > > >> >>
> > > > >> >> What kind of horsepower is included in the
> free
> > Azure
> > > account?
> > > > >> >>
> > > > >> >> The server I mentioned builds (considerably)
> > faster than
> > > my own
> > > > >> local machine. The ci server seems to build many
> times
> > slower.
> > > > >> >>
> > > > >> >> One thing we can do to minimize running
> server time
> > > would be to
> > > > >> transfer the artifacts to storage instead of
> keeping
> > them on
> > > the
> > > > server. On
> > > > >> AWS, I’d probably use S3. Not sure what the
> similar
> > service on
> > > > Azure is
> > > > >> called.
> > > > >> >>
> > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > > <aharui@adobe.com.INVALID
> > > > >> <mailto:aharui@adobe.com.INVALID<mailto:
> aharui@adobe.com.INVALID>>> wrote:
> > > > >> >>>
> > > > >> >>> OK, that's pretty much how I understand Azure
> as
> > well.
> > > The key
> > > > thing
> > > > >> is that "running" includes time where the CI
> server is
> > not
> > > running
> > > > any
> > > > >> Jenkins jobs. The CI Server steps might take
> only a few
> > > hours of
> > > > actual
> > > > >> server time, but there is time where the RM is
> verifying
> > > artifacts
> > > > locally
> > > > >> so you'd be paying for that or the RM would have
> to keep
> > > shutting
> > > > down and
> > > > >> restarting.
> > > > >> >>>
> > > > >> >>> Seems like it would be cheaper/simpler to get
> the
> > free
> > > MSDN
> > > > account
> > > > >> and leave it running.
> > > > >> >>>
> > > > >> >>> -Alex
> > > > >> >>>
> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> > harbs.lists@gmail.com<ma...@gmail.com>
> > > <mailto:
> > > > >> harbs.lists@gmail.com<mailto:
> harbs.lists@gmail.com>>> wrote:
> > > > >> >>>
> > > > >> >>> My experience is with AWS.
> > > > >> >>>
> > > > >> >>> I assume Microsoft has similar offerings,
> but I
> > don’t
> > > have
> > > > >> experience with Azure.
> > > > >> >>>
> > > > >> >>> AWS has on-demand EC2 instances which you
> pay for
> > only
> > > the
> > > > actual
> > > > >> time that they are running.[1]
> > > > >> >>>
> > > > >> >>> Instances can be started and stopped via
> command
> > line
> > > (or via
> > > > the
> > > > >> web interface) as long as you have valid
> credentials to
> > do so.
> > > > >> >>>
> > > > >> >>> For example: an m5.4xlarge instance has 16
> cores
> > and
> > > costs
> > > > about
> > > > >> $1.5 per hour. On a machine like that, a full
> build
> > would
> > > probably
> > > > take
> > > > >> less than 10 minutes. It’s probably possible to
> do a
> > full
> > > release
> > > > with only
> > > > >> a few hours of server time.
> > > > >> >>>
> > > > >> >>> Leaving a server like that running all the
> time
> > would get
> > > > expensive,
> > > > >> but if it’s just spun up for releases, you’d get
> very
> > fast
> > > builds
> > > > at a
> > > > >> reasonable price.
> > > > >> >>>
> > > > >> >>> I’d be happy to pay $10-$50 (and possibly
> more) per
> > > release to
> > > > make
> > > > >> the release process painless for the RM.
> > > > >> >>>
> > > > >> >>> [1]
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364340114&sdata=41K%2BATYi7LVVlRri0xuMXsyxGTcbKZ25kNwwkZvuBjE%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364350105&sdata=gZiMiKr%2BHVB2nZ%2B%2Fc5800BhJU0qZJdBKOci8VHBX4iM%3D&reserved=0
> >
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364360099&sdata=FOiH4WuVekfyBUwXcJMTTV5BTli4R3XObAAR5aQy90Y%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364360099&sdata=FOiH4WuVekfyBUwXcJMTTV5BTli4R3XObAAR5aQy90Y%3D&reserved=0
> >
> > > > >> >><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364370100&sdata=daWwHVoCUnh%2BFJluzPj1CFre8b1SdwTYvGAM1ag2EZc%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364370100&sdata=daWwHVoCUnh%2BFJluzPj1CFre8b1SdwTYvGAM1ag2EZc%3D&reserved=0
> >
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364380093&sdata=FUO4FFIy4h6Y793ePdbcnEoR4sV%2FnjHfnIWX1M0tcyg%3D&reserved=0
> >
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364390094&sdata=04q6yASC3OU6KPZ9ROXkDV0taI9D%2FG1EKoKcdPj7tAs%3D&reserved=0
> >
> > > > >> >>>
> > > > >> >>>
> > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>
> > > > >> >>>> I'm not very experienced with spinning up
> > servers. The
> > > CI
> > > > server we
> > > > >> are using is effectively free, based on a generous
> > donation
> > > from
> > > > Microsoft
> > > > >> of MSDN accounts to ASF committers. So I leave
> it up
> > 24/7,
> > > and
> > > > share the
> > > > >> RDP access on private@. I think any other ASF
> > committer
> > > could do
> > > > the
> > > > >> same. IIRC, if that server actually is stopped,
> I have
> > to
> > > use my
> > > > personal
> > > > >> (unshared) MSDN credentials to start it again.
> AIUI,
> > if I
> > > > actually paid
> > > > >> for the server, it would cost me to leave it
> running
> > even if
> > > it
> > > > didn't run
> > > > >> jobs between releases.
> > > > >> >>>>
> > > > >> >>>> Is that what you are basically saying? I
> think it
> > might
> > > be
> > > > best if
> > > > >> another committer got a CI server going via the MS
> > donation
> > > and
> > > > could leave
> > > > >> it up 24/7.
> > > > >> >>>>
> > > > >> >>>> -Alex
> > > > >> >>>>
> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> > harbs.lists@gmail.com<ma...@gmail.com>>
> > > wrote:
> > > > >> >>>>
> > > > >> >>>> I’m willing to do this.
> > > > >> >>>>
> > > > >> >>>> Considering that the release will be run
> > infrequently, it
> > > > should be
> > > > >> doable to have a relatively powerful server that
> could
> > be
> > > spun up on
> > > > >> demand. This is something I have setup for my own
> > releases.
> > > > >> >>>>
> > > > >> >>>> The only complication would be that each RM
> would
> > need
> > > valid
> > > > >> credentials to spin up the server.
> > > > >> >>>>
> > > > >> >>>> Harbs
> > > > >> >>>>
> > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>>
> > > > >> >>>>> A better solution, IMO, is for someone else
> to
> > offer up
> > > a CI
> > > > server
> > > > >> only for release jobs.
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Should be here:
http://apacheroyaleci2.westus2.cloudapp.azure.com:8080/configureTools/
HTH,
-Alex
From: OmPrakash Muppirala <bi...@gmail.com>
Reply-To: "dev@royale.apache.org" <de...@royale.apache.org>
Date: Sunday, April 19, 2020 at 9:37 PM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
I'm a bit stumped here. The royale-compiler is failing with this error:
BUILD FAILED
c:\jenkins\workspace\royale-compiler\jenkins.xml:55: Execute failed: java.io.IOException: Cannot run program "git" (in directory "c:\jenkins\workspace\royale-compiler"): CreateProcess error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(Unknown Source)
It is from this part of the jenkins.xml:
<target name="closure-lib-download" description="Copies Closure Library from GitHub">
<echo message="Be patient. This takes a few minutes..." />
<exec executable="git" failifexecutionfails="true">
<arg value="clone" />
<arg value="https://github.com/google/closure-library<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fgoogle%2Fclosure-library&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364320116&sdata=yH8RnSomTWYMU5qKf%2FnQhztdjHhVRIb%2BdtmaU6cIUzQ%3D&reserved=0>" />
<arg value="${closure.root}" />
</exec>
<echo>Cloned fresh copy of Google Closure Library</echo>
</target>
I am not sure how this executable call works without the full path.
I checked the env variables, I do have both the git/bin and git/cmd directory in the PATH:
[cid:ii_k97zkk9o0]
What am I missing?
Thanks,
Om
On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <bi...@gmail.com>> wrote:
Update - I have successfully attached my VM as a slave agent of our Jenkins instance.
I am going to pull the job - /royale-asjs_jsonly and tie it to my agent so I can test it.
It will fail for a sometime while I go set up my VM with all the dependencies.
Once we have the job successfully building on my VM, we can figure out how to divide the load between the master and agent.
Thanks,
Om
On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <bi...@gmail.com>> wrote:
We could achieve the same by creating a new agent (separate vm) and attaching it as a slave to the current Jenkins server.
Then we can use labels/tags to tie release jobs to one agent and non release jobs to another agent.
That way we can maintain everything in one UI, one login while achieving the concurrent building capabilities we want.
Jenkins is built for this kind of stuff and I think it would be best we followed this practice.
Thanks,
Om
On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid> wrote:
Om, I thought you were going to get the image from my VM and run it on another VM. Then we'd remove all non-release jobs from your VM and all of the release jobs from my VM. That won't solve the problem of how long it takes for a commit to be built and tested, but will allow the RM to get a release out without getting stuck behind the commit jobs. Is that currently the plan?
-Alex
On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bi...@gmail.com>> wrote:
Makes sense to me. I will set parallel executors back to 1.
And start working on a new Jenkins instance.
Thanks,
Om
On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> Are you saying that Java, Ant and Maven do not know how to distribute work
> to different cores?
>
> To repeat my main concern: our Jenkins jobs often use shared resources.
> If you want to take the time to fix that, feel free, but I do not know how
> you are going to keep two jobs from both trying to launch Flash Player
> Debugger at the same time and open the same socket to communicate with it,
> or try to parse the flashlog.txt that they have both written to.
>
> The royale-asjs job will use the royale-compiler workspace to get the
> compiler. If the compiler is building, the jars are not there and the
> royale-asjs build fails.
>
> There is also only so much memory and some of our jobs use all of it and
> I'm not sure if jobs slowed down due to paging memory and writing/reading
> from disk, even if it is an SSD.
>
> I'm done for tonight, but that's what I was seeing last time I tried to
> have both master and an agent running jobs in parallel.
>
> Thanks,
> -Alex
>
> On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com>> wrote:
>
> A typical setup would be to have 0 executors on master and at least n
> number of executors on each agent, where n = number of cpu cores.
> I see that the current VM has 2 cores. So, I started with setting the
> num
> executors on the current agent to 2.
>
> This should improve things quite a bit. If this doesn't work, I will
> create a new VM and make it the slave agent of the current Jenkins
> master.
>
>
> Thanks,
> Om
>
> On Fri, Apr 17, 2020 at 11:31 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > On your VM or mine? I don't think mine can handle it. I used to
> run jobs
> > of master and agent and we got lots of failures and jobs took
> forever. If
> > two jobs are trying to run tests with the shared Flash Player
> Debugger, for
> > example, you won't get consistent results.
> >
> > -Alex
> >
> > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <bi...@gmail.com>>
> wrote:
> >
> > I just realized that we have only one Agent (node) listed under
> > Jenkins. I
> > am going to add at least one more node to start with.
> >
> > Thanks,
> > Om
> >
> > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > I think I followed the instructions and enabled SSH.
> > >
> > > On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com>>
> wrote:
> > >
> > > I haven’t gotten it to work. Could be ssh needs to be
> enabled on
> > the
> > > VM [1]. This is nice to have but not essential. So Alex, let
> me know
> > if you
> > > want to try that, otherwise I’ll suspend my efforts on this.
> > >
> > > [1]
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364330112&sdata=7px%2Fi%2FK64cMzUmtgJXgLikG3iBXXpmp1LT6YZmZk%2FpU%3D&reserved=0>
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>>
> > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > I’d like to try and install an ssh server. Can anyone
> think of a
> > > reason not to do that? I’m asking in terms of security, and if
> there
> > might
> > > be a problem because it’s a VM.
> > >
> > > Thanks.
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>>
> > > Sent: Monday, April 13, 2020 10:02 AM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > Related, as most (all?) of the instructions don’t require
> > anything but
> > > a shell wouldn’t it be easier and faster to access the machine
> with
> > ssh
> > > [1], rather than using remote desktop?
> > >
> > > [1]
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364340114&sdata=wefrwBy0B5PnAklSrSYqF5VzRtCXYOmV70vGipgK%2B%2F4%3D&reserved=0>
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>>
> > > Sent: Monday, April 13, 2020 9:55 AM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > Can’t you do that with remote desktop?
> > >
> > > ________________________________
> > > From: OmPrakash Muppirala <bi...@gmail.com>>
> > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > To: Apache Royale Development <de...@royale.apache.org>>
> > > Subject: Re: Prioritize Release Jobs on CI
> > >
> > > Alex,
> > >
> > > I believe this is your personal Azure subscription right?
> Any
> > chance
> > > I can
> > > get access to it so I can try to copy the image out the
> machine
> > and
> > > redeploy it somewhere else?
> > >
> > > Thanks,
> > > Om
> > >
> > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > > bigosmallm@gmail.com<ma...@gmail.com>>
> > > wrote:
> > >
> > > > I can help set this up on Azure. Give me some time to
> work
> > out the
> > > > details?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> harbs.lists@gmail.com<ma...@gmail.com>>
> > wrote:
> > > >
> > > >> OK. Good to know.
> > > >>
> > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > > >
> > > >> wrote:
> > > >> >
> > > >> > FWIW, I just looked and the longest job in the release
> > steps so
> > > far is
> > > >> 8 minutes. Most are under 2 minutes. There might be
> jobs
> > later
> > > that take
> > > >> longer that we haven't run yet. IMO, the issue isn't
> speed
> > of the
> > > machine,
> > > >> it is just that we are sharing the machine with longer
> jobs
> > (1 hour
> > > for
> > > >> TourDeFlexMigration). And again, the machine will be
> idle for
> > > stretches of
> > > >> time while the RM verifies artifacts after each step.
> > > >> >
> > > >> > -Alex
> > > >> >
> > > >> > On 4/12/20, 11:32 AM, "Harbs" <ha...@gmail.com>
> > <mailto:
> > > >> harbs.lists@gmail.com<ma...@gmail.com>>> wrote:
> > > >> >
> > > >> > Fair enough.
> > > >> >
> > > >> > I expect builds to be somewhere between 10 and 20
> times
> > faster
> > > on a
> > > >> powerful machine.
> > > >> >
> > > >> > Yeah. It’s probably going to be a bit of work
> changing
> > the
> > > server,
> > > >> but probably worth it in the long run.
> > > >> >
> > > >> > I think I’ll try this when I do the next release
> unless
> > Yishay
> > > wants
> > > >> to work with me on this for this release — but I’m not
> going
> > to be
> > > able to
> > > >> help until after Passover (i.e. next week).
> > > >> >
> > > >> > Thanks,
> > > >> > Harbs
> > > >> >
> > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > > >
> > > >> wrote:
> > > >> >>
> > > >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4
> GiB
> > memory)
> > > >> >>
> > > >> >> I think I am reading changes to the build process in
> your
> > > >> suggestions. I do not really want to spend more of my
> time
> > on this
> > > >> process. But if you want to do the work, that's fine
> with me.
> > > >> >>
> > > >> >> -Alex
> > > >> >>
> > > >> >> On 4/12/20, 10:57 AM, "Harbs" <ha...@gmail.com>
> > <mailto:
> > > >> harbs.lists@gmail.com<ma...@gmail.com>> <ma...@gmail.com>
> <mailto:
> > > >> harbs.lists@gmail.com<ma...@gmail.com>>>> wrote:
> > > >> >>
> > > >> >> What kind of horsepower is included in the free
> Azure
> > account?
> > > >> >>
> > > >> >> The server I mentioned builds (considerably)
> faster than
> > my own
> > > >> local machine. The ci server seems to build many times
> slower.
> > > >> >>
> > > >> >> One thing we can do to minimize running server time
> > would be to
> > > >> transfer the artifacts to storage instead of keeping
> them on
> > the
> > > server. On
> > > >> AWS, I’d probably use S3. Not sure what the similar
> service on
> > > Azure is
> > > >> called.
> > > >> >>
> > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > >> <ma...@adobe.com.INVALID>>> wrote:
> > > >> >>>
> > > >> >>> OK, that's pretty much how I understand Azure as
> well.
> > The key
> > > thing
> > > >> is that "running" includes time where the CI server is
> not
> > running
> > > any
> > > >> Jenkins jobs. The CI Server steps might take only a few
> > hours of
> > > actual
> > > >> server time, but there is time where the RM is verifying
> > artifacts
> > > locally
> > > >> so you'd be paying for that or the RM would have to keep
> > shutting
> > > down and
> > > >> restarting.
> > > >> >>>
> > > >> >>> Seems like it would be cheaper/simpler to get the
> free
> > MSDN
> > > account
> > > >> and leave it running.
> > > >> >>>
> > > >> >>> -Alex
> > > >> >>>
> > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> harbs.lists@gmail.com<ma...@gmail.com>
> > <mailto:
> > > >> harbs.lists@gmail.com<ma...@gmail.com>>> wrote:
> > > >> >>>
> > > >> >>> My experience is with AWS.
> > > >> >>>
> > > >> >>> I assume Microsoft has similar offerings, but I
> don’t
> > have
> > > >> experience with Azure.
> > > >> >>>
> > > >> >>> AWS has on-demand EC2 instances which you pay for
> only
> > the
> > > actual
> > > >> time that they are running.[1]
> > > >> >>>
> > > >> >>> Instances can be started and stopped via command
> line
> > (or via
> > > the
> > > >> web interface) as long as you have valid credentials to
> do so.
> > > >> >>>
> > > >> >>> For example: an m5.4xlarge instance has 16 cores
> and
> > costs
> > > about
> > > >> $1.5 per hour. On a machine like that, a full build
> would
> > probably
> > > take
> > > >> less than 10 minutes. It’s probably possible to do a
> full
> > release
> > > with only
> > > >> a few hours of server time.
> > > >> >>>
> > > >> >>> Leaving a server like that running all the time
> would get
> > > expensive,
> > > >> but if it’s just spun up for releases, you’d get very
> fast
> > builds
> > > at a
> > > >> reasonable price.
> > > >> >>>
> > > >> >>> I’d be happy to pay $10-$50 (and possibly more) per
> > release to
> > > make
> > > >> the release process painless for the RM.
> > > >> >>>
> > > >> >>> [1]
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364340114&sdata=41K%2BATYi7LVVlRri0xuMXsyxGTcbKZ25kNwwkZvuBjE%3D&reserved=0>
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364350105&sdata=gZiMiKr%2BHVB2nZ%2B%2Fc5800BhJU0qZJdBKOci8VHBX4iM%3D&reserved=0>
> > > >> ><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364360099&sdata=FOiH4WuVekfyBUwXcJMTTV5BTli4R3XObAAR5aQy90Y%3D&reserved=0>
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364360099&sdata=FOiH4WuVekfyBUwXcJMTTV5BTli4R3XObAAR5aQy90Y%3D&reserved=0>
> > > >> >><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364370100&sdata=daWwHVoCUnh%2BFJluzPj1CFre8b1SdwTYvGAM1ag2EZc%3D&reserved=0>
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364370100&sdata=daWwHVoCUnh%2BFJluzPj1CFre8b1SdwTYvGAM1ag2EZc%3D&reserved=0>
> > > >> ><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364380093&sdata=FUO4FFIy4h6Y793ePdbcnEoR4sV%2FnjHfnIWX1M0tcyg%3D&reserved=0>
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C0dd5709b5c23458c5f0508d7e4e47f47%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637229542364390094&sdata=04q6yASC3OU6KPZ9ROXkDV0taI9D%2FG1EKoKcdPj7tAs%3D&reserved=0>
> > > >> >>>
> > > >> >>>
> > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > <ah...@adobe.com.INVALID>
> > > >> wrote:
> > > >> >>>>
> > > >> >>>> I'm not very experienced with spinning up
> servers. The
> > CI
> > > server we
> > > >> are using is effectively free, based on a generous
> donation
> > from
> > > Microsoft
> > > >> of MSDN accounts to ASF committers. So I leave it up
> 24/7,
> > and
> > > share the
> > > >> RDP access on private@. I think any other ASF
> committer
> > could do
> > > the
> > > >> same. IIRC, if that server actually is stopped, I have
> to
> > use my
> > > personal
> > > >> (unshared) MSDN credentials to start it again. AIUI,
> if I
> > > actually paid
> > > >> for the server, it would cost me to leave it running
> even if
> > it
> > > didn't run
> > > >> jobs between releases.
> > > >> >>>>
> > > >> >>>> Is that what you are basically saying? I think it
> might
> > be
> > > best if
> > > >> another committer got a CI server going via the MS
> donation
> > and
> > > could leave
> > > >> it up 24/7.
> > > >> >>>>
> > > >> >>>> -Alex
> > > >> >>>>
> > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> harbs.lists@gmail.com<ma...@gmail.com>>
> > wrote:
> > > >> >>>>
> > > >> >>>> I’m willing to do this.
> > > >> >>>>
> > > >> >>>> Considering that the release will be run
> infrequently, it
> > > should be
> > > >> doable to have a relatively powerful server that could
> be
> > spun up on
> > > >> demand. This is something I have setup for my own
> releases.
> > > >> >>>>
> > > >> >>>> The only complication would be that each RM would
> need
> > valid
> > > >> credentials to spin up the server.
> > > >> >>>>
> > > >> >>>> Harbs
> > > >> >>>>
> > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > > <ah...@adobe.com.INVALID>
> > > >> wrote:
> > > >> >>>>>
> > > >> >>>>> A better solution, IMO, is for someone else to
> offer up
> > a CI
> > > server
> > > >> only for release jobs.
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
I'm a bit stumped here. The royale-compiler is failing with this error:
BUILD FAILEDc:\jenkins\workspace\royale-compiler\jenkins.xml:55:
Execute failed: java.io.IOException: Cannot run program "git" (in
directory "c:\jenkins\workspace\royale-compiler"): CreateProcess
error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(Unknown Source)
It is from this part of the jenkins.xml:
<target name="closure-lib-download" description="Copies Closure Library
from GitHub">
<echo message="Be patient. This takes a few minutes..." />
<exec executable="git" failifexecutionfails="true">
<arg value="clone" />
<arg value="https://github.com/google/closure-library" />
<arg value="${closure.root}" />
</exec>
<echo>Cloned fresh copy of Google Closure Library</echo>
</target>
I am not sure how this executable call works without the full path.
I checked the env variables, I do have both the git/bin and git/cmd
directory in the PATH:
[image: image.png]
What am I missing?
Thanks,
Om
On Sat, Apr 18, 2020 at 11:54 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> Update - I have successfully attached my VM as a slave agent of our
> Jenkins instance.
> I am going to pull the job - /royale-asjs_jsonly and tie it to my agent so
> I can test it.
>
> It will fail for a sometime while I go set up my VM with all the
> dependencies.
>
> Once we have the job successfully building on my VM, we can figure out how
> to divide the load between the master and agent.
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <bi...@gmail.com>
> wrote:
>
>> We could achieve the same by creating a new agent (separate vm) and
>> attaching it as a slave to the current Jenkins server.
>>
>> Then we can use labels/tags to tie release jobs to one agent and non
>> release jobs to another agent.
>>
>> That way we can maintain everything in one UI, one login while achieving
>> the concurrent building capabilities we want.
>>
>> Jenkins is built for this kind of stuff and I think it would be best we
>> followed this practice.
>>
>> Thanks,
>> Om
>>
>> On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid>
>> wrote:
>>
>>> Om, I thought you were going to get the image from my VM and run it on
>>> another VM. Then we'd remove all non-release jobs from your VM and all of
>>> the release jobs from my VM. That won't solve the problem of how long it
>>> takes for a commit to be built and tested, but will allow the RM to get a
>>> release out without getting stuck behind the commit jobs. Is that
>>> currently the plan?
>>>
>>> -Alex
>>>
>>> On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bi...@gmail.com>
>>> wrote:
>>>
>>> Makes sense to me. I will set parallel executors back to 1.
>>>
>>> And start working on a new Jenkins instance.
>>>
>>> Thanks,
>>> Om
>>>
>>>
>>> On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid>
>>> wrote:
>>>
>>> > Are you saying that Java, Ant and Maven do not know how to
>>> distribute work
>>> > to different cores?
>>> >
>>> > To repeat my main concern: our Jenkins jobs often use shared
>>> resources.
>>> > If you want to take the time to fix that, feel free, but I do not
>>> know how
>>> > you are going to keep two jobs from both trying to launch Flash
>>> Player
>>> > Debugger at the same time and open the same socket to communicate
>>> with it,
>>> > or try to parse the flashlog.txt that they have both written to.
>>> >
>>> > The royale-asjs job will use the royale-compiler workspace to get
>>> the
>>> > compiler. If the compiler is building, the jars are not there and
>>> the
>>> > royale-asjs build fails.
>>> >
>>> > There is also only so much memory and some of our jobs use all of
>>> it and
>>> > I'm not sure if jobs slowed down due to paging memory and
>>> writing/reading
>>> > from disk, even if it is an SSD.
>>> >
>>> > I'm done for tonight, but that's what I was seeing last time I
>>> tried to
>>> > have both master and an agent running jobs in parallel.
>>> >
>>> > Thanks,
>>> > -Alex
>>> >
>>> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>>> wrote:
>>> >
>>> > A typical setup would be to have 0 executors on master and at
>>> least n
>>> > number of executors on each agent, where n = number of cpu
>>> cores.
>>> > I see that the current VM has 2 cores. So, I started with
>>> setting the
>>> > num
>>> > executors on the current agent to 2.
>>> >
>>> > This should improve things quite a bit. If this doesn't work,
>>> I will
>>> > create a new VM and make it the slave agent of the current
>>> Jenkins
>>> > master.
>>> >
>>> >
>>> > Thanks,
>>> > Om
>>> >
>>> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>>> <ah...@adobe.com.invalid>
>>> > wrote:
>>> >
>>> > > On your VM or mine? I don't think mine can handle it. I
>>> used to
>>> > run jobs
>>> > > of master and agent and we got lots of failures and jobs took
>>> > forever. If
>>> > > two jobs are trying to run tests with the shared Flash Player
>>> > Debugger, for
>>> > > example, you won't get consistent results.
>>> > >
>>> > > -Alex
>>> > >
>>> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>>> bigosmallm@gmail.com>
>>> > wrote:
>>> > >
>>> > > I just realized that we have only one Agent (node)
>>> listed under
>>> > > Jenkins. I
>>> > > am going to add at least one more node to start with.
>>> > >
>>> > > Thanks,
>>> > > Om
>>> > >
>>> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>>> > <ah...@adobe.com.invalid>
>>> > > wrote:
>>> > >
>>> > > > I think I followed the instructions and enabled SSH.
>>> > > >
>>> > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>>> yishayjobs@hotmail.com>
>>> > wrote:
>>> > > >
>>> > > > I haven’t gotten it to work. Could be ssh needs to
>>> be
>>> > enabled on
>>> > > the
>>> > > > VM [1]. This is nice to have but not essential. So
>>> Alex, let
>>> > me know
>>> > > if you
>>> > > > want to try that, otherwise I’ll suspend my efforts on
>>> this.
>>> > > >
>>> > > > [1]
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
>>> > > >
>>> > > > From: Yishay Weiss<ma...@hotmail.com>
>>> > > > Sent: Wednesday, April 15, 2020 5:09 PM
>>> > > > To: dev@royale.apache.org<mailto:
>>> dev@royale.apache.org>
>>> > > > Subject: RE: Prioritize Release Jobs on CI
>>> > > >
>>> > > > I’d like to try and install an ssh server. Can
>>> anyone
>>> > think of a
>>> > > > reason not to do that? I’m asking in terms of
>>> security, and if
>>> > there
>>> > > might
>>> > > > be a problem because it’s a VM.
>>> > > >
>>> > > > Thanks.
>>> > > >
>>> > > > From: Yishay Weiss<ma...@hotmail.com>
>>> > > > Sent: Monday, April 13, 2020 10:02 AM
>>> > > > To: dev@royale.apache.org<mailto:
>>> dev@royale.apache.org>
>>> > > > Subject: RE: Prioritize Release Jobs on CI
>>> > > >
>>> > > > Related, as most (all?) of the instructions don’t
>>> require
>>> > > anything but
>>> > > > a shell wouldn’t it be easier and faster to access the
>>> machine
>>> > with
>>> > > ssh
>>> > > > [1], rather than using remote desktop?
>>> > > >
>>> > > > [1]
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
>>> > > >
>>> > > > From: Yishay Weiss<ma...@hotmail.com>
>>> > > > Sent: Monday, April 13, 2020 9:55 AM
>>> > > > To: dev@royale.apache.org<mailto:
>>> dev@royale.apache.org>
>>> > > > Subject: RE: Prioritize Release Jobs on CI
>>> > > >
>>> > > > Can’t you do that with remote desktop?
>>> > > >
>>> > > > ________________________________
>>> > > > From: OmPrakash Muppirala <bi...@gmail.com>
>>> > > > Sent: Monday, April 13, 2020 9:51:25 AM
>>> > > > To: Apache Royale Development <
>>> dev@royale.apache.org>
>>> > > > Subject: Re: Prioritize Release Jobs on CI
>>> > > >
>>> > > > Alex,
>>> > > >
>>> > > > I believe this is your personal Azure subscription
>>> right?
>>> > Any
>>> > > chance
>>> > > > I can
>>> > > > get access to it so I can try to copy the image
>>> out the
>>> > machine
>>> > > and
>>> > > > redeploy it somewhere else?
>>> > > >
>>> > > > Thanks,
>>> > > > Om
>>> > > >
>>> > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash
>>> Muppirala <
>>> > > > bigosmallm@gmail.com>
>>> > > > wrote:
>>> > > >
>>> > > > > I can help set this up on Azure. Give me some
>>> time to
>>> > work
>>> > > out the
>>> > > > > details?
>>> > > > >
>>> > > > > Thanks,
>>> > > > > Om
>>> > > > >
>>> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
>>> > harbs.lists@gmail.com>
>>> > > wrote:
>>> > > > >
>>> > > > >> OK. Good to know.
>>> > > > >>
>>> > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
>>> > > <aharui@adobe.com.INVALID
>>> > > > >
>>> > > > >> wrote:
>>> > > > >> >
>>> > > > >> > FWIW, I just looked and the longest job in
>>> the release
>>> > > steps so
>>> > > > far is
>>> > > > >> 8 minutes. Most are under 2 minutes. There
>>> might be
>>> > jobs
>>> > > later
>>> > > > that take
>>> > > > >> longer that we haven't run yet. IMO, the issue
>>> isn't
>>> > speed
>>> > > of the
>>> > > > machine,
>>> > > > >> it is just that we are sharing the machine with
>>> longer
>>> > jobs
>>> > > (1 hour
>>> > > > for
>>> > > > >> TourDeFlexMigration). And again, the machine
>>> will be
>>> > idle for
>>> > > > stretches of
>>> > > > >> time while the RM verifies artifacts after each
>>> step.
>>> > > > >> >
>>> > > > >> > -Alex
>>> > > > >> >
>>> > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>>> harbs.lists@gmail.com
>>> > > <mailto:
>>> > > > >> harbs.lists@gmail.com>> wrote:
>>> > > > >> >
>>> > > > >> > Fair enough.
>>> > > > >> >
>>> > > > >> > I expect builds to be somewhere between 10
>>> and 20
>>> > times
>>> > > faster
>>> > > > on a
>>> > > > >> powerful machine.
>>> > > > >> >
>>> > > > >> > Yeah. It’s probably going to be a bit of
>>> work
>>> > changing
>>> > > the
>>> > > > server,
>>> > > > >> but probably worth it in the long run.
>>> > > > >> >
>>> > > > >> > I think I’ll try this when I do the next
>>> release
>>> > unless
>>> > > Yishay
>>> > > > wants
>>> > > > >> to work with me on this for this release — but
>>> I’m not
>>> > going
>>> > > to be
>>> > > > able to
>>> > > > >> help until after Passover (i.e. next week).
>>> > > > >> >
>>> > > > >> > Thanks,
>>> > > > >> > Harbs
>>> > > > >> >
>>> > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
>>> > > <aharui@adobe.com.INVALID
>>> > > > >
>>> > > > >> wrote:
>>> > > > >> >>
>>> > > > >> >> The Azure portal says: Standard F2s_v2 (2
>>> vcpus, 4
>>> > GiB
>>> > > memory)
>>> > > > >> >>
>>> > > > >> >> I think I am reading changes to the build
>>> process in
>>> > your
>>> > > > >> suggestions. I do not really want to spend
>>> more of my
>>> > time
>>> > > on this
>>> > > > >> process. But if you want to do the work,
>>> that's fine
>>> > with me.
>>> > > > >> >>
>>> > > > >> >> -Alex
>>> > > > >> >>
>>> > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>>> harbs.lists@gmail.com
>>> > > <mailto:
>>> > > > >> harbs.lists@gmail.com> <mailto:
>>> harbs.lists@gmail.com
>>> > <mailto:
>>> > > > >> harbs.lists@gmail.com>>> wrote:
>>> > > > >> >>
>>> > > > >> >> What kind of horsepower is included in the
>>> free
>>> > Azure
>>> > > account?
>>> > > > >> >>
>>> > > > >> >> The server I mentioned builds
>>> (considerably)
>>> > faster than
>>> > > my own
>>> > > > >> local machine. The ci server seems to build
>>> many times
>>> > slower.
>>> > > > >> >>
>>> > > > >> >> One thing we can do to minimize running
>>> server time
>>> > > would be to
>>> > > > >> transfer the artifacts to storage instead of
>>> keeping
>>> > them on
>>> > > the
>>> > > > server. On
>>> > > > >> AWS, I’d probably use S3. Not sure what the
>>> similar
>>> > service on
>>> > > > Azure is
>>> > > > >> called.
>>> > > > >> >>
>>> > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
>>> > > > <aharui@adobe.com.INVALID
>>> > > > >> <ma...@adobe.com.INVALID>> wrote:
>>> > > > >> >>>
>>> > > > >> >>> OK, that's pretty much how I understand
>>> Azure as
>>> > well.
>>> > > The key
>>> > > > thing
>>> > > > >> is that "running" includes time where the CI
>>> server is
>>> > not
>>> > > running
>>> > > > any
>>> > > > >> Jenkins jobs. The CI Server steps might take
>>> only a few
>>> > > hours of
>>> > > > actual
>>> > > > >> server time, but there is time where the RM is
>>> verifying
>>> > > artifacts
>>> > > > locally
>>> > > > >> so you'd be paying for that or the RM would
>>> have to keep
>>> > > shutting
>>> > > > down and
>>> > > > >> restarting.
>>> > > > >> >>>
>>> > > > >> >>> Seems like it would be cheaper/simpler to
>>> get the
>>> > free
>>> > > MSDN
>>> > > > account
>>> > > > >> and leave it running.
>>> > > > >> >>>
>>> > > > >> >>> -Alex
>>> > > > >> >>>
>>> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>>> > harbs.lists@gmail.com
>>> > > <mailto:
>>> > > > >> harbs.lists@gmail.com>> wrote:
>>> > > > >> >>>
>>> > > > >> >>> My experience is with AWS.
>>> > > > >> >>>
>>> > > > >> >>> I assume Microsoft has similar offerings,
>>> but I
>>> > don’t
>>> > > have
>>> > > > >> experience with Azure.
>>> > > > >> >>>
>>> > > > >> >>> AWS has on-demand EC2 instances which you
>>> pay for
>>> > only
>>> > > the
>>> > > > actual
>>> > > > >> time that they are running.[1]
>>> > > > >> >>>
>>> > > > >> >>> Instances can be started and stopped via
>>> command
>>> > line
>>> > > (or via
>>> > > > the
>>> > > > >> web interface) as long as you have valid
>>> credentials to
>>> > do so.
>>> > > > >> >>>
>>> > > > >> >>> For example: an m5.4xlarge instance has 16
>>> cores
>>> > and
>>> > > costs
>>> > > > about
>>> > > > >> $1.5 per hour. On a machine like that, a full
>>> build
>>> > would
>>> > > probably
>>> > > > take
>>> > > > >> less than 10 minutes. It’s probably possible to
>>> do a
>>> > full
>>> > > release
>>> > > > with only
>>> > > > >> a few hours of server time.
>>> > > > >> >>>
>>> > > > >> >>> Leaving a server like that running all the
>>> time
>>> > would get
>>> > > > expensive,
>>> > > > >> but if it’s just spun up for releases, you’d
>>> get very
>>> > fast
>>> > > builds
>>> > > > at a
>>> > > > >> reasonable price.
>>> > > > >> >>>
>>> > > > >> >>> I’d be happy to pay $10-$50 (and possibly
>>> more) per
>>> > > release to
>>> > > > make
>>> > > > >> the release process painless for the RM.
>>> > > > >> >>>
>>> > > > >> >>> [1]
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>> > > > >> <
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>> > > > >> ><
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>> > > > >> <
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>> > > > >> >><
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>>> > > > >> <
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>>> > > > >> ><
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>>> > > > >> <
>>> > > > >>
>>> > > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>>> > > > >> >>>
>>> > > > >> >>>
>>> > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
>>> > > > <ah...@adobe.com.INVALID>
>>> > > > >> wrote:
>>> > > > >> >>>>
>>> > > > >> >>>> I'm not very experienced with spinning up
>>> > servers. The
>>> > > CI
>>> > > > server we
>>> > > > >> are using is effectively free, based on a
>>> generous
>>> > donation
>>> > > from
>>> > > > Microsoft
>>> > > > >> of MSDN accounts to ASF committers. So I leave
>>> it up
>>> > 24/7,
>>> > > and
>>> > > > share the
>>> > > > >> RDP access on private@. I think any other ASF
>>> > committer
>>> > > could do
>>> > > > the
>>> > > > >> same. IIRC, if that server actually is
>>> stopped, I have
>>> > to
>>> > > use my
>>> > > > personal
>>> > > > >> (unshared) MSDN credentials to start it again.
>>> AIUI,
>>> > if I
>>> > > > actually paid
>>> > > > >> for the server, it would cost me to leave it
>>> running
>>> > even if
>>> > > it
>>> > > > didn't run
>>> > > > >> jobs between releases.
>>> > > > >> >>>>
>>> > > > >> >>>> Is that what you are basically saying? I
>>> think it
>>> > might
>>> > > be
>>> > > > best if
>>> > > > >> another committer got a CI server going via the
>>> MS
>>> > donation
>>> > > and
>>> > > > could leave
>>> > > > >> it up 24/7.
>>> > > > >> >>>>
>>> > > > >> >>>> -Alex
>>> > > > >> >>>>
>>> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>>> > harbs.lists@gmail.com>
>>> > > wrote:
>>> > > > >> >>>>
>>> > > > >> >>>> I’m willing to do this.
>>> > > > >> >>>>
>>> > > > >> >>>> Considering that the release will be run
>>> > infrequently, it
>>> > > > should be
>>> > > > >> doable to have a relatively powerful server
>>> that could
>>> > be
>>> > > spun up on
>>> > > > >> demand. This is something I have setup for my
>>> own
>>> > releases.
>>> > > > >> >>>>
>>> > > > >> >>>> The only complication would be that each
>>> RM would
>>> > need
>>> > > valid
>>> > > > >> credentials to spin up the server.
>>> > > > >> >>>>
>>> > > > >> >>>> Harbs
>>> > > > >> >>>>
>>> > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
>>> > > > <ah...@adobe.com.INVALID>
>>> > > > >> wrote:
>>> > > > >> >>>>>
>>> > > > >> >>>>> A better solution, IMO, is for someone
>>> else to
>>> > offer up
>>> > > a CI
>>> > > > server
>>> > > > >> only for release jobs.
>>> > > > >>
>>> > > > >>
>>> > > >
>>> > > >
>>> > > >
>>> > > >
>>> > >
>>> > >
>>> > >
>>> >
>>> >
>>> >
>>>
>>>
>>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
Update - I have successfully attached my VM as a slave agent of our Jenkins
instance.
I am going to pull the job - /royale-asjs_jsonly and tie it to my agent so
I can test it.
It will fail for a sometime while I go set up my VM with all the
dependencies.
Once we have the job successfully building on my VM, we can figure out how
to divide the load between the master and agent.
Thanks,
Om
On Sat, Apr 18, 2020 at 8:59 AM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> We could achieve the same by creating a new agent (separate vm) and
> attaching it as a slave to the current Jenkins server.
>
> Then we can use labels/tags to tie release jobs to one agent and non
> release jobs to another agent.
>
> That way we can maintain everything in one UI, one login while achieving
> the concurrent building capabilities we want.
>
> Jenkins is built for this kind of stuff and I think it would be best we
> followed this practice.
>
> Thanks,
> Om
>
> On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid> wrote:
>
>> Om, I thought you were going to get the image from my VM and run it on
>> another VM. Then we'd remove all non-release jobs from your VM and all of
>> the release jobs from my VM. That won't solve the problem of how long it
>> takes for a commit to be built and tested, but will allow the RM to get a
>> release out without getting stuck behind the commit jobs. Is that
>> currently the plan?
>>
>> -Alex
>>
>> On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>>
>> Makes sense to me. I will set parallel executors back to 1.
>>
>> And start working on a new Jenkins instance.
>>
>> Thanks,
>> Om
>>
>>
>> On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid>
>> wrote:
>>
>> > Are you saying that Java, Ant and Maven do not know how to
>> distribute work
>> > to different cores?
>> >
>> > To repeat my main concern: our Jenkins jobs often use shared
>> resources.
>> > If you want to take the time to fix that, feel free, but I do not
>> know how
>> > you are going to keep two jobs from both trying to launch Flash
>> Player
>> > Debugger at the same time and open the same socket to communicate
>> with it,
>> > or try to parse the flashlog.txt that they have both written to.
>> >
>> > The royale-asjs job will use the royale-compiler workspace to get
>> the
>> > compiler. If the compiler is building, the jars are not there and
>> the
>> > royale-asjs build fails.
>> >
>> > There is also only so much memory and some of our jobs use all of
>> it and
>> > I'm not sure if jobs slowed down due to paging memory and
>> writing/reading
>> > from disk, even if it is an SSD.
>> >
>> > I'm done for tonight, but that's what I was seeing last time I
>> tried to
>> > have both master and an agent running jobs in parallel.
>> >
>> > Thanks,
>> > -Alex
>> >
>> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com>
>> wrote:
>> >
>> > A typical setup would be to have 0 executors on master and at
>> least n
>> > number of executors on each agent, where n = number of cpu
>> cores.
>> > I see that the current VM has 2 cores. So, I started with
>> setting the
>> > num
>> > executors on the current agent to 2.
>> >
>> > This should improve things quite a bit. If this doesn't work,
>> I will
>> > create a new VM and make it the slave agent of the current
>> Jenkins
>> > master.
>> >
>> >
>> > Thanks,
>> > Om
>> >
>> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
>> <ah...@adobe.com.invalid>
>> > wrote:
>> >
>> > > On your VM or mine? I don't think mine can handle it. I
>> used to
>> > run jobs
>> > > of master and agent and we got lots of failures and jobs took
>> > forever. If
>> > > two jobs are trying to run tests with the shared Flash Player
>> > Debugger, for
>> > > example, you won't get consistent results.
>> > >
>> > > -Alex
>> > >
>> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
>> bigosmallm@gmail.com>
>> > wrote:
>> > >
>> > > I just realized that we have only one Agent (node) listed
>> under
>> > > Jenkins. I
>> > > am going to add at least one more node to start with.
>> > >
>> > > Thanks,
>> > > Om
>> > >
>> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
>> > <ah...@adobe.com.invalid>
>> > > wrote:
>> > >
>> > > > I think I followed the instructions and enabled SSH.
>> > > >
>> > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
>> yishayjobs@hotmail.com>
>> > wrote:
>> > > >
>> > > > I haven’t gotten it to work. Could be ssh needs to
>> be
>> > enabled on
>> > > the
>> > > > VM [1]. This is nice to have but not essential. So
>> Alex, let
>> > me know
>> > > if you
>> > > > want to try that, otherwise I’ll suspend my efforts on
>> this.
>> > > >
>> > > > [1]
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
>> > > >
>> > > > From: Yishay Weiss<ma...@hotmail.com>
>> > > > Sent: Wednesday, April 15, 2020 5:09 PM
>> > > > To: dev@royale.apache.org<mailto:
>> dev@royale.apache.org>
>> > > > Subject: RE: Prioritize Release Jobs on CI
>> > > >
>> > > > I’d like to try and install an ssh server. Can
>> anyone
>> > think of a
>> > > > reason not to do that? I’m asking in terms of security,
>> and if
>> > there
>> > > might
>> > > > be a problem because it’s a VM.
>> > > >
>> > > > Thanks.
>> > > >
>> > > > From: Yishay Weiss<ma...@hotmail.com>
>> > > > Sent: Monday, April 13, 2020 10:02 AM
>> > > > To: dev@royale.apache.org<mailto:
>> dev@royale.apache.org>
>> > > > Subject: RE: Prioritize Release Jobs on CI
>> > > >
>> > > > Related, as most (all?) of the instructions don’t
>> require
>> > > anything but
>> > > > a shell wouldn’t it be easier and faster to access the
>> machine
>> > with
>> > > ssh
>> > > > [1], rather than using remote desktop?
>> > > >
>> > > > [1]
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
>> > > >
>> > > > From: Yishay Weiss<ma...@hotmail.com>
>> > > > Sent: Monday, April 13, 2020 9:55 AM
>> > > > To: dev@royale.apache.org<mailto:
>> dev@royale.apache.org>
>> > > > Subject: RE: Prioritize Release Jobs on CI
>> > > >
>> > > > Can’t you do that with remote desktop?
>> > > >
>> > > > ________________________________
>> > > > From: OmPrakash Muppirala <bi...@gmail.com>
>> > > > Sent: Monday, April 13, 2020 9:51:25 AM
>> > > > To: Apache Royale Development <
>> dev@royale.apache.org>
>> > > > Subject: Re: Prioritize Release Jobs on CI
>> > > >
>> > > > Alex,
>> > > >
>> > > > I believe this is your personal Azure subscription
>> right?
>> > Any
>> > > chance
>> > > > I can
>> > > > get access to it so I can try to copy the image out
>> the
>> > machine
>> > > and
>> > > > redeploy it somewhere else?
>> > > >
>> > > > Thanks,
>> > > > Om
>> > > >
>> > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala
>> <
>> > > > bigosmallm@gmail.com>
>> > > > wrote:
>> > > >
>> > > > > I can help set this up on Azure. Give me some
>> time to
>> > work
>> > > out the
>> > > > > details?
>> > > > >
>> > > > > Thanks,
>> > > > > Om
>> > > > >
>> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
>> > harbs.lists@gmail.com>
>> > > wrote:
>> > > > >
>> > > > >> OK. Good to know.
>> > > > >>
>> > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
>> > > <aharui@adobe.com.INVALID
>> > > > >
>> > > > >> wrote:
>> > > > >> >
>> > > > >> > FWIW, I just looked and the longest job in the
>> release
>> > > steps so
>> > > > far is
>> > > > >> 8 minutes. Most are under 2 minutes. There
>> might be
>> > jobs
>> > > later
>> > > > that take
>> > > > >> longer that we haven't run yet. IMO, the issue
>> isn't
>> > speed
>> > > of the
>> > > > machine,
>> > > > >> it is just that we are sharing the machine with
>> longer
>> > jobs
>> > > (1 hour
>> > > > for
>> > > > >> TourDeFlexMigration). And again, the machine
>> will be
>> > idle for
>> > > > stretches of
>> > > > >> time while the RM verifies artifacts after each
>> step.
>> > > > >> >
>> > > > >> > -Alex
>> > > > >> >
>> > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
>> harbs.lists@gmail.com
>> > > <mailto:
>> > > > >> harbs.lists@gmail.com>> wrote:
>> > > > >> >
>> > > > >> > Fair enough.
>> > > > >> >
>> > > > >> > I expect builds to be somewhere between 10
>> and 20
>> > times
>> > > faster
>> > > > on a
>> > > > >> powerful machine.
>> > > > >> >
>> > > > >> > Yeah. It’s probably going to be a bit of
>> work
>> > changing
>> > > the
>> > > > server,
>> > > > >> but probably worth it in the long run.
>> > > > >> >
>> > > > >> > I think I’ll try this when I do the next
>> release
>> > unless
>> > > Yishay
>> > > > wants
>> > > > >> to work with me on this for this release — but
>> I’m not
>> > going
>> > > to be
>> > > > able to
>> > > > >> help until after Passover (i.e. next week).
>> > > > >> >
>> > > > >> > Thanks,
>> > > > >> > Harbs
>> > > > >> >
>> > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
>> > > <aharui@adobe.com.INVALID
>> > > > >
>> > > > >> wrote:
>> > > > >> >>
>> > > > >> >> The Azure portal says: Standard F2s_v2 (2
>> vcpus, 4
>> > GiB
>> > > memory)
>> > > > >> >>
>> > > > >> >> I think I am reading changes to the build
>> process in
>> > your
>> > > > >> suggestions. I do not really want to spend more
>> of my
>> > time
>> > > on this
>> > > > >> process. But if you want to do the work, that's
>> fine
>> > with me.
>> > > > >> >>
>> > > > >> >> -Alex
>> > > > >> >>
>> > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
>> harbs.lists@gmail.com
>> > > <mailto:
>> > > > >> harbs.lists@gmail.com> <mailto:
>> harbs.lists@gmail.com
>> > <mailto:
>> > > > >> harbs.lists@gmail.com>>> wrote:
>> > > > >> >>
>> > > > >> >> What kind of horsepower is included in the
>> free
>> > Azure
>> > > account?
>> > > > >> >>
>> > > > >> >> The server I mentioned builds (considerably)
>> > faster than
>> > > my own
>> > > > >> local machine. The ci server seems to build many
>> times
>> > slower.
>> > > > >> >>
>> > > > >> >> One thing we can do to minimize running
>> server time
>> > > would be to
>> > > > >> transfer the artifacts to storage instead of
>> keeping
>> > them on
>> > > the
>> > > > server. On
>> > > > >> AWS, I’d probably use S3. Not sure what the
>> similar
>> > service on
>> > > > Azure is
>> > > > >> called.
>> > > > >> >>
>> > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
>> > > > <aharui@adobe.com.INVALID
>> > > > >> <ma...@adobe.com.INVALID>> wrote:
>> > > > >> >>>
>> > > > >> >>> OK, that's pretty much how I understand
>> Azure as
>> > well.
>> > > The key
>> > > > thing
>> > > > >> is that "running" includes time where the CI
>> server is
>> > not
>> > > running
>> > > > any
>> > > > >> Jenkins jobs. The CI Server steps might take
>> only a few
>> > > hours of
>> > > > actual
>> > > > >> server time, but there is time where the RM is
>> verifying
>> > > artifacts
>> > > > locally
>> > > > >> so you'd be paying for that or the RM would have
>> to keep
>> > > shutting
>> > > > down and
>> > > > >> restarting.
>> > > > >> >>>
>> > > > >> >>> Seems like it would be cheaper/simpler to
>> get the
>> > free
>> > > MSDN
>> > > > account
>> > > > >> and leave it running.
>> > > > >> >>>
>> > > > >> >>> -Alex
>> > > > >> >>>
>> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
>> > harbs.lists@gmail.com
>> > > <mailto:
>> > > > >> harbs.lists@gmail.com>> wrote:
>> > > > >> >>>
>> > > > >> >>> My experience is with AWS.
>> > > > >> >>>
>> > > > >> >>> I assume Microsoft has similar offerings,
>> but I
>> > don’t
>> > > have
>> > > > >> experience with Azure.
>> > > > >> >>>
>> > > > >> >>> AWS has on-demand EC2 instances which you
>> pay for
>> > only
>> > > the
>> > > > actual
>> > > > >> time that they are running.[1]
>> > > > >> >>>
>> > > > >> >>> Instances can be started and stopped via
>> command
>> > line
>> > > (or via
>> > > > the
>> > > > >> web interface) as long as you have valid
>> credentials to
>> > do so.
>> > > > >> >>>
>> > > > >> >>> For example: an m5.4xlarge instance has 16
>> cores
>> > and
>> > > costs
>> > > > about
>> > > > >> $1.5 per hour. On a machine like that, a full
>> build
>> > would
>> > > probably
>> > > > take
>> > > > >> less than 10 minutes. It’s probably possible to
>> do a
>> > full
>> > > release
>> > > > with only
>> > > > >> a few hours of server time.
>> > > > >> >>>
>> > > > >> >>> Leaving a server like that running all the
>> time
>> > would get
>> > > > expensive,
>> > > > >> but if it’s just spun up for releases, you’d get
>> very
>> > fast
>> > > builds
>> > > > at a
>> > > > >> reasonable price.
>> > > > >> >>>
>> > > > >> >>> I’d be happy to pay $10-$50 (and possibly
>> more) per
>> > > release to
>> > > > make
>> > > > >> the release process painless for the RM.
>> > > > >> >>>
>> > > > >> >>> [1]
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>> > > > >> <
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>> > > > >> ><
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>> > > > >> <
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>> > > > >> >><
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
>> > > > >> <
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>> > > > >> ><
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>> > > > >> <
>> > > > >>
>> > > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
>> > > > >> >>>
>> > > > >> >>>
>> > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
>> > > > <ah...@adobe.com.INVALID>
>> > > > >> wrote:
>> > > > >> >>>>
>> > > > >> >>>> I'm not very experienced with spinning up
>> > servers. The
>> > > CI
>> > > > server we
>> > > > >> are using is effectively free, based on a
>> generous
>> > donation
>> > > from
>> > > > Microsoft
>> > > > >> of MSDN accounts to ASF committers. So I leave
>> it up
>> > 24/7,
>> > > and
>> > > > share the
>> > > > >> RDP access on private@. I think any other ASF
>> > committer
>> > > could do
>> > > > the
>> > > > >> same. IIRC, if that server actually is stopped,
>> I have
>> > to
>> > > use my
>> > > > personal
>> > > > >> (unshared) MSDN credentials to start it again.
>> AIUI,
>> > if I
>> > > > actually paid
>> > > > >> for the server, it would cost me to leave it
>> running
>> > even if
>> > > it
>> > > > didn't run
>> > > > >> jobs between releases.
>> > > > >> >>>>
>> > > > >> >>>> Is that what you are basically saying? I
>> think it
>> > might
>> > > be
>> > > > best if
>> > > > >> another committer got a CI server going via the
>> MS
>> > donation
>> > > and
>> > > > could leave
>> > > > >> it up 24/7.
>> > > > >> >>>>
>> > > > >> >>>> -Alex
>> > > > >> >>>>
>> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
>> > harbs.lists@gmail.com>
>> > > wrote:
>> > > > >> >>>>
>> > > > >> >>>> I’m willing to do this.
>> > > > >> >>>>
>> > > > >> >>>> Considering that the release will be run
>> > infrequently, it
>> > > > should be
>> > > > >> doable to have a relatively powerful server that
>> could
>> > be
>> > > spun up on
>> > > > >> demand. This is something I have setup for my own
>> > releases.
>> > > > >> >>>>
>> > > > >> >>>> The only complication would be that each RM
>> would
>> > need
>> > > valid
>> > > > >> credentials to spin up the server.
>> > > > >> >>>>
>> > > > >> >>>> Harbs
>> > > > >> >>>>
>> > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
>> > > > <ah...@adobe.com.INVALID>
>> > > > >> wrote:
>> > > > >> >>>>>
>> > > > >> >>>>> A better solution, IMO, is for someone
>> else to
>> > offer up
>> > > a CI
>> > > > server
>> > > > >> only for release jobs.
>> > > > >>
>> > > > >>
>> > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> > >
>> >
>> >
>> >
>>
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
We could achieve the same by creating a new agent (separate vm) and
attaching it as a slave to the current Jenkins server.
Then we can use labels/tags to tie release jobs to one agent and non
release jobs to another agent.
That way we can maintain everything in one UI, one login while achieving
the concurrent building capabilities we want.
Jenkins is built for this kind of stuff and I think it would be best we
followed this practice.
Thanks,
Om
On Sat, Apr 18, 2020, 8:18 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> Om, I thought you were going to get the image from my VM and run it on
> another VM. Then we'd remove all non-release jobs from your VM and all of
> the release jobs from my VM. That won't solve the problem of how long it
> takes for a commit to be built and tested, but will allow the RM to get a
> release out without getting stuck behind the commit jobs. Is that
> currently the plan?
>
> -Alex
>
> On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> Makes sense to me. I will set parallel executors back to 1.
>
> And start working on a new Jenkins instance.
>
> Thanks,
> Om
>
>
> On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > Are you saying that Java, Ant and Maven do not know how to
> distribute work
> > to different cores?
> >
> > To repeat my main concern: our Jenkins jobs often use shared
> resources.
> > If you want to take the time to fix that, feel free, but I do not
> know how
> > you are going to keep two jobs from both trying to launch Flash
> Player
> > Debugger at the same time and open the same socket to communicate
> with it,
> > or try to parse the flashlog.txt that they have both written to.
> >
> > The royale-asjs job will use the royale-compiler workspace to get the
> > compiler. If the compiler is building, the jars are not there and
> the
> > royale-asjs build fails.
> >
> > There is also only so much memory and some of our jobs use all of it
> and
> > I'm not sure if jobs slowed down due to paging memory and
> writing/reading
> > from disk, even if it is an SSD.
> >
> > I'm done for tonight, but that's what I was seeing last time I tried
> to
> > have both master and an agent running jobs in parallel.
> >
> > Thanks,
> > -Alex
> >
> > On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> wrote:
> >
> > A typical setup would be to have 0 executors on master and at
> least n
> > number of executors on each agent, where n = number of cpu cores.
> > I see that the current VM has 2 cores. So, I started with
> setting the
> > num
> > executors on the current agent to 2.
> >
> > This should improve things quite a bit. If this doesn't work, I
> will
> > create a new VM and make it the slave agent of the current
> Jenkins
> > master.
> >
> >
> > Thanks,
> > Om
> >
> > On Fri, Apr 17, 2020 at 11:31 PM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > On your VM or mine? I don't think mine can handle it. I used
> to
> > run jobs
> > > of master and agent and we got lots of failures and jobs took
> > forever. If
> > > two jobs are trying to run tests with the shared Flash Player
> > Debugger, for
> > > example, you won't get consistent results.
> > >
> > > -Alex
> > >
> > > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <
> bigosmallm@gmail.com>
> > wrote:
> > >
> > > I just realized that we have only one Agent (node) listed
> under
> > > Jenkins. I
> > > am going to add at least one more node to start with.
> > >
> > > Thanks,
> > > Om
> > >
> > > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> > <ah...@adobe.com.invalid>
> > > wrote:
> > >
> > > > I think I followed the instructions and enabled SSH.
> > > >
> > > > On 4/16/20, 9:37 AM, "Yishay Weiss" <
> yishayjobs@hotmail.com>
> > wrote:
> > > >
> > > > I haven’t gotten it to work. Could be ssh needs to be
> > enabled on
> > > the
> > > > VM [1]. This is nice to have but not essential. So Alex,
> let
> > me know
> > > if you
> > > > want to try that, otherwise I’ll suspend my efforts on
> this.
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
> > > >
> > > > From: Yishay Weiss<ma...@hotmail.com>
> > > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > I’d like to try and install an ssh server. Can anyone
> > think of a
> > > > reason not to do that? I’m asking in terms of security,
> and if
> > there
> > > might
> > > > be a problem because it’s a VM.
> > > >
> > > > Thanks.
> > > >
> > > > From: Yishay Weiss<ma...@hotmail.com>
> > > > Sent: Monday, April 13, 2020 10:02 AM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > Related, as most (all?) of the instructions don’t
> require
> > > anything but
> > > > a shell wouldn’t it be easier and faster to access the
> machine
> > with
> > > ssh
> > > > [1], rather than using remote desktop?
> > > >
> > > > [1]
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
> > > >
> > > > From: Yishay Weiss<ma...@hotmail.com>
> > > > Sent: Monday, April 13, 2020 9:55 AM
> > > > To: dev@royale.apache.org<mailto:
> dev@royale.apache.org>
> > > > Subject: RE: Prioritize Release Jobs on CI
> > > >
> > > > Can’t you do that with remote desktop?
> > > >
> > > > ________________________________
> > > > From: OmPrakash Muppirala <bi...@gmail.com>
> > > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > > To: Apache Royale Development <dev@royale.apache.org
> >
> > > > Subject: Re: Prioritize Release Jobs on CI
> > > >
> > > > Alex,
> > > >
> > > > I believe this is your personal Azure subscription
> right?
> > Any
> > > chance
> > > > I can
> > > > get access to it so I can try to copy the image out
> the
> > machine
> > > and
> > > > redeploy it somewhere else?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > > > bigosmallm@gmail.com>
> > > > wrote:
> > > >
> > > > > I can help set this up on Azure. Give me some
> time to
> > work
> > > out the
> > > > > details?
> > > > >
> > > > > Thanks,
> > > > > Om
> > > > >
> > > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> > harbs.lists@gmail.com>
> > > wrote:
> > > > >
> > > > >> OK. Good to know.
> > > > >>
> > > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >
> > > > >> > FWIW, I just looked and the longest job in the
> release
> > > steps so
> > > > far is
> > > > >> 8 minutes. Most are under 2 minutes. There
> might be
> > jobs
> > > later
> > > > that take
> > > > >> longer that we haven't run yet. IMO, the issue
> isn't
> > speed
> > > of the
> > > > machine,
> > > > >> it is just that we are sharing the machine with
> longer
> > jobs
> > > (1 hour
> > > > for
> > > > >> TourDeFlexMigration). And again, the machine
> will be
> > idle for
> > > > stretches of
> > > > >> time while the RM verifies artifacts after each
> step.
> > > > >> >
> > > > >> > -Alex
> > > > >> >
> > > > >> > On 4/12/20, 11:32 AM, "Harbs" <
> harbs.lists@gmail.com
> > > <mailto:
> > > > >> harbs.lists@gmail.com>> wrote:
> > > > >> >
> > > > >> > Fair enough.
> > > > >> >
> > > > >> > I expect builds to be somewhere between 10
> and 20
> > times
> > > faster
> > > > on a
> > > > >> powerful machine.
> > > > >> >
> > > > >> > Yeah. It’s probably going to be a bit of work
> > changing
> > > the
> > > > server,
> > > > >> but probably worth it in the long run.
> > > > >> >
> > > > >> > I think I’ll try this when I do the next
> release
> > unless
> > > Yishay
> > > > wants
> > > > >> to work with me on this for this release — but
> I’m not
> > going
> > > to be
> > > > able to
> > > > >> help until after Passover (i.e. next week).
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Harbs
> > > > >> >
> > > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > > >
> > > > >> wrote:
> > > > >> >>
> > > > >> >> The Azure portal says: Standard F2s_v2 (2
> vcpus, 4
> > GiB
> > > memory)
> > > > >> >>
> > > > >> >> I think I am reading changes to the build
> process in
> > your
> > > > >> suggestions. I do not really want to spend more
> of my
> > time
> > > on this
> > > > >> process. But if you want to do the work, that's
> fine
> > with me.
> > > > >> >>
> > > > >> >> -Alex
> > > > >> >>
> > > > >> >> On 4/12/20, 10:57 AM, "Harbs" <
> harbs.lists@gmail.com
> > > <mailto:
> > > > >> harbs.lists@gmail.com> <mailto:
> harbs.lists@gmail.com
> > <mailto:
> > > > >> harbs.lists@gmail.com>>> wrote:
> > > > >> >>
> > > > >> >> What kind of horsepower is included in the
> free
> > Azure
> > > account?
> > > > >> >>
> > > > >> >> The server I mentioned builds (considerably)
> > faster than
> > > my own
> > > > >> local machine. The ci server seems to build many
> times
> > slower.
> > > > >> >>
> > > > >> >> One thing we can do to minimize running
> server time
> > > would be to
> > > > >> transfer the artifacts to storage instead of
> keeping
> > them on
> > > the
> > > > server. On
> > > > >> AWS, I’d probably use S3. Not sure what the
> similar
> > service on
> > > > Azure is
> > > > >> called.
> > > > >> >>
> > > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > > <aharui@adobe.com.INVALID
> > > > >> <ma...@adobe.com.INVALID>> wrote:
> > > > >> >>>
> > > > >> >>> OK, that's pretty much how I understand Azure
> as
> > well.
> > > The key
> > > > thing
> > > > >> is that "running" includes time where the CI
> server is
> > not
> > > running
> > > > any
> > > > >> Jenkins jobs. The CI Server steps might take
> only a few
> > > hours of
> > > > actual
> > > > >> server time, but there is time where the RM is
> verifying
> > > artifacts
> > > > locally
> > > > >> so you'd be paying for that or the RM would have
> to keep
> > > shutting
> > > > down and
> > > > >> restarting.
> > > > >> >>>
> > > > >> >>> Seems like it would be cheaper/simpler to get
> the
> > free
> > > MSDN
> > > > account
> > > > >> and leave it running.
> > > > >> >>>
> > > > >> >>> -Alex
> > > > >> >>>
> > > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> > harbs.lists@gmail.com
> > > <mailto:
> > > > >> harbs.lists@gmail.com>> wrote:
> > > > >> >>>
> > > > >> >>> My experience is with AWS.
> > > > >> >>>
> > > > >> >>> I assume Microsoft has similar offerings,
> but I
> > don’t
> > > have
> > > > >> experience with Azure.
> > > > >> >>>
> > > > >> >>> AWS has on-demand EC2 instances which you
> pay for
> > only
> > > the
> > > > actual
> > > > >> time that they are running.[1]
> > > > >> >>>
> > > > >> >>> Instances can be started and stopped via
> command
> > line
> > > (or via
> > > > the
> > > > >> web interface) as long as you have valid
> credentials to
> > do so.
> > > > >> >>>
> > > > >> >>> For example: an m5.4xlarge instance has 16
> cores
> > and
> > > costs
> > > > about
> > > > >> $1.5 per hour. On a machine like that, a full
> build
> > would
> > > probably
> > > > take
> > > > >> less than 10 minutes. It’s probably possible to
> do a
> > full
> > > release
> > > > with only
> > > > >> a few hours of server time.
> > > > >> >>>
> > > > >> >>> Leaving a server like that running all the
> time
> > would get
> > > > expensive,
> > > > >> but if it’s just spun up for releases, you’d get
> very
> > fast
> > > builds
> > > > at a
> > > > >> reasonable price.
> > > > >> >>>
> > > > >> >>> I’d be happy to pay $10-$50 (and possibly
> more) per
> > > release to
> > > > make
> > > > >> the release process painless for the RM.
> > > > >> >>>
> > > > >> >>> [1]
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> >><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > > >> ><
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > > >> <
> > > > >>
> > > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > > >> >>>
> > > > >> >>>
> > > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>
> > > > >> >>>> I'm not very experienced with spinning up
> > servers. The
> > > CI
> > > > server we
> > > > >> are using is effectively free, based on a generous
> > donation
> > > from
> > > > Microsoft
> > > > >> of MSDN accounts to ASF committers. So I leave
> it up
> > 24/7,
> > > and
> > > > share the
> > > > >> RDP access on private@. I think any other ASF
> > committer
> > > could do
> > > > the
> > > > >> same. IIRC, if that server actually is stopped,
> I have
> > to
> > > use my
> > > > personal
> > > > >> (unshared) MSDN credentials to start it again.
> AIUI,
> > if I
> > > > actually paid
> > > > >> for the server, it would cost me to leave it
> running
> > even if
> > > it
> > > > didn't run
> > > > >> jobs between releases.
> > > > >> >>>>
> > > > >> >>>> Is that what you are basically saying? I
> think it
> > might
> > > be
> > > > best if
> > > > >> another committer got a CI server going via the MS
> > donation
> > > and
> > > > could leave
> > > > >> it up 24/7.
> > > > >> >>>>
> > > > >> >>>> -Alex
> > > > >> >>>>
> > > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> > harbs.lists@gmail.com>
> > > wrote:
> > > > >> >>>>
> > > > >> >>>> I’m willing to do this.
> > > > >> >>>>
> > > > >> >>>> Considering that the release will be run
> > infrequently, it
> > > > should be
> > > > >> doable to have a relatively powerful server that
> could
> > be
> > > spun up on
> > > > >> demand. This is something I have setup for my own
> > releases.
> > > > >> >>>>
> > > > >> >>>> The only complication would be that each RM
> would
> > need
> > > valid
> > > > >> credentials to spin up the server.
> > > > >> >>>>
> > > > >> >>>> Harbs
> > > > >> >>>>
> > > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > > > <ah...@adobe.com.INVALID>
> > > > >> wrote:
> > > > >> >>>>>
> > > > >> >>>>> A better solution, IMO, is for someone else
> to
> > offer up
> > > a CI
> > > > server
> > > > >> only for release jobs.
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Om, I thought you were going to get the image from my VM and run it on another VM. Then we'd remove all non-release jobs from your VM and all of the release jobs from my VM. That won't solve the problem of how long it takes for a commit to be built and tested, but will allow the RM to get a release out without getting stuck behind the commit jobs. Is that currently the plan?
-Alex
On 4/18/20, 12:43 AM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
Makes sense to me. I will set parallel executors back to 1.
And start working on a new Jenkins instance.
Thanks,
Om
On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> Are you saying that Java, Ant and Maven do not know how to distribute work
> to different cores?
>
> To repeat my main concern: our Jenkins jobs often use shared resources.
> If you want to take the time to fix that, feel free, but I do not know how
> you are going to keep two jobs from both trying to launch Flash Player
> Debugger at the same time and open the same socket to communicate with it,
> or try to parse the flashlog.txt that they have both written to.
>
> The royale-asjs job will use the royale-compiler workspace to get the
> compiler. If the compiler is building, the jars are not there and the
> royale-asjs build fails.
>
> There is also only so much memory and some of our jobs use all of it and
> I'm not sure if jobs slowed down due to paging memory and writing/reading
> from disk, even if it is an SSD.
>
> I'm done for tonight, but that's what I was seeing last time I tried to
> have both master and an agent running jobs in parallel.
>
> Thanks,
> -Alex
>
> On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> A typical setup would be to have 0 executors on master and at least n
> number of executors on each agent, where n = number of cpu cores.
> I see that the current VM has 2 cores. So, I started with setting the
> num
> executors on the current agent to 2.
>
> This should improve things quite a bit. If this doesn't work, I will
> create a new VM and make it the slave agent of the current Jenkins
> master.
>
>
> Thanks,
> Om
>
> On Fri, Apr 17, 2020 at 11:31 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > On your VM or mine? I don't think mine can handle it. I used to
> run jobs
> > of master and agent and we got lots of failures and jobs took
> forever. If
> > two jobs are trying to run tests with the shared Flash Player
> Debugger, for
> > example, you won't get consistent results.
> >
> > -Alex
> >
> > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> wrote:
> >
> > I just realized that we have only one Agent (node) listed under
> > Jenkins. I
> > am going to add at least one more node to start with.
> >
> > Thanks,
> > Om
> >
> > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > I think I followed the instructions and enabled SSH.
> > >
> > > On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com>
> wrote:
> > >
> > > I haven’t gotten it to work. Could be ssh needs to be
> enabled on
> > the
> > > VM [1]. This is nice to have but not essential. So Alex, let
> me know
> > if you
> > > want to try that, otherwise I’ll suspend my efforts on this.
> > >
> > > [1]
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=%2FdPPdqLaeWZYyshv14%2BhhL0ffSznS%2BAUOGQ3xNnwido%3D&reserved=0
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>
> > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > I’d like to try and install an ssh server. Can anyone
> think of a
> > > reason not to do that? I’m asking in terms of security, and if
> there
> > might
> > > be a problem because it’s a VM.
> > >
> > > Thanks.
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>
> > > Sent: Monday, April 13, 2020 10:02 AM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > Related, as most (all?) of the instructions don’t require
> > anything but
> > > a shell wouldn’t it be easier and faster to access the machine
> with
> > ssh
> > > [1], rather than using remote desktop?
> > >
> > > [1]
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=pKNVfpAa0zGTTCz2jnsF9Uley6b%2BY%2Bg1ZlSWJ0%2FiYcY%3D&reserved=0
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>
> > > Sent: Monday, April 13, 2020 9:55 AM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > Can’t you do that with remote desktop?
> > >
> > > ________________________________
> > > From: OmPrakash Muppirala <bi...@gmail.com>
> > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > To: Apache Royale Development <de...@royale.apache.org>
> > > Subject: Re: Prioritize Release Jobs on CI
> > >
> > > Alex,
> > >
> > > I believe this is your personal Azure subscription right?
> Any
> > chance
> > > I can
> > > get access to it so I can try to copy the image out the
> machine
> > and
> > > redeploy it somewhere else?
> > >
> > > Thanks,
> > > Om
> > >
> > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > > bigosmallm@gmail.com>
> > > wrote:
> > >
> > > > I can help set this up on Azure. Give me some time to
> work
> > out the
> > > > details?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> harbs.lists@gmail.com>
> > wrote:
> > > >
> > > >> OK. Good to know.
> > > >>
> > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > > >
> > > >> wrote:
> > > >> >
> > > >> > FWIW, I just looked and the longest job in the release
> > steps so
> > > far is
> > > >> 8 minutes. Most are under 2 minutes. There might be
> jobs
> > later
> > > that take
> > > >> longer that we haven't run yet. IMO, the issue isn't
> speed
> > of the
> > > machine,
> > > >> it is just that we are sharing the machine with longer
> jobs
> > (1 hour
> > > for
> > > >> TourDeFlexMigration). And again, the machine will be
> idle for
> > > stretches of
> > > >> time while the RM verifies artifacts after each step.
> > > >> >
> > > >> > -Alex
> > > >> >
> > > >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com
> > <mailto:
> > > >> harbs.lists@gmail.com>> wrote:
> > > >> >
> > > >> > Fair enough.
> > > >> >
> > > >> > I expect builds to be somewhere between 10 and 20
> times
> > faster
> > > on a
> > > >> powerful machine.
> > > >> >
> > > >> > Yeah. It’s probably going to be a bit of work
> changing
> > the
> > > server,
> > > >> but probably worth it in the long run.
> > > >> >
> > > >> > I think I’ll try this when I do the next release
> unless
> > Yishay
> > > wants
> > > >> to work with me on this for this release — but I’m not
> going
> > to be
> > > able to
> > > >> help until after Passover (i.e. next week).
> > > >> >
> > > >> > Thanks,
> > > >> > Harbs
> > > >> >
> > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > > >
> > > >> wrote:
> > > >> >>
> > > >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4
> GiB
> > memory)
> > > >> >>
> > > >> >> I think I am reading changes to the build process in
> your
> > > >> suggestions. I do not really want to spend more of my
> time
> > on this
> > > >> process. But if you want to do the work, that's fine
> with me.
> > > >> >>
> > > >> >> -Alex
> > > >> >>
> > > >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com
> > <mailto:
> > > >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com
> <mailto:
> > > >> harbs.lists@gmail.com>>> wrote:
> > > >> >>
> > > >> >> What kind of horsepower is included in the free
> Azure
> > account?
> > > >> >>
> > > >> >> The server I mentioned builds (considerably)
> faster than
> > my own
> > > >> local machine. The ci server seems to build many times
> slower.
> > > >> >>
> > > >> >> One thing we can do to minimize running server time
> > would be to
> > > >> transfer the artifacts to storage instead of keeping
> them on
> > the
> > > server. On
> > > >> AWS, I’d probably use S3. Not sure what the similar
> service on
> > > Azure is
> > > >> called.
> > > >> >>
> > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > >> <ma...@adobe.com.INVALID>> wrote:
> > > >> >>>
> > > >> >>> OK, that's pretty much how I understand Azure as
> well.
> > The key
> > > thing
> > > >> is that "running" includes time where the CI server is
> not
> > running
> > > any
> > > >> Jenkins jobs. The CI Server steps might take only a few
> > hours of
> > > actual
> > > >> server time, but there is time where the RM is verifying
> > artifacts
> > > locally
> > > >> so you'd be paying for that or the RM would have to keep
> > shutting
> > > down and
> > > >> restarting.
> > > >> >>>
> > > >> >>> Seems like it would be cheaper/simpler to get the
> free
> > MSDN
> > > account
> > > >> and leave it running.
> > > >> >>>
> > > >> >>> -Alex
> > > >> >>>
> > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> harbs.lists@gmail.com
> > <mailto:
> > > >> harbs.lists@gmail.com>> wrote:
> > > >> >>>
> > > >> >>> My experience is with AWS.
> > > >> >>>
> > > >> >>> I assume Microsoft has similar offerings, but I
> don’t
> > have
> > > >> experience with Azure.
> > > >> >>>
> > > >> >>> AWS has on-demand EC2 instances which you pay for
> only
> > the
> > > actual
> > > >> time that they are running.[1]
> > > >> >>>
> > > >> >>> Instances can be started and stopped via command
> line
> > (or via
> > > the
> > > >> web interface) as long as you have valid credentials to
> do so.
> > > >> >>>
> > > >> >>> For example: an m5.4xlarge instance has 16 cores
> and
> > costs
> > > about
> > > >> $1.5 per hour. On a machine like that, a full build
> would
> > probably
> > > take
> > > >> less than 10 minutes. It’s probably possible to do a
> full
> > release
> > > with only
> > > >> a few hours of server time.
> > > >> >>>
> > > >> >>> Leaving a server like that running all the time
> would get
> > > expensive,
> > > >> but if it’s just spun up for releases, you’d get very
> fast
> > builds
> > > at a
> > > >> reasonable price.
> > > >> >>>
> > > >> >>> I’d be happy to pay $10-$50 (and possibly more) per
> > release to
> > > make
> > > >> the release process painless for the RM.
> > > >> >>>
> > > >> >>> [1]
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > >> ><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > >> >><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926092990578&sdata=AlpLmsJYbBpN%2BLTXIwn2ESklg5aU04KGAfWe2vhJxyc%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > >> ><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C15fe635dba674d69308108d7e36c2ea2%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227926093000574&sdata=YZE52sCQqRXb6CAMtU4DW3RKXjg%2FffHhiGy5b0Yz2I0%3D&reserved=0
> > > >> >>>
> > > >> >>>
> > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > <ah...@adobe.com.INVALID>
> > > >> wrote:
> > > >> >>>>
> > > >> >>>> I'm not very experienced with spinning up
> servers. The
> > CI
> > > server we
> > > >> are using is effectively free, based on a generous
> donation
> > from
> > > Microsoft
> > > >> of MSDN accounts to ASF committers. So I leave it up
> 24/7,
> > and
> > > share the
> > > >> RDP access on private@. I think any other ASF
> committer
> > could do
> > > the
> > > >> same. IIRC, if that server actually is stopped, I have
> to
> > use my
> > > personal
> > > >> (unshared) MSDN credentials to start it again. AIUI,
> if I
> > > actually paid
> > > >> for the server, it would cost me to leave it running
> even if
> > it
> > > didn't run
> > > >> jobs between releases.
> > > >> >>>>
> > > >> >>>> Is that what you are basically saying? I think it
> might
> > be
> > > best if
> > > >> another committer got a CI server going via the MS
> donation
> > and
> > > could leave
> > > >> it up 24/7.
> > > >> >>>>
> > > >> >>>> -Alex
> > > >> >>>>
> > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> harbs.lists@gmail.com>
> > wrote:
> > > >> >>>>
> > > >> >>>> I’m willing to do this.
> > > >> >>>>
> > > >> >>>> Considering that the release will be run
> infrequently, it
> > > should be
> > > >> doable to have a relatively powerful server that could
> be
> > spun up on
> > > >> demand. This is something I have setup for my own
> releases.
> > > >> >>>>
> > > >> >>>> The only complication would be that each RM would
> need
> > valid
> > > >> credentials to spin up the server.
> > > >> >>>>
> > > >> >>>> Harbs
> > > >> >>>>
> > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > > <ah...@adobe.com.INVALID>
> > > >> wrote:
> > > >> >>>>>
> > > >> >>>>> A better solution, IMO, is for someone else to
> offer up
> > a CI
> > > server
> > > >> only for release jobs.
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
Makes sense to me. I will set parallel executors back to 1.
And start working on a new Jenkins instance.
Thanks,
Om
On Sat, Apr 18, 2020, 12:28 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> Are you saying that Java, Ant and Maven do not know how to distribute work
> to different cores?
>
> To repeat my main concern: our Jenkins jobs often use shared resources.
> If you want to take the time to fix that, feel free, but I do not know how
> you are going to keep two jobs from both trying to launch Flash Player
> Debugger at the same time and open the same socket to communicate with it,
> or try to parse the flashlog.txt that they have both written to.
>
> The royale-asjs job will use the royale-compiler workspace to get the
> compiler. If the compiler is building, the jars are not there and the
> royale-asjs build fails.
>
> There is also only so much memory and some of our jobs use all of it and
> I'm not sure if jobs slowed down due to paging memory and writing/reading
> from disk, even if it is an SSD.
>
> I'm done for tonight, but that's what I was seeing last time I tried to
> have both master and an agent running jobs in parallel.
>
> Thanks,
> -Alex
>
> On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> A typical setup would be to have 0 executors on master and at least n
> number of executors on each agent, where n = number of cpu cores.
> I see that the current VM has 2 cores. So, I started with setting the
> num
> executors on the current agent to 2.
>
> This should improve things quite a bit. If this doesn't work, I will
> create a new VM and make it the slave agent of the current Jenkins
> master.
>
>
> Thanks,
> Om
>
> On Fri, Apr 17, 2020 at 11:31 PM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > On your VM or mine? I don't think mine can handle it. I used to
> run jobs
> > of master and agent and we got lots of failures and jobs took
> forever. If
> > two jobs are trying to run tests with the shared Flash Player
> Debugger, for
> > example, you won't get consistent results.
> >
> > -Alex
> >
> > On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <bi...@gmail.com>
> wrote:
> >
> > I just realized that we have only one Agent (node) listed under
> > Jenkins. I
> > am going to add at least one more node to start with.
> >
> > Thanks,
> > Om
> >
> > On Thu, Apr 16, 2020 at 9:58 AM Alex Harui
> <ah...@adobe.com.invalid>
> > wrote:
> >
> > > I think I followed the instructions and enabled SSH.
> > >
> > > On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com>
> wrote:
> > >
> > > I haven’t gotten it to work. Could be ssh needs to be
> enabled on
> > the
> > > VM [1]. This is nice to have but not essential. So Alex, let
> me know
> > if you
> > > want to try that, otherwise I’ll suspend my efforts on this.
> > >
> > > [1]
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512817076&sdata=hxkdbHxBDgkPwstUWJME54TKz9R2X4RdeWpaVzqHQ4g%3D&reserved=0
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>
> > > Sent: Wednesday, April 15, 2020 5:09 PM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > I’d like to try and install an ssh server. Can anyone
> think of a
> > > reason not to do that? I’m asking in terms of security, and if
> there
> > might
> > > be a problem because it’s a VM.
> > >
> > > Thanks.
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>
> > > Sent: Monday, April 13, 2020 10:02 AM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > Related, as most (all?) of the instructions don’t require
> > anything but
> > > a shell wouldn’t it be easier and faster to access the machine
> with
> > ssh
> > > [1], rather than using remote desktop?
> > >
> > > [1]
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512817076&sdata=7xKvZszvpz7FovUSvShKXfYqh1b7ulWgW0ZKUkwP%2B%2F4%3D&reserved=0
> > >
> > > From: Yishay Weiss<ma...@hotmail.com>
> > > Sent: Monday, April 13, 2020 9:55 AM
> > > To: dev@royale.apache.org<ma...@royale.apache.org>
> > > Subject: RE: Prioritize Release Jobs on CI
> > >
> > > Can’t you do that with remote desktop?
> > >
> > > ________________________________
> > > From: OmPrakash Muppirala <bi...@gmail.com>
> > > Sent: Monday, April 13, 2020 9:51:25 AM
> > > To: Apache Royale Development <de...@royale.apache.org>
> > > Subject: Re: Prioritize Release Jobs on CI
> > >
> > > Alex,
> > >
> > > I believe this is your personal Azure subscription right?
> Any
> > chance
> > > I can
> > > get access to it so I can try to copy the image out the
> machine
> > and
> > > redeploy it somewhere else?
> > >
> > > Thanks,
> > > Om
> > >
> > > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > > bigosmallm@gmail.com>
> > > wrote:
> > >
> > > > I can help set this up on Azure. Give me some time to
> work
> > out the
> > > > details?
> > > >
> > > > Thanks,
> > > > Om
> > > >
> > > > On Sun, Apr 12, 2020, 11:49 AM Harbs <
> harbs.lists@gmail.com>
> > wrote:
> > > >
> > > >> OK. Good to know.
> > > >>
> > > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > > >
> > > >> wrote:
> > > >> >
> > > >> > FWIW, I just looked and the longest job in the release
> > steps so
> > > far is
> > > >> 8 minutes. Most are under 2 minutes. There might be
> jobs
> > later
> > > that take
> > > >> longer that we haven't run yet. IMO, the issue isn't
> speed
> > of the
> > > machine,
> > > >> it is just that we are sharing the machine with longer
> jobs
> > (1 hour
> > > for
> > > >> TourDeFlexMigration). And again, the machine will be
> idle for
> > > stretches of
> > > >> time while the RM verifies artifacts after each step.
> > > >> >
> > > >> > -Alex
> > > >> >
> > > >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com
> > <mailto:
> > > >> harbs.lists@gmail.com>> wrote:
> > > >> >
> > > >> > Fair enough.
> > > >> >
> > > >> > I expect builds to be somewhere between 10 and 20
> times
> > faster
> > > on a
> > > >> powerful machine.
> > > >> >
> > > >> > Yeah. It’s probably going to be a bit of work
> changing
> > the
> > > server,
> > > >> but probably worth it in the long run.
> > > >> >
> > > >> > I think I’ll try this when I do the next release
> unless
> > Yishay
> > > wants
> > > >> to work with me on this for this release — but I’m not
> going
> > to be
> > > able to
> > > >> help until after Passover (i.e. next week).
> > > >> >
> > > >> > Thanks,
> > > >> > Harbs
> > > >> >
> > > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > > >
> > > >> wrote:
> > > >> >>
> > > >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4
> GiB
> > memory)
> > > >> >>
> > > >> >> I think I am reading changes to the build process in
> your
> > > >> suggestions. I do not really want to spend more of my
> time
> > on this
> > > >> process. But if you want to do the work, that's fine
> with me.
> > > >> >>
> > > >> >> -Alex
> > > >> >>
> > > >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com
> > <mailto:
> > > >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com
> <mailto:
> > > >> harbs.lists@gmail.com>>> wrote:
> > > >> >>
> > > >> >> What kind of horsepower is included in the free
> Azure
> > account?
> > > >> >>
> > > >> >> The server I mentioned builds (considerably)
> faster than
> > my own
> > > >> local machine. The ci server seems to build many times
> slower.
> > > >> >>
> > > >> >> One thing we can do to minimize running server time
> > would be to
> > > >> transfer the artifacts to storage instead of keeping
> them on
> > the
> > > server. On
> > > >> AWS, I’d probably use S3. Not sure what the similar
> service on
> > > Azure is
> > > >> called.
> > > >> >>
> > > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > > <aharui@adobe.com.INVALID
> > > >> <ma...@adobe.com.INVALID>> wrote:
> > > >> >>>
> > > >> >>> OK, that's pretty much how I understand Azure as
> well.
> > The key
> > > thing
> > > >> is that "running" includes time where the CI server is
> not
> > running
> > > any
> > > >> Jenkins jobs. The CI Server steps might take only a few
> > hours of
> > > actual
> > > >> server time, but there is time where the RM is verifying
> > artifacts
> > > locally
> > > >> so you'd be paying for that or the RM would have to keep
> > shutting
> > > down and
> > > >> restarting.
> > > >> >>>
> > > >> >>> Seems like it would be cheaper/simpler to get the
> free
> > MSDN
> > > account
> > > >> and leave it running.
> > > >> >>>
> > > >> >>> -Alex
> > > >> >>>
> > > >> >>> On 4/12/20, 10:15 AM, "Harbs" <
> harbs.lists@gmail.com
> > <mailto:
> > > >> harbs.lists@gmail.com>> wrote:
> > > >> >>>
> > > >> >>> My experience is with AWS.
> > > >> >>>
> > > >> >>> I assume Microsoft has similar offerings, but I
> don’t
> > have
> > > >> experience with Azure.
> > > >> >>>
> > > >> >>> AWS has on-demand EC2 instances which you pay for
> only
> > the
> > > actual
> > > >> time that they are running.[1]
> > > >> >>>
> > > >> >>> Instances can be started and stopped via command
> line
> > (or via
> > > the
> > > >> web interface) as long as you have valid credentials to
> do so.
> > > >> >>>
> > > >> >>> For example: an m5.4xlarge instance has 16 cores
> and
> > costs
> > > about
> > > >> $1.5 per hour. On a machine like that, a full build
> would
> > probably
> > > take
> > > >> less than 10 minutes. It’s probably possible to do a
> full
> > release
> > > with only
> > > >> a few hours of server time.
> > > >> >>>
> > > >> >>> Leaving a server like that running all the time
> would get
> > > expensive,
> > > >> but if it’s just spun up for releases, you’d get very
> fast
> > builds
> > > at a
> > > >> reasonable price.
> > > >> >>>
> > > >> >>> I’d be happy to pay $10-$50 (and possibly more) per
> > release to
> > > make
> > > >> the release process painless for the RM.
> > > >> >>>
> > > >> >>> [1]
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512817076&sdata=BZzHQVAkum497LTo%2BiTThqSgnfPERqSgklluj8QrLKE%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > > >> ><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > > >> >><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512827061&sdata=71%2BpJHsGmOMC%2Bv9lQJdu00Rx8X20SXW5XPKRByL6ftY%3D&reserved=0
> > > >> ><
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512827061&sdata=71%2BpJHsGmOMC%2Bv9lQJdu00Rx8X20SXW5XPKRByL6ftY%3D&reserved=0
> > > >> <
> > > >>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512827061&sdata=71%2BpJHsGmOMC%2Bv9lQJdu00Rx8X20SXW5XPKRByL6ftY%3D&reserved=0
> > > >> >>>
> > > >> >>>
> > > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > > <ah...@adobe.com.INVALID>
> > > >> wrote:
> > > >> >>>>
> > > >> >>>> I'm not very experienced with spinning up
> servers. The
> > CI
> > > server we
> > > >> are using is effectively free, based on a generous
> donation
> > from
> > > Microsoft
> > > >> of MSDN accounts to ASF committers. So I leave it up
> 24/7,
> > and
> > > share the
> > > >> RDP access on private@. I think any other ASF
> committer
> > could do
> > > the
> > > >> same. IIRC, if that server actually is stopped, I have
> to
> > use my
> > > personal
> > > >> (unshared) MSDN credentials to start it again. AIUI,
> if I
> > > actually paid
> > > >> for the server, it would cost me to leave it running
> even if
> > it
> > > didn't run
> > > >> jobs between releases.
> > > >> >>>>
> > > >> >>>> Is that what you are basically saying? I think it
> might
> > be
> > > best if
> > > >> another committer got a CI server going via the MS
> donation
> > and
> > > could leave
> > > >> it up 24/7.
> > > >> >>>>
> > > >> >>>> -Alex
> > > >> >>>>
> > > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <
> harbs.lists@gmail.com>
> > wrote:
> > > >> >>>>
> > > >> >>>> I’m willing to do this.
> > > >> >>>>
> > > >> >>>> Considering that the release will be run
> infrequently, it
> > > should be
> > > >> doable to have a relatively powerful server that could
> be
> > spun up on
> > > >> demand. This is something I have setup for my own
> releases.
> > > >> >>>>
> > > >> >>>> The only complication would be that each RM would
> need
> > valid
> > > >> credentials to spin up the server.
> > > >> >>>>
> > > >> >>>> Harbs
> > > >> >>>>
> > > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > > <ah...@adobe.com.INVALID>
> > > >> wrote:
> > > >> >>>>>
> > > >> >>>>> A better solution, IMO, is for someone else to
> offer up
> > a CI
> > > server
> > > >> only for release jobs.
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
Are you saying that Java, Ant and Maven do not know how to distribute work to different cores?
To repeat my main concern: our Jenkins jobs often use shared resources. If you want to take the time to fix that, feel free, but I do not know how you are going to keep two jobs from both trying to launch Flash Player Debugger at the same time and open the same socket to communicate with it, or try to parse the flashlog.txt that they have both written to.
The royale-asjs job will use the royale-compiler workspace to get the compiler. If the compiler is building, the jars are not there and the royale-asjs build fails.
There is also only so much memory and some of our jobs use all of it and I'm not sure if jobs slowed down due to paging memory and writing/reading from disk, even if it is an SSD.
I'm done for tonight, but that's what I was seeing last time I tried to have both master and an agent running jobs in parallel.
Thanks,
-Alex
On 4/17/20, 11:52 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
A typical setup would be to have 0 executors on master and at least n
number of executors on each agent, where n = number of cpu cores.
I see that the current VM has 2 cores. So, I started with setting the num
executors on the current agent to 2.
This should improve things quite a bit. If this doesn't work, I will
create a new VM and make it the slave agent of the current Jenkins master.
Thanks,
Om
On Fri, Apr 17, 2020 at 11:31 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> On your VM or mine? I don't think mine can handle it. I used to run jobs
> of master and agent and we got lots of failures and jobs took forever. If
> two jobs are trying to run tests with the shared Flash Player Debugger, for
> example, you won't get consistent results.
>
> -Alex
>
> On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> I just realized that we have only one Agent (node) listed under
> Jenkins. I
> am going to add at least one more node to start with.
>
> Thanks,
> Om
>
> On Thu, Apr 16, 2020 at 9:58 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > I think I followed the instructions and enabled SSH.
> >
> > On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
> >
> > I haven’t gotten it to work. Could be ssh needs to be enabled on
> the
> > VM [1]. This is nice to have but not essential. So Alex, let me know
> if you
> > want to try that, otherwise I’ll suspend my efforts on this.
> >
> > [1]
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512817076&sdata=hxkdbHxBDgkPwstUWJME54TKz9R2X4RdeWpaVzqHQ4g%3D&reserved=0
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Wednesday, April 15, 2020 5:09 PM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > I’d like to try and install an ssh server. Can anyone think of a
> > reason not to do that? I’m asking in terms of security, and if there
> might
> > be a problem because it’s a VM.
> >
> > Thanks.
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Monday, April 13, 2020 10:02 AM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > Related, as most (all?) of the instructions don’t require
> anything but
> > a shell wouldn’t it be easier and faster to access the machine with
> ssh
> > [1], rather than using remote desktop?
> >
> > [1]
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512817076&sdata=7xKvZszvpz7FovUSvShKXfYqh1b7ulWgW0ZKUkwP%2B%2F4%3D&reserved=0
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Monday, April 13, 2020 9:55 AM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > Can’t you do that with remote desktop?
> >
> > ________________________________
> > From: OmPrakash Muppirala <bi...@gmail.com>
> > Sent: Monday, April 13, 2020 9:51:25 AM
> > To: Apache Royale Development <de...@royale.apache.org>
> > Subject: Re: Prioritize Release Jobs on CI
> >
> > Alex,
> >
> > I believe this is your personal Azure subscription right? Any
> chance
> > I can
> > get access to it so I can try to copy the image out the machine
> and
> > redeploy it somewhere else?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > bigosmallm@gmail.com>
> > wrote:
> >
> > > I can help set this up on Azure. Give me some time to work
> out the
> > > details?
> > >
> > > Thanks,
> > > Om
> > >
> > > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com>
> wrote:
> > >
> > >> OK. Good to know.
> > >>
> > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> <aharui@adobe.com.INVALID
> > >
> > >> wrote:
> > >> >
> > >> > FWIW, I just looked and the longest job in the release
> steps so
> > far is
> > >> 8 minutes. Most are under 2 minutes. There might be jobs
> later
> > that take
> > >> longer that we haven't run yet. IMO, the issue isn't speed
> of the
> > machine,
> > >> it is just that we are sharing the machine with longer jobs
> (1 hour
> > for
> > >> TourDeFlexMigration). And again, the machine will be idle for
> > stretches of
> > >> time while the RM verifies artifacts after each step.
> > >> >
> > >> > -Alex
> > >> >
> > >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com>> wrote:
> > >> >
> > >> > Fair enough.
> > >> >
> > >> > I expect builds to be somewhere between 10 and 20 times
> faster
> > on a
> > >> powerful machine.
> > >> >
> > >> > Yeah. It’s probably going to be a bit of work changing
> the
> > server,
> > >> but probably worth it in the long run.
> > >> >
> > >> > I think I’ll try this when I do the next release unless
> Yishay
> > wants
> > >> to work with me on this for this release — but I’m not going
> to be
> > able to
> > >> help until after Passover (i.e. next week).
> > >> >
> > >> > Thanks,
> > >> > Harbs
> > >> >
> > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> <aharui@adobe.com.INVALID
> > >
> > >> wrote:
> > >> >>
> > >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB
> memory)
> > >> >>
> > >> >> I think I am reading changes to the build process in your
> > >> suggestions. I do not really want to spend more of my time
> on this
> > >> process. But if you want to do the work, that's fine with me.
> > >> >>
> > >> >> -Alex
> > >> >>
> > >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> > >> harbs.lists@gmail.com>>> wrote:
> > >> >>
> > >> >> What kind of horsepower is included in the free Azure
> account?
> > >> >>
> > >> >> The server I mentioned builds (considerably) faster than
> my own
> > >> local machine. The ci server seems to build many times slower.
> > >> >>
> > >> >> One thing we can do to minimize running server time
> would be to
> > >> transfer the artifacts to storage instead of keeping them on
> the
> > server. On
> > >> AWS, I’d probably use S3. Not sure what the similar service on
> > Azure is
> > >> called.
> > >> >>
> > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > >> <ma...@adobe.com.INVALID>> wrote:
> > >> >>>
> > >> >>> OK, that's pretty much how I understand Azure as well.
> The key
> > thing
> > >> is that "running" includes time where the CI server is not
> running
> > any
> > >> Jenkins jobs. The CI Server steps might take only a few
> hours of
> > actual
> > >> server time, but there is time where the RM is verifying
> artifacts
> > locally
> > >> so you'd be paying for that or the RM would have to keep
> shutting
> > down and
> > >> restarting.
> > >> >>>
> > >> >>> Seems like it would be cheaper/simpler to get the free
> MSDN
> > account
> > >> and leave it running.
> > >> >>>
> > >> >>> -Alex
> > >> >>>
> > >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com>> wrote:
> > >> >>>
> > >> >>> My experience is with AWS.
> > >> >>>
> > >> >>> I assume Microsoft has similar offerings, but I don’t
> have
> > >> experience with Azure.
> > >> >>>
> > >> >>> AWS has on-demand EC2 instances which you pay for only
> the
> > actual
> > >> time that they are running.[1]
> > >> >>>
> > >> >>> Instances can be started and stopped via command line
> (or via
> > the
> > >> web interface) as long as you have valid credentials to do so.
> > >> >>>
> > >> >>> For example: an m5.4xlarge instance has 16 cores and
> costs
> > about
> > >> $1.5 per hour. On a machine like that, a full build would
> probably
> > take
> > >> less than 10 minutes. It’s probably possible to do a full
> release
> > with only
> > >> a few hours of server time.
> > >> >>>
> > >> >>> Leaving a server like that running all the time would get
> > expensive,
> > >> but if it’s just spun up for releases, you’d get very fast
> builds
> > at a
> > >> reasonable price.
> > >> >>>
> > >> >>> I’d be happy to pay $10-$50 (and possibly more) per
> release to
> > make
> > >> the release process painless for the RM.
> > >> >>>
> > >> >>> [1]
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512817076&sdata=BZzHQVAkum497LTo%2BiTThqSgnfPERqSgklluj8QrLKE%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > >> ><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > >> >><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512822068&sdata=CdCoGjKmHETJNgapXtJy4dnAjumpJE7fSEU0FhiN6g8%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512827061&sdata=71%2BpJHsGmOMC%2Bv9lQJdu00Rx8X20SXW5XPKRByL6ftY%3D&reserved=0
> > >> ><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512827061&sdata=71%2BpJHsGmOMC%2Bv9lQJdu00Rx8X20SXW5XPKRByL6ftY%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C833f9530b95943d3288908d7e3651005%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227895512827061&sdata=71%2BpJHsGmOMC%2Bv9lQJdu00Rx8X20SXW5XPKRByL6ftY%3D&reserved=0
> > >> >>>
> > >> >>>
> > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > <ah...@adobe.com.INVALID>
> > >> wrote:
> > >> >>>>
> > >> >>>> I'm not very experienced with spinning up servers. The
> CI
> > server we
> > >> are using is effectively free, based on a generous donation
> from
> > Microsoft
> > >> of MSDN accounts to ASF committers. So I leave it up 24/7,
> and
> > share the
> > >> RDP access on private@. I think any other ASF committer
> could do
> > the
> > >> same. IIRC, if that server actually is stopped, I have to
> use my
> > personal
> > >> (unshared) MSDN credentials to start it again. AIUI, if I
> > actually paid
> > >> for the server, it would cost me to leave it running even if
> it
> > didn't run
> > >> jobs between releases.
> > >> >>>>
> > >> >>>> Is that what you are basically saying? I think it might
> be
> > best if
> > >> another committer got a CI server going via the MS donation
> and
> > could leave
> > >> it up 24/7.
> > >> >>>>
> > >> >>>> -Alex
> > >> >>>>
> > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com>
> wrote:
> > >> >>>>
> > >> >>>> I’m willing to do this.
> > >> >>>>
> > >> >>>> Considering that the release will be run infrequently, it
> > should be
> > >> doable to have a relatively powerful server that could be
> spun up on
> > >> demand. This is something I have setup for my own releases.
> > >> >>>>
> > >> >>>> The only complication would be that each RM would need
> valid
> > >> credentials to spin up the server.
> > >> >>>>
> > >> >>>> Harbs
> > >> >>>>
> > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > <ah...@adobe.com.INVALID>
> > >> wrote:
> > >> >>>>>
> > >> >>>>> A better solution, IMO, is for someone else to offer up
> a CI
> > server
> > >> only for release jobs.
> > >>
> > >>
> >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
A typical setup would be to have 0 executors on master and at least n
number of executors on each agent, where n = number of cpu cores.
I see that the current VM has 2 cores. So, I started with setting the num
executors on the current agent to 2.
This should improve things quite a bit. If this doesn't work, I will
create a new VM and make it the slave agent of the current Jenkins master.
Thanks,
Om
On Fri, Apr 17, 2020 at 11:31 PM Alex Harui <ah...@adobe.com.invalid>
wrote:
> On your VM or mine? I don't think mine can handle it. I used to run jobs
> of master and agent and we got lots of failures and jobs took forever. If
> two jobs are trying to run tests with the shared Flash Player Debugger, for
> example, you won't get consistent results.
>
> -Alex
>
> On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
>
> I just realized that we have only one Agent (node) listed under
> Jenkins. I
> am going to add at least one more node to start with.
>
> Thanks,
> Om
>
> On Thu, Apr 16, 2020 at 9:58 AM Alex Harui <ah...@adobe.com.invalid>
> wrote:
>
> > I think I followed the instructions and enabled SSH.
> >
> > On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
> >
> > I haven’t gotten it to work. Could be ssh needs to be enabled on
> the
> > VM [1]. This is nice to have but not essential. So Alex, let me know
> if you
> > want to try that, otherwise I’ll suspend my efforts on this.
> >
> > [1]
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016381273&sdata=F%2BK15FxeXOKB5eMLeLLF5h2htv3KOMwhh4tal9mX3E4%3D&reserved=0
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Wednesday, April 15, 2020 5:09 PM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > I’d like to try and install an ssh server. Can anyone think of a
> > reason not to do that? I’m asking in terms of security, and if there
> might
> > be a problem because it’s a VM.
> >
> > Thanks.
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Monday, April 13, 2020 10:02 AM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > Related, as most (all?) of the instructions don’t require
> anything but
> > a shell wouldn’t it be easier and faster to access the machine with
> ssh
> > [1], rather than using remote desktop?
> >
> > [1]
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016381273&sdata=YFufQTJU3eLIXLTur%2Fz2ZGfzdTOc5Mjszbayd7z5r3o%3D&reserved=0
> >
> > From: Yishay Weiss<ma...@hotmail.com>
> > Sent: Monday, April 13, 2020 9:55 AM
> > To: dev@royale.apache.org<ma...@royale.apache.org>
> > Subject: RE: Prioritize Release Jobs on CI
> >
> > Can’t you do that with remote desktop?
> >
> > ________________________________
> > From: OmPrakash Muppirala <bi...@gmail.com>
> > Sent: Monday, April 13, 2020 9:51:25 AM
> > To: Apache Royale Development <de...@royale.apache.org>
> > Subject: Re: Prioritize Release Jobs on CI
> >
> > Alex,
> >
> > I believe this is your personal Azure subscription right? Any
> chance
> > I can
> > get access to it so I can try to copy the image out the machine
> and
> > redeploy it somewhere else?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> > bigosmallm@gmail.com>
> > wrote:
> >
> > > I can help set this up on Azure. Give me some time to work
> out the
> > > details?
> > >
> > > Thanks,
> > > Om
> > >
> > > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com>
> wrote:
> > >
> > >> OK. Good to know.
> > >>
> > >> > On Apr 12, 2020, at 9:45 PM, Alex Harui
> <aharui@adobe.com.INVALID
> > >
> > >> wrote:
> > >> >
> > >> > FWIW, I just looked and the longest job in the release
> steps so
> > far is
> > >> 8 minutes. Most are under 2 minutes. There might be jobs
> later
> > that take
> > >> longer that we haven't run yet. IMO, the issue isn't speed
> of the
> > machine,
> > >> it is just that we are sharing the machine with longer jobs
> (1 hour
> > for
> > >> TourDeFlexMigration). And again, the machine will be idle for
> > stretches of
> > >> time while the RM verifies artifacts after each step.
> > >> >
> > >> > -Alex
> > >> >
> > >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com>> wrote:
> > >> >
> > >> > Fair enough.
> > >> >
> > >> > I expect builds to be somewhere between 10 and 20 times
> faster
> > on a
> > >> powerful machine.
> > >> >
> > >> > Yeah. It’s probably going to be a bit of work changing
> the
> > server,
> > >> but probably worth it in the long run.
> > >> >
> > >> > I think I’ll try this when I do the next release unless
> Yishay
> > wants
> > >> to work with me on this for this release — but I’m not going
> to be
> > able to
> > >> help until after Passover (i.e. next week).
> > >> >
> > >> > Thanks,
> > >> > Harbs
> > >> >
> > >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui
> <aharui@adobe.com.INVALID
> > >
> > >> wrote:
> > >> >>
> > >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB
> memory)
> > >> >>
> > >> >> I think I am reading changes to the build process in your
> > >> suggestions. I do not really want to spend more of my time
> on this
> > >> process. But if you want to do the work, that's fine with me.
> > >> >>
> > >> >> -Alex
> > >> >>
> > >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> > >> harbs.lists@gmail.com>>> wrote:
> > >> >>
> > >> >> What kind of horsepower is included in the free Azure
> account?
> > >> >>
> > >> >> The server I mentioned builds (considerably) faster than
> my own
> > >> local machine. The ci server seems to build many times slower.
> > >> >>
> > >> >> One thing we can do to minimize running server time
> would be to
> > >> transfer the artifacts to storage instead of keeping them on
> the
> > server. On
> > >> AWS, I’d probably use S3. Not sure what the similar service on
> > Azure is
> > >> called.
> > >> >>
> > >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> > <aharui@adobe.com.INVALID
> > >> <ma...@adobe.com.INVALID>> wrote:
> > >> >>>
> > >> >>> OK, that's pretty much how I understand Azure as well.
> The key
> > thing
> > >> is that "running" includes time where the CI server is not
> running
> > any
> > >> Jenkins jobs. The CI Server steps might take only a few
> hours of
> > actual
> > >> server time, but there is time where the RM is verifying
> artifacts
> > locally
> > >> so you'd be paying for that or the RM would have to keep
> shutting
> > down and
> > >> restarting.
> > >> >>>
> > >> >>> Seems like it would be cheaper/simpler to get the free
> MSDN
> > account
> > >> and leave it running.
> > >> >>>
> > >> >>> -Alex
> > >> >>>
> > >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com
> <mailto:
> > >> harbs.lists@gmail.com>> wrote:
> > >> >>>
> > >> >>> My experience is with AWS.
> > >> >>>
> > >> >>> I assume Microsoft has similar offerings, but I don’t
> have
> > >> experience with Azure.
> > >> >>>
> > >> >>> AWS has on-demand EC2 instances which you pay for only
> the
> > actual
> > >> time that they are running.[1]
> > >> >>>
> > >> >>> Instances can be started and stopped via command line
> (or via
> > the
> > >> web interface) as long as you have valid credentials to do so.
> > >> >>>
> > >> >>> For example: an m5.4xlarge instance has 16 cores and
> costs
> > about
> > >> $1.5 per hour. On a machine like that, a full build would
> probably
> > take
> > >> less than 10 minutes. It’s probably possible to do a full
> release
> > with only
> > >> a few hours of server time.
> > >> >>>
> > >> >>> Leaving a server like that running all the time would get
> > expensive,
> > >> but if it’s just spun up for releases, you’d get very fast
> builds
> > at a
> > >> reasonable price.
> > >> >>>
> > >> >>> I’d be happy to pay $10-$50 (and possibly more) per
> release to
> > make
> > >> the release process painless for the RM.
> > >> >>>
> > >> >>> [1]
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> ><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> >><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> ><
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> <
> > >>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> > >> >>>
> > >> >>>
> > >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> > <ah...@adobe.com.INVALID>
> > >> wrote:
> > >> >>>>
> > >> >>>> I'm not very experienced with spinning up servers. The
> CI
> > server we
> > >> are using is effectively free, based on a generous donation
> from
> > Microsoft
> > >> of MSDN accounts to ASF committers. So I leave it up 24/7,
> and
> > share the
> > >> RDP access on private@. I think any other ASF committer
> could do
> > the
> > >> same. IIRC, if that server actually is stopped, I have to
> use my
> > personal
> > >> (unshared) MSDN credentials to start it again. AIUI, if I
> > actually paid
> > >> for the server, it would cost me to leave it running even if
> it
> > didn't run
> > >> jobs between releases.
> > >> >>>>
> > >> >>>> Is that what you are basically saying? I think it might
> be
> > best if
> > >> another committer got a CI server going via the MS donation
> and
> > could leave
> > >> it up 24/7.
> > >> >>>>
> > >> >>>> -Alex
> > >> >>>>
> > >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com>
> wrote:
> > >> >>>>
> > >> >>>> I’m willing to do this.
> > >> >>>>
> > >> >>>> Considering that the release will be run infrequently, it
> > should be
> > >> doable to have a relatively powerful server that could be
> spun up on
> > >> demand. This is something I have setup for my own releases.
> > >> >>>>
> > >> >>>> The only complication would be that each RM would need
> valid
> > >> credentials to spin up the server.
> > >> >>>>
> > >> >>>> Harbs
> > >> >>>>
> > >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> > <ah...@adobe.com.INVALID>
> > >> wrote:
> > >> >>>>>
> > >> >>>>> A better solution, IMO, is for someone else to offer up
> a CI
> > server
> > >> only for release jobs.
> > >>
> > >>
> >
> >
> >
> >
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
On your VM or mine? I don't think mine can handle it. I used to run jobs of master and agent and we got lots of failures and jobs took forever. If two jobs are trying to run tests with the shared Flash Player Debugger, for example, you won't get consistent results.
-Alex
On 4/17/20, 11:23 PM, "OmPrakash Muppirala" <bi...@gmail.com> wrote:
I just realized that we have only one Agent (node) listed under Jenkins. I
am going to add at least one more node to start with.
Thanks,
Om
On Thu, Apr 16, 2020 at 9:58 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> I think I followed the instructions and enabled SSH.
>
> On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
>
> I haven’t gotten it to work. Could be ssh needs to be enabled on the
> VM [1]. This is nice to have but not essential. So Alex, let me know if you
> want to try that, otherwise I’ll suspend my efforts on this.
>
> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016381273&sdata=F%2BK15FxeXOKB5eMLeLLF5h2htv3KOMwhh4tal9mX3E4%3D&reserved=0
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Wednesday, April 15, 2020 5:09 PM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> I’d like to try and install an ssh server. Can anyone think of a
> reason not to do that? I’m asking in terms of security, and if there might
> be a problem because it’s a VM.
>
> Thanks.
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 10:02 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Related, as most (all?) of the instructions don’t require anything but
> a shell wouldn’t it be easier and faster to access the machine with ssh
> [1], rather than using remote desktop?
>
> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016381273&sdata=YFufQTJU3eLIXLTur%2Fz2ZGfzdTOc5Mjszbayd7z5r3o%3D&reserved=0
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 9:55 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Can’t you do that with remote desktop?
>
> ________________________________
> From: OmPrakash Muppirala <bi...@gmail.com>
> Sent: Monday, April 13, 2020 9:51:25 AM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> Alex,
>
> I believe this is your personal Azure subscription right? Any chance
> I can
> get access to it so I can try to copy the image out the machine and
> redeploy it somewhere else?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > I can help set this up on Azure. Give me some time to work out the
> > details?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
> >
> >> OK. Good to know.
> >>
> >> > On Apr 12, 2020, at 9:45 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >
> >> > FWIW, I just looked and the longest job in the release steps so
> far is
> >> 8 minutes. Most are under 2 minutes. There might be jobs later
> that take
> >> longer that we haven't run yet. IMO, the issue isn't speed of the
> machine,
> >> it is just that we are sharing the machine with longer jobs (1 hour
> for
> >> TourDeFlexMigration). And again, the machine will be idle for
> stretches of
> >> time while the RM verifies artifacts after each step.
> >> >
> >> > -Alex
> >> >
> >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >
> >> > Fair enough.
> >> >
> >> > I expect builds to be somewhere between 10 and 20 times faster
> on a
> >> powerful machine.
> >> >
> >> > Yeah. It’s probably going to be a bit of work changing the
> server,
> >> but probably worth it in the long run.
> >> >
> >> > I think I’ll try this when I do the next release unless Yishay
> wants
> >> to work with me on this for this release — but I’m not going to be
> able to
> >> help until after Passover (i.e. next week).
> >> >
> >> > Thanks,
> >> > Harbs
> >> >
> >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >>
> >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
> >> >>
> >> >> I think I am reading changes to the build process in your
> >> suggestions. I do not really want to spend more of my time on this
> >> process. But if you want to do the work, that's fine with me.
> >> >>
> >> >> -Alex
> >> >>
> >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>>> wrote:
> >> >>
> >> >> What kind of horsepower is included in the free Azure account?
> >> >>
> >> >> The server I mentioned builds (considerably) faster than my own
> >> local machine. The ci server seems to build many times slower.
> >> >>
> >> >> One thing we can do to minimize running server time would be to
> >> transfer the artifacts to storage instead of keeping them on the
> server. On
> >> AWS, I’d probably use S3. Not sure what the similar service on
> Azure is
> >> called.
> >> >>
> >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> <aharui@adobe.com.INVALID
> >> <ma...@adobe.com.INVALID>> wrote:
> >> >>>
> >> >>> OK, that's pretty much how I understand Azure as well. The key
> thing
> >> is that "running" includes time where the CI server is not running
> any
> >> Jenkins jobs. The CI Server steps might take only a few hours of
> actual
> >> server time, but there is time where the RM is verifying artifacts
> locally
> >> so you'd be paying for that or the RM would have to keep shutting
> down and
> >> restarting.
> >> >>>
> >> >>> Seems like it would be cheaper/simpler to get the free MSDN
> account
> >> and leave it running.
> >> >>>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >>>
> >> >>> My experience is with AWS.
> >> >>>
> >> >>> I assume Microsoft has similar offerings, but I don’t have
> >> experience with Azure.
> >> >>>
> >> >>> AWS has on-demand EC2 instances which you pay for only the
> actual
> >> time that they are running.[1]
> >> >>>
> >> >>> Instances can be started and stopped via command line (or via
> the
> >> web interface) as long as you have valid credentials to do so.
> >> >>>
> >> >>> For example: an m5.4xlarge instance has 16 cores and costs
> about
> >> $1.5 per hour. On a machine like that, a full build would probably
> take
> >> less than 10 minutes. It’s probably possible to do a full release
> with only
> >> a few hours of server time.
> >> >>>
> >> >>> Leaving a server like that running all the time would get
> expensive,
> >> but if it’s just spun up for releases, you’d get very fast builds
> at a
> >> reasonable price.
> >> >>>
> >> >>> I’d be happy to pay $10-$50 (and possibly more) per release to
> make
> >> the release process painless for the RM.
> >> >>>
> >> >>> [1]
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> >><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9296a39419024731f58b08d7e360fcfb%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637227878016391271&sdata=tz0EZzy8wGtQVeN%2Bnc1ofMlJ6zpKLM2wWMnX%2BAcMJa4%3D&reserved=0
> >> >>>
> >> >>>
> >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>
> >> >>>> I'm not very experienced with spinning up servers. The CI
> server we
> >> are using is effectively free, based on a generous donation from
> Microsoft
> >> of MSDN accounts to ASF committers. So I leave it up 24/7, and
> share the
> >> RDP access on private@. I think any other ASF committer could do
> the
> >> same. IIRC, if that server actually is stopped, I have to use my
> personal
> >> (unshared) MSDN credentials to start it again. AIUI, if I
> actually paid
> >> for the server, it would cost me to leave it running even if it
> didn't run
> >> jobs between releases.
> >> >>>>
> >> >>>> Is that what you are basically saying? I think it might be
> best if
> >> another committer got a CI server going via the MS donation and
> could leave
> >> it up 24/7.
> >> >>>>
> >> >>>> -Alex
> >> >>>>
> >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
> >> >>>>
> >> >>>> I’m willing to do this.
> >> >>>>
> >> >>>> Considering that the release will be run infrequently, it
> should be
> >> doable to have a relatively powerful server that could be spun up on
> >> demand. This is something I have setup for my own releases.
> >> >>>>
> >> >>>> The only complication would be that each RM would need valid
> >> credentials to spin up the server.
> >> >>>>
> >> >>>> Harbs
> >> >>>>
> >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>>
> >> >>>>> A better solution, IMO, is for someone else to offer up a CI
> server
> >> only for release jobs.
> >>
> >>
>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
I just realized that we have only one Agent (node) listed under Jenkins. I
am going to add at least one more node to start with.
Thanks,
Om
On Thu, Apr 16, 2020 at 9:58 AM Alex Harui <ah...@adobe.com.invalid> wrote:
> I think I followed the instructions and enabled SSH.
>
> On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
>
> I haven’t gotten it to work. Could be ssh needs to be enabled on the
> VM [1]. This is nice to have but not essential. So Alex, let me know if you
> want to try that, otherwise I’ll suspend my efforts on this.
>
> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=mqUm5RGL%2B3rI%2F3VPHUDbwcQTL1gFaNP0lHcTryzWFIc%3D&reserved=0
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Wednesday, April 15, 2020 5:09 PM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> I’d like to try and install an ssh server. Can anyone think of a
> reason not to do that? I’m asking in terms of security, and if there might
> be a problem because it’s a VM.
>
> Thanks.
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 10:02 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Related, as most (all?) of the instructions don’t require anything but
> a shell wouldn’t it be easier and faster to access the machine with ssh
> [1], rather than using remote desktop?
>
> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=gRrAdP2dDbrSwl40rGZhzQG7SWw4D0SWmg9XuTRhGYY%3D&reserved=0
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 9:55 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Can’t you do that with remote desktop?
>
> ________________________________
> From: OmPrakash Muppirala <bi...@gmail.com>
> Sent: Monday, April 13, 2020 9:51:25 AM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> Alex,
>
> I believe this is your personal Azure subscription right? Any chance
> I can
> get access to it so I can try to copy the image out the machine and
> redeploy it somewhere else?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <
> bigosmallm@gmail.com>
> wrote:
>
> > I can help set this up on Azure. Give me some time to work out the
> > details?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
> >
> >> OK. Good to know.
> >>
> >> > On Apr 12, 2020, at 9:45 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >
> >> > FWIW, I just looked and the longest job in the release steps so
> far is
> >> 8 minutes. Most are under 2 minutes. There might be jobs later
> that take
> >> longer that we haven't run yet. IMO, the issue isn't speed of the
> machine,
> >> it is just that we are sharing the machine with longer jobs (1 hour
> for
> >> TourDeFlexMigration). And again, the machine will be idle for
> stretches of
> >> time while the RM verifies artifacts after each step.
> >> >
> >> > -Alex
> >> >
> >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >
> >> > Fair enough.
> >> >
> >> > I expect builds to be somewhere between 10 and 20 times faster
> on a
> >> powerful machine.
> >> >
> >> > Yeah. It’s probably going to be a bit of work changing the
> server,
> >> but probably worth it in the long run.
> >> >
> >> > I think I’ll try this when I do the next release unless Yishay
> wants
> >> to work with me on this for this release — but I’m not going to be
> able to
> >> help until after Passover (i.e. next week).
> >> >
> >> > Thanks,
> >> > Harbs
> >> >
> >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >>
> >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
> >> >>
> >> >> I think I am reading changes to the build process in your
> >> suggestions. I do not really want to spend more of my time on this
> >> process. But if you want to do the work, that's fine with me.
> >> >>
> >> >> -Alex
> >> >>
> >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>>> wrote:
> >> >>
> >> >> What kind of horsepower is included in the free Azure account?
> >> >>
> >> >> The server I mentioned builds (considerably) faster than my own
> >> local machine. The ci server seems to build many times slower.
> >> >>
> >> >> One thing we can do to minimize running server time would be to
> >> transfer the artifacts to storage instead of keeping them on the
> server. On
> >> AWS, I’d probably use S3. Not sure what the similar service on
> Azure is
> >> called.
> >> >>
> >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui
> <aharui@adobe.com.INVALID
> >> <ma...@adobe.com.INVALID>> wrote:
> >> >>>
> >> >>> OK, that's pretty much how I understand Azure as well. The key
> thing
> >> is that "running" includes time where the CI server is not running
> any
> >> Jenkins jobs. The CI Server steps might take only a few hours of
> actual
> >> server time, but there is time where the RM is verifying artifacts
> locally
> >> so you'd be paying for that or the RM would have to keep shutting
> down and
> >> restarting.
> >> >>>
> >> >>> Seems like it would be cheaper/simpler to get the free MSDN
> account
> >> and leave it running.
> >> >>>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >>>
> >> >>> My experience is with AWS.
> >> >>>
> >> >>> I assume Microsoft has similar offerings, but I don’t have
> >> experience with Azure.
> >> >>>
> >> >>> AWS has on-demand EC2 instances which you pay for only the
> actual
> >> time that they are running.[1]
> >> >>>
> >> >>> Instances can be started and stopped via command line (or via
> the
> >> web interface) as long as you have valid credentials to do so.
> >> >>>
> >> >>> For example: an m5.4xlarge instance has 16 cores and costs
> about
> >> $1.5 per hour. On a machine like that, a full build would probably
> take
> >> less than 10 minutes. It’s probably possible to do a full release
> with only
> >> a few hours of server time.
> >> >>>
> >> >>> Leaving a server like that running all the time would get
> expensive,
> >> but if it’s just spun up for releases, you’d get very fast builds
> at a
> >> reasonable price.
> >> >>>
> >> >>> I’d be happy to pay $10-$50 (and possibly more) per release to
> make
> >> the release process painless for the RM.
> >> >>>
> >> >>> [1]
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> >><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
> >> >>>
> >> >>>
> >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>
> >> >>>> I'm not very experienced with spinning up servers. The CI
> server we
> >> are using is effectively free, based on a generous donation from
> Microsoft
> >> of MSDN accounts to ASF committers. So I leave it up 24/7, and
> share the
> >> RDP access on private@. I think any other ASF committer could do
> the
> >> same. IIRC, if that server actually is stopped, I have to use my
> personal
> >> (unshared) MSDN credentials to start it again. AIUI, if I
> actually paid
> >> for the server, it would cost me to leave it running even if it
> didn't run
> >> jobs between releases.
> >> >>>>
> >> >>>> Is that what you are basically saying? I think it might be
> best if
> >> another committer got a CI server going via the MS donation and
> could leave
> >> it up 24/7.
> >> >>>>
> >> >>>> -Alex
> >> >>>>
> >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
> >> >>>>
> >> >>>> I’m willing to do this.
> >> >>>>
> >> >>>> Considering that the release will be run infrequently, it
> should be
> >> doable to have a relatively powerful server that could be spun up on
> >> demand. This is something I have setup for my own releases.
> >> >>>>
> >> >>>> The only complication would be that each RM would need valid
> >> credentials to spin up the server.
> >> >>>>
> >> >>>> Harbs
> >> >>>>
> >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui
> <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>>
> >> >>>>> A better solution, IMO, is for someone else to offer up a CI
> server
> >> only for release jobs.
> >>
> >>
>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
I think I followed the instructions and enabled SSH.
On 4/16/20, 9:37 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
I haven’t gotten it to work. Could be ssh needs to be enabled on the VM [1]. This is nice to have but not essential. So Alex, let me know if you want to try that, otherwise I’ll suspend my efforts on this.
[1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmedium.com%2Ftechinpieces%2Fpractical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=mqUm5RGL%2B3rI%2F3VPHUDbwcQTL1gFaNP0lHcTryzWFIc%3D&reserved=0
From: Yishay Weiss<ma...@hotmail.com>
Sent: Wednesday, April 15, 2020 5:09 PM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
I’d like to try and install an ssh server. Can anyone think of a reason not to do that? I’m asking in terms of security, and if there might be a problem because it’s a VM.
Thanks.
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 10:02 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Related, as most (all?) of the instructions don’t require anything but a shell wouldn’t it be easier and faster to access the machine with ssh [1], rather than using remote desktop?
[1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fwindows-server%2Fadministration%2Fopenssh%2Fopenssh_install_firstuse&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=gRrAdP2dDbrSwl40rGZhzQG7SWw4D0SWmg9XuTRhGYY%3D&reserved=0
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 9:55 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Can’t you do that with remote desktop?
________________________________
From: OmPrakash Muppirala <bi...@gmail.com>
Sent: Monday, April 13, 2020 9:51:25 AM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Ce67059c2037046cb064108d7e2246f35%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637226518430398302&sdata=hJAJvsyuh42sJFnd9c%2BQdzEvcgxC3U4of%2FRLvWu9Uyo%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
Update: Alex and I connected last night and I now have access to the VM on
Azure. I am going to try cloning the VM now.
On that note, Alex, I am turning on backups on the VM, because it is good
to have in any case.
Thanks,
Om
On Thu, Apr 16, 2020 at 9:37 AM Yishay Weiss <yi...@hotmail.com> wrote:
> I haven’t gotten it to work. Could be ssh needs to be enabled on the VM
> [1]. This is nice to have but not essential. So Alex, let me know if you
> want to try that, otherwise I’ll suspend my efforts on this.
>
> [1]
> https://medium.com/techinpieces/practical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Wednesday, April 15, 2020 5:09 PM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> I’d like to try and install an ssh server. Can anyone think of a reason
> not to do that? I’m asking in terms of security, and if there might be a
> problem because it’s a VM.
>
> Thanks.
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 10:02 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Related, as most (all?) of the instructions don’t require anything but a
> shell wouldn’t it be easier and faster to access the machine with ssh [1],
> rather than using remote desktop?
>
> [1]
> https://docs.microsoft.com/en-us/windows-server/administration/openssh/openssh_install_firstuse
>
> From: Yishay Weiss<ma...@hotmail.com>
> Sent: Monday, April 13, 2020 9:55 AM
> To: dev@royale.apache.org<ma...@royale.apache.org>
> Subject: RE: Prioritize Release Jobs on CI
>
> Can’t you do that with remote desktop?
>
> ________________________________
> From: OmPrakash Muppirala <bi...@gmail.com>
> Sent: Monday, April 13, 2020 9:51:25 AM
> To: Apache Royale Development <de...@royale.apache.org>
> Subject: Re: Prioritize Release Jobs on CI
>
> Alex,
>
> I believe this is your personal Azure subscription right? Any chance I can
> get access to it so I can try to copy the image out the machine and
> redeploy it somewhere else?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
> wrote:
>
> > I can help set this up on Azure. Give me some time to work out the
> > details?
> >
> > Thanks,
> > Om
> >
> > On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
> >
> >> OK. Good to know.
> >>
> >> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
> >> wrote:
> >> >
> >> > FWIW, I just looked and the longest job in the release steps so far is
> >> 8 minutes. Most are under 2 minutes. There might be jobs later that
> take
> >> longer that we haven't run yet. IMO, the issue isn't speed of the
> machine,
> >> it is just that we are sharing the machine with longer jobs (1 hour for
> >> TourDeFlexMigration). And again, the machine will be idle for
> stretches of
> >> time while the RM verifies artifacts after each step.
> >> >
> >> > -Alex
> >> >
> >> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >
> >> > Fair enough.
> >> >
> >> > I expect builds to be somewhere between 10 and 20 times faster on a
> >> powerful machine.
> >> >
> >> > Yeah. It’s probably going to be a bit of work changing the server,
> >> but probably worth it in the long run.
> >> >
> >> > I think I’ll try this when I do the next release unless Yishay
> wants
> >> to work with me on this for this release — but I’m not going to be able
> to
> >> help until after Passover (i.e. next week).
> >> >
> >> > Thanks,
> >> > Harbs
> >> >
> >> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>
> >> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
> >> >>
> >> >> I think I am reading changes to the build process in your
> >> suggestions. I do not really want to spend more of my time on this
> >> process. But if you want to do the work, that's fine with me.
> >> >>
> >> >> -Alex
> >> >>
> >> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>>> wrote:
> >> >>
> >> >> What kind of horsepower is included in the free Azure account?
> >> >>
> >> >> The server I mentioned builds (considerably) faster than my own
> >> local machine. The ci server seems to build many times slower.
> >> >>
> >> >> One thing we can do to minimize running server time would be to
> >> transfer the artifacts to storage instead of keeping them on the
> server. On
> >> AWS, I’d probably use S3. Not sure what the similar service on Azure is
> >> called.
> >> >>
> >> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
> >> <ma...@adobe.com.INVALID>> wrote:
> >> >>>
> >> >>> OK, that's pretty much how I understand Azure as well. The key
> thing
> >> is that "running" includes time where the CI server is not running any
> >> Jenkins jobs. The CI Server steps might take only a few hours of actual
> >> server time, but there is time where the RM is verifying artifacts
> locally
> >> so you'd be paying for that or the RM would have to keep shutting down
> and
> >> restarting.
> >> >>>
> >> >>> Seems like it would be cheaper/simpler to get the free MSDN account
> >> and leave it running.
> >> >>>
> >> >>> -Alex
> >> >>>
> >> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> >> harbs.lists@gmail.com>> wrote:
> >> >>>
> >> >>> My experience is with AWS.
> >> >>>
> >> >>> I assume Microsoft has similar offerings, but I don’t have
> >> experience with Azure.
> >> >>>
> >> >>> AWS has on-demand EC2 instances which you pay for only the actual
> >> time that they are running.[1]
> >> >>>
> >> >>> Instances can be started and stopped via command line (or via the
> >> web interface) as long as you have valid credentials to do so.
> >> >>>
> >> >>> For example: an m5.4xlarge instance has 16 cores and costs about
> >> $1.5 per hour. On a machine like that, a full build would probably take
> >> less than 10 minutes. It’s probably possible to do a full release with
> only
> >> a few hours of server time.
> >> >>>
> >> >>> Leaving a server like that running all the time would get
> expensive,
> >> but if it’s just spun up for releases, you’d get very fast builds at a
> >> reasonable price.
> >> >>>
> >> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
> >> the release process painless for the RM.
> >> >>>
> >> >>> [1]
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> >><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> ><
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> <
> >>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >> >>>
> >> >>>
> >> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
> >> wrote:
> >> >>>>
> >> >>>> I'm not very experienced with spinning up servers. The CI server
> we
> >> are using is effectively free, based on a generous donation from
> Microsoft
> >> of MSDN accounts to ASF committers. So I leave it up 24/7, and share
> the
> >> RDP access on private@. I think any other ASF committer could do the
> >> same. IIRC, if that server actually is stopped, I have to use my
> personal
> >> (unshared) MSDN credentials to start it again. AIUI, if I actually
> paid
> >> for the server, it would cost me to leave it running even if it didn't
> run
> >> jobs between releases.
> >> >>>>
> >> >>>> Is that what you are basically saying? I think it might be best if
> >> another committer got a CI server going via the MS donation and could
> leave
> >> it up 24/7.
> >> >>>>
> >> >>>> -Alex
> >> >>>>
> >> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
> >> >>>>
> >> >>>> I’m willing to do this.
> >> >>>>
> >> >>>> Considering that the release will be run infrequently, it should be
> >> doable to have a relatively powerful server that could be spun up on
> >> demand. This is something I have setup for my own releases.
> >> >>>>
> >> >>>> The only complication would be that each RM would need valid
> >> credentials to spin up the server.
> >> >>>>
> >> >>>> Harbs
> >> >>>>
> >> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <aharui@adobe.com.INVALID
> >
> >> wrote:
> >> >>>>>
> >> >>>>> A better solution, IMO, is for someone else to offer up a CI
> server
> >> only for release jobs.
> >>
> >>
>
>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
I haven’t gotten it to work. Could be ssh needs to be enabled on the VM [1]. This is nice to have but not essential. So Alex, let me know if you want to try that, otherwise I’ll suspend my efforts on this.
[1] https://medium.com/techinpieces/practical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e
From: Yishay Weiss<ma...@hotmail.com>
Sent: Wednesday, April 15, 2020 5:09 PM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
I’d like to try and install an ssh server. Can anyone think of a reason not to do that? I’m asking in terms of security, and if there might be a problem because it’s a VM.
Thanks.
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 10:02 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Related, as most (all?) of the instructions don’t require anything but a shell wouldn’t it be easier and faster to access the machine with ssh [1], rather than using remote desktop?
[1] https://docs.microsoft.com/en-us/windows-server/administration/openssh/openssh_install_firstuse
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 9:55 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Can’t you do that with remote desktop?
________________________________
From: OmPrakash Muppirala <bi...@gmail.com>
Sent: Monday, April 13, 2020 9:51:25 AM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
Re: Prioritize Release Jobs on CI
Posted by Carlos Rovira <ca...@apache.org>.
Hi,
for me is not a problem always that is not any official things as the rest
of CI or other additional things that people would want to ease his work as
RM.
In my case , I'll prefer to stick with the simplest way.
Thanks
El mié., 15 abr. 2020 a las 18:18, Alex Harui (<ah...@adobe.com.invalid>)
escribió:
>
>
> On 4/15/20, 7:09 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
>
> I’d like to try and install an ssh server. Can anyone think of a
> reason not to do that? I’m asking in terms of security, and if there might
> be a problem because it’s a VM.
>
> I have no idea about stuff like this. Note that you will be responsible
> for updating the RM documentation as I believe the SSH shell may not
> support Windows command-line. But I think most of the commands are not
> Windows-specific.
>
> -Alex
>
>
>
--
Carlos Rovira
http://about.me/carlosrovira
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
On 4/15/20, 7:09 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
I’d like to try and install an ssh server. Can anyone think of a reason not to do that? I’m asking in terms of security, and if there might be a problem because it’s a VM.
I have no idea about stuff like this. Note that you will be responsible for updating the RM documentation as I believe the SSH shell may not support Windows command-line. But I think most of the commands are not Windows-specific.
-Alex
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
I’d like to try and install an ssh server. Can anyone think of a reason not to do that? I’m asking in terms of security, and if there might be a problem because it’s a VM.
Thanks.
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 10:02 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Related, as most (all?) of the instructions don’t require anything but a shell wouldn’t it be easier and faster to access the machine with ssh [1], rather than using remote desktop?
[1] https://docs.microsoft.com/en-us/windows-server/administration/openssh/openssh_install_firstuse
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 9:55 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Can’t you do that with remote desktop?
________________________________
From: OmPrakash Muppirala <bi...@gmail.com>
Sent: Monday, April 13, 2020 9:51:25 AM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
Related, as most (all?) of the instructions don’t require anything but a shell wouldn’t it be easier and faster to access the machine with ssh [1], rather than using remote desktop?
[1] https://docs.microsoft.com/en-us/windows-server/administration/openssh/openssh_install_firstuse
From: Yishay Weiss<ma...@hotmail.com>
Sent: Monday, April 13, 2020 9:55 AM
To: dev@royale.apache.org<ma...@royale.apache.org>
Subject: RE: Prioritize Release Jobs on CI
Can’t you do that with remote desktop?
________________________________
From: OmPrakash Muppirala <bi...@gmail.com>
Sent: Monday, April 13, 2020 9:51:25 AM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
RE: Prioritize Release Jobs on CI
Posted by Yishay Weiss <yi...@hotmail.com>.
Can’t you do that with remote desktop?
________________________________
From: OmPrakash Muppirala <bi...@gmail.com>
Sent: Monday, April 13, 2020 9:51:25 AM
To: Apache Royale Development <de...@royale.apache.org>
Subject: Re: Prioritize Release Jobs on CI
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
Alex,
I believe this is your personal Azure subscription right? Any chance I can
get access to it so I can try to copy the image out the machine and
redeploy it somewhere else?
Thanks,
Om
On Sun, Apr 12, 2020 at 6:18 PM OmPrakash Muppirala <bi...@gmail.com>
wrote:
> I can help set this up on Azure. Give me some time to work out the
> details?
>
> Thanks,
> Om
>
> On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
>
>> OK. Good to know.
>>
>> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >
>> > FWIW, I just looked and the longest job in the release steps so far is
>> 8 minutes. Most are under 2 minutes. There might be jobs later that take
>> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
>> it is just that we are sharing the machine with longer jobs (1 hour for
>> TourDeFlexMigration). And again, the machine will be idle for stretches of
>> time while the RM verifies artifacts after each step.
>> >
>> > -Alex
>> >
>> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >
>> > Fair enough.
>> >
>> > I expect builds to be somewhere between 10 and 20 times faster on a
>> powerful machine.
>> >
>> > Yeah. It’s probably going to be a bit of work changing the server,
>> but probably worth it in the long run.
>> >
>> > I think I’ll try this when I do the next release unless Yishay wants
>> to work with me on this for this release — but I’m not going to be able to
>> help until after Passover (i.e. next week).
>> >
>> > Thanks,
>> > Harbs
>> >
>> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>
>> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>> >>
>> >> I think I am reading changes to the build process in your
>> suggestions. I do not really want to spend more of my time on this
>> process. But if you want to do the work, that's fine with me.
>> >>
>> >> -Alex
>> >>
>> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>>> wrote:
>> >>
>> >> What kind of horsepower is included in the free Azure account?
>> >>
>> >> The server I mentioned builds (considerably) faster than my own
>> local machine. The ci server seems to build many times slower.
>> >>
>> >> One thing we can do to minimize running server time would be to
>> transfer the artifacts to storage instead of keeping them on the server. On
>> AWS, I’d probably use S3. Not sure what the similar service on Azure is
>> called.
>> >>
>> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
>> <ma...@adobe.com.INVALID>> wrote:
>> >>>
>> >>> OK, that's pretty much how I understand Azure as well. The key thing
>> is that "running" includes time where the CI server is not running any
>> Jenkins jobs. The CI Server steps might take only a few hours of actual
>> server time, but there is time where the RM is verifying artifacts locally
>> so you'd be paying for that or the RM would have to keep shutting down and
>> restarting.
>> >>>
>> >>> Seems like it would be cheaper/simpler to get the free MSDN account
>> and leave it running.
>> >>>
>> >>> -Alex
>> >>>
>> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
>> harbs.lists@gmail.com>> wrote:
>> >>>
>> >>> My experience is with AWS.
>> >>>
>> >>> I assume Microsoft has similar offerings, but I don’t have
>> experience with Azure.
>> >>>
>> >>> AWS has on-demand EC2 instances which you pay for only the actual
>> time that they are running.[1]
>> >>>
>> >>> Instances can be started and stopped via command line (or via the
>> web interface) as long as you have valid credentials to do so.
>> >>>
>> >>> For example: an m5.4xlarge instance has 16 cores and costs about
>> $1.5 per hour. On a machine like that, a full build would probably take
>> less than 10 minutes. It’s probably possible to do a full release with only
>> a few hours of server time.
>> >>>
>> >>> Leaving a server like that running all the time would get expensive,
>> but if it’s just spun up for releases, you’d get very fast builds at a
>> reasonable price.
>> >>>
>> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
>> the release process painless for the RM.
>> >>>
>> >>> [1]
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> ><
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> <
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
>> >>>
>> >>>
>> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>
>> >>>> I'm not very experienced with spinning up servers. The CI server we
>> are using is effectively free, based on a generous donation from Microsoft
>> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
>> RDP access on private@. I think any other ASF committer could do the
>> same. IIRC, if that server actually is stopped, I have to use my personal
>> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
>> for the server, it would cost me to leave it running even if it didn't run
>> jobs between releases.
>> >>>>
>> >>>> Is that what you are basically saying? I think it might be best if
>> another committer got a CI server going via the MS donation and could leave
>> it up 24/7.
>> >>>>
>> >>>> -Alex
>> >>>>
>> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>> >>>>
>> >>>> I’m willing to do this.
>> >>>>
>> >>>> Considering that the release will be run infrequently, it should be
>> doable to have a relatively powerful server that could be spun up on
>> demand. This is something I have setup for my own releases.
>> >>>>
>> >>>> The only complication would be that each RM would need valid
>> credentials to spin up the server.
>> >>>>
>> >>>> Harbs
>> >>>>
>> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
>> wrote:
>> >>>>>
>> >>>>> A better solution, IMO, is for someone else to offer up a CI server
>> only for release jobs.
>>
>>
Re: Prioritize Release Jobs on CI
Posted by OmPrakash Muppirala <bi...@gmail.com>.
I can help set this up on Azure. Give me some time to work out the details?
Thanks,
Om
On Sun, Apr 12, 2020, 11:49 AM Harbs <ha...@gmail.com> wrote:
> OK. Good to know.
>
> > On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID>
> wrote:
> >
> > FWIW, I just looked and the longest job in the release steps so far is 8
> minutes. Most are under 2 minutes. There might be jobs later that take
> longer that we haven't run yet. IMO, the issue isn't speed of the machine,
> it is just that we are sharing the machine with longer jobs (1 hour for
> TourDeFlexMigration). And again, the machine will be idle for stretches of
> time while the RM verifies artifacts after each step.
> >
> > -Alex
> >
> > On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> harbs.lists@gmail.com>> wrote:
> >
> > Fair enough.
> >
> > I expect builds to be somewhere between 10 and 20 times faster on a
> powerful machine.
> >
> > Yeah. It’s probably going to be a bit of work changing the server,
> but probably worth it in the long run.
> >
> > I think I’ll try this when I do the next release unless Yishay wants
> to work with me on this for this release — but I’m not going to be able to
> help until after Passover (i.e. next week).
> >
> > Thanks,
> > Harbs
> >
> >> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID>
> wrote:
> >>
> >> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
> >>
> >> I think I am reading changes to the build process in your suggestions.
> I do not really want to spend more of my time on this process. But if you
> want to do the work, that's fine with me.
> >>
> >> -Alex
> >>
> >> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> harbs.lists@gmail.com> <mailto:harbs.lists@gmail.com <mailto:
> harbs.lists@gmail.com>>> wrote:
> >>
> >> What kind of horsepower is included in the free Azure account?
> >>
> >> The server I mentioned builds (considerably) faster than my own local
> machine. The ci server seems to build many times slower.
> >>
> >> One thing we can do to minimize running server time would be to
> transfer the artifacts to storage instead of keeping them on the server. On
> AWS, I’d probably use S3. Not sure what the similar service on Azure is
> called.
> >>
> >>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID
> <ma...@adobe.com.INVALID>> wrote:
> >>>
> >>> OK, that's pretty much how I understand Azure as well. The key thing
> is that "running" includes time where the CI server is not running any
> Jenkins jobs. The CI Server steps might take only a few hours of actual
> server time, but there is time where the RM is verifying artifacts locally
> so you'd be paying for that or the RM would have to keep shutting down and
> restarting.
> >>>
> >>> Seems like it would be cheaper/simpler to get the free MSDN account
> and leave it running.
> >>>
> >>> -Alex
> >>>
> >>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <mailto:
> harbs.lists@gmail.com>> wrote:
> >>>
> >>> My experience is with AWS.
> >>>
> >>> I assume Microsoft has similar offerings, but I don’t have experience
> with Azure.
> >>>
> >>> AWS has on-demand EC2 instances which you pay for only the actual
> time that they are running.[1]
> >>>
> >>> Instances can be started and stopped via command line (or via the web
> interface) as long as you have valid credentials to do so.
> >>>
> >>> For example: an m5.4xlarge instance has 16 cores and costs about $1.5
> per hour. On a machine like that, a full build would probably take less
> than 10 minutes. It’s probably possible to do a full release with only a
> few hours of server time.
> >>>
> >>> Leaving a server like that running all the time would get expensive,
> but if it’s just spun up for releases, you’d get very fast builds at a
> reasonable price.
> >>>
> >>> I’d be happy to pay $10-$50 (and possibly more) per release to make
> the release process painless for the RM.
> >>>
> >>> [1]
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> ><
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >><
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> ><
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> <
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0
> >>>
> >>>
> >>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID>
> wrote:
> >>>>
> >>>> I'm not very experienced with spinning up servers. The CI server we
> are using is effectively free, based on a generous donation from Microsoft
> of MSDN accounts to ASF committers. So I leave it up 24/7, and share the
> RDP access on private@. I think any other ASF committer could do the
> same. IIRC, if that server actually is stopped, I have to use my personal
> (unshared) MSDN credentials to start it again. AIUI, if I actually paid
> for the server, it would cost me to leave it running even if it didn't run
> jobs between releases.
> >>>>
> >>>> Is that what you are basically saying? I think it might be best if
> another committer got a CI server going via the MS donation and could leave
> it up 24/7.
> >>>>
> >>>> -Alex
> >>>>
> >>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
> >>>>
> >>>> I’m willing to do this.
> >>>>
> >>>> Considering that the release will be run infrequently, it should be
> doable to have a relatively powerful server that could be spun up on
> demand. This is something I have setup for my own releases.
> >>>>
> >>>> The only complication would be that each RM would need valid
> credentials to spin up the server.
> >>>>
> >>>> Harbs
> >>>>
> >>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID>
> wrote:
> >>>>>
> >>>>> A better solution, IMO, is for someone else to offer up a CI server
> only for release jobs.
>
>
Re: Prioritize Release Jobs on CI
Posted by Harbs <ha...@gmail.com>.
OK. Good to know.
> On Apr 12, 2020, at 9:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> FWIW, I just looked and the longest job in the release steps so far is 8 minutes. Most are under 2 minutes. There might be jobs later that take longer that we haven't run yet. IMO, the issue isn't speed of the machine, it is just that we are sharing the machine with longer jobs (1 hour for TourDeFlexMigration). And again, the machine will be idle for stretches of time while the RM verifies artifacts after each step.
>
> -Alex
>
> On 4/12/20, 11:32 AM, "Harbs" <harbs.lists@gmail.com <ma...@gmail.com>> wrote:
>
> Fair enough.
>
> I expect builds to be somewhere between 10 and 20 times faster on a powerful machine.
>
> Yeah. It’s probably going to be a bit of work changing the server, but probably worth it in the long run.
>
> I think I’ll try this when I do the next release unless Yishay wants to work with me on this for this release — but I’m not going to be able to help until after Passover (i.e. next week).
>
> Thanks,
> Harbs
>
>> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>>
>> I think I am reading changes to the build process in your suggestions. I do not really want to spend more of my time on this process. But if you want to do the work, that's fine with me.
>>
>> -Alex
>>
>> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <ma...@gmail.com> <mailto:harbs.lists@gmail.com <ma...@gmail.com>>> wrote:
>>
>> What kind of horsepower is included in the free Azure account?
>>
>> The server I mentioned builds (considerably) faster than my own local machine. The ci server seems to build many times slower.
>>
>> One thing we can do to minimize running server time would be to transfer the artifacts to storage instead of keeping them on the server. On AWS, I’d probably use S3. Not sure what the similar service on Azure is called.
>>
>>> On Apr 12, 2020, at 8:26 PM, Alex Harui <aharui@adobe.com.INVALID <ma...@adobe.com.INVALID>> wrote:
>>>
>>> OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
>>>
>>> Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
>>>
>>> -Alex
>>>
>>> On 4/12/20, 10:15 AM, "Harbs" <harbs.lists@gmail.com <ma...@gmail.com>> wrote:
>>>
>>> My experience is with AWS.
>>>
>>> I assume Microsoft has similar offerings, but I don’t have experience with Azure.
>>>
>>> AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
>>>
>>> Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
>>>
>>> For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
>>>
>>> Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
>>>
>>> I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
>>>
>>> [1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0><https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0>><https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0><https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0>>>
>>>
>>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>>
>>>> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>>>>
>>>> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>>>>
>>>> -Alex
>>>>
>>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>>>>
>>>> I’m willing to do this.
>>>>
>>>> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>>>>
>>>> The only complication would be that each RM would need valid credentials to spin up the server.
>>>>
>>>> Harbs
>>>>
>>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>>>
>>>>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
FWIW, I just looked and the longest job in the release steps so far is 8 minutes. Most are under 2 minutes. There might be jobs later that take longer that we haven't run yet. IMO, the issue isn't speed of the machine, it is just that we are sharing the machine with longer jobs (1 hour for TourDeFlexMigration). And again, the machine will be idle for stretches of time while the RM verifies artifacts after each step.
-Alex
On 4/12/20, 11:32 AM, "Harbs" <ha...@gmail.com> wrote:
Fair enough.
I expect builds to be somewhere between 10 and 20 times faster on a powerful machine.
Yeah. It’s probably going to be a bit of work changing the server, but probably worth it in the long run.
I think I’ll try this when I do the next release unless Yishay wants to work with me on this for this release — but I’m not going to be able to help until after Passover (i.e. next week).
Thanks,
Harbs
> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>
> I think I am reading changes to the build process in your suggestions. I do not really want to spend more of my time on this process. But if you want to do the work, that's fine with me.
>
> -Alex
>
> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <ma...@gmail.com>> wrote:
>
> What kind of horsepower is included in the free Azure account?
>
> The server I mentioned builds (considerably) faster than my own local machine. The ci server seems to build many times slower.
>
> One thing we can do to minimize running server time would be to transfer the artifacts to storage instead of keeping them on the server. On AWS, I’d probably use S3. Not sure what the similar service on Azure is called.
>
>> On Apr 12, 2020, at 8:26 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
>>
>> Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
>>
>> -Alex
>>
>> On 4/12/20, 10:15 AM, "Harbs" <ha...@gmail.com> wrote:
>>
>> My experience is with AWS.
>>
>> I assume Microsoft has similar offerings, but I don’t have experience with Azure.
>>
>> AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
>>
>> Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
>>
>> For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
>>
>> Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
>>
>> I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
>>
>> [1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0><https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd99d1960963240ce500c08d7df0fe417%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223131651425591&sdata=HPLHT0r9qTmJhR4f4j52wtslRJaCCnqf2lj8CM3x0LE%3D&reserved=0>>
>>
>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>
>>> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>>>
>>> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>>>
>>> -Alex
>>>
>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>>>
>>> I’m willing to do this.
>>>
>>> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>>>
>>> The only complication would be that each RM would need valid credentials to spin up the server.
>>>
>>> Harbs
>>>
>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>>
>>>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
Re: Prioritize Release Jobs on CI
Posted by Harbs <ha...@gmail.com>.
Fair enough.
I expect builds to be somewhere between 10 and 20 times faster on a powerful machine.
Yeah. It’s probably going to be a bit of work changing the server, but probably worth it in the long run.
I think I’ll try this when I do the next release unless Yishay wants to work with me on this for this release — but I’m not going to be able to help until after Passover (i.e. next week).
Thanks,
Harbs
> On Apr 12, 2020, at 9:22 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
>
> I think I am reading changes to the build process in your suggestions. I do not really want to spend more of my time on this process. But if you want to do the work, that's fine with me.
>
> -Alex
>
> On 4/12/20, 10:57 AM, "Harbs" <harbs.lists@gmail.com <ma...@gmail.com>> wrote:
>
> What kind of horsepower is included in the free Azure account?
>
> The server I mentioned builds (considerably) faster than my own local machine. The ci server seems to build many times slower.
>
> One thing we can do to minimize running server time would be to transfer the artifacts to storage instead of keeping them on the server. On AWS, I’d probably use S3. Not sure what the similar service on Azure is called.
>
>> On Apr 12, 2020, at 8:26 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
>>
>> Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
>>
>> -Alex
>>
>> On 4/12/20, 10:15 AM, "Harbs" <ha...@gmail.com> wrote:
>>
>> My experience is with AWS.
>>
>> I assume Microsoft has similar offerings, but I don’t have experience with Azure.
>>
>> AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
>>
>> Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
>>
>> For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
>>
>> Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
>>
>> I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
>>
>> [1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd686f90158d64b443af208d7df0ae705%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223110228240938&sdata=4h8pNDGgZpz66Lau44TAVMNDhgue8FplYnAapfJoEzM%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd686f90158d64b443af208d7df0ae705%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223110228240938&sdata=4h8pNDGgZpz66Lau44TAVMNDhgue8FplYnAapfJoEzM%3D&reserved=0><https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd686f90158d64b443af208d7df0ae705%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223110228240938&sdata=4h8pNDGgZpz66Lau44TAVMNDhgue8FplYnAapfJoEzM%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd686f90158d64b443af208d7df0ae705%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223110228240938&sdata=4h8pNDGgZpz66Lau44TAVMNDhgue8FplYnAapfJoEzM%3D&reserved=0>>
>>
>>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>
>>> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>>>
>>> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>>>
>>> -Alex
>>>
>>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>>>
>>> I’m willing to do this.
>>>
>>> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>>>
>>> The only complication would be that each RM would need valid credentials to spin up the server.
>>>
>>> Harbs
>>>
>>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>>
>>>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
The Azure portal says: Standard F2s_v2 (2 vcpus, 4 GiB memory)
I think I am reading changes to the build process in your suggestions. I do not really want to spend more of my time on this process. But if you want to do the work, that's fine with me.
-Alex
On 4/12/20, 10:57 AM, "Harbs" <ha...@gmail.com> wrote:
What kind of horsepower is included in the free Azure account?
The server I mentioned builds (considerably) faster than my own local machine. The ci server seems to build many times slower.
One thing we can do to minimize running server time would be to transfer the artifacts to storage instead of keeping them on the server. On AWS, I’d probably use S3. Not sure what the similar service on Azure is called.
> On Apr 12, 2020, at 8:26 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
>
> Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
>
> -Alex
>
> On 4/12/20, 10:15 AM, "Harbs" <ha...@gmail.com> wrote:
>
> My experience is with AWS.
>
> I assume Microsoft has similar offerings, but I don’t have experience with Azure.
>
> AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
>
> Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
>
> For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
>
> Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
>
> I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
>
> [1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd686f90158d64b443af208d7df0ae705%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223110228240938&sdata=4h8pNDGgZpz66Lau44TAVMNDhgue8FplYnAapfJoEzM%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7Cd686f90158d64b443af208d7df0ae705%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223110228240938&sdata=4h8pNDGgZpz66Lau44TAVMNDhgue8FplYnAapfJoEzM%3D&reserved=0>
>
>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>>
>> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>>
>> -Alex
>>
>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>>
>> I’m willing to do this.
>>
>> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>>
>> The only complication would be that each RM would need valid credentials to spin up the server.
>>
>> Harbs
>>
>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>
>>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
>>
>>
>>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Harbs <ha...@gmail.com>.
What kind of horsepower is included in the free Azure account?
The server I mentioned builds (considerably) faster than my own local machine. The ci server seems to build many times slower.
One thing we can do to minimize running server time would be to transfer the artifacts to storage instead of keeping them on the server. On AWS, I’d probably use S3. Not sure what the similar service on Azure is called.
> On Apr 12, 2020, at 8:26 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
>
> Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
>
> -Alex
>
> On 4/12/20, 10:15 AM, "Harbs" <ha...@gmail.com> wrote:
>
> My experience is with AWS.
>
> I assume Microsoft has similar offerings, but I don’t have experience with Azure.
>
> AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
>
> Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
>
> For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
>
> Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
>
> I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
>
> [1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9f9fa6f357c74ddd43fb08d7df051cfd%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223085366319686&sdata=%2Fq01Kgdo28ZEr%2BnR9Rh8uwXZz4TGt%2FdV60cx7XW9ixs%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9f9fa6f357c74ddd43fb08d7df051cfd%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223085366319686&sdata=%2Fq01Kgdo28ZEr%2BnR9Rh8uwXZz4TGt%2FdV60cx7XW9ixs%3D&reserved=0>
>
>> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>>
>> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>>
>> -Alex
>>
>> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>>
>> I’m willing to do this.
>>
>> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>>
>> The only complication would be that each RM would need valid credentials to spin up the server.
>>
>> Harbs
>>
>>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>>
>>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
>>
>>
>>
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
OK, that's pretty much how I understand Azure as well. The key thing is that "running" includes time where the CI server is not running any Jenkins jobs. The CI Server steps might take only a few hours of actual server time, but there is time where the RM is verifying artifacts locally so you'd be paying for that or the RM would have to keep shutting down and restarting.
Seems like it would be cheaper/simpler to get the free MSDN account and leave it running.
-Alex
On 4/12/20, 10:15 AM, "Harbs" <ha...@gmail.com> wrote:
My experience is with AWS.
I assume Microsoft has similar offerings, but I don’t have experience with Azure.
AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
[1]https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9f9fa6f357c74ddd43fb08d7df051cfd%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223085366319686&sdata=%2Fq01Kgdo28ZEr%2BnR9Rh8uwXZz4TGt%2FdV60cx7XW9ixs%3D&reserved=0 <https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faws.amazon.com%2Fec2%2Fpricing%2Fon-demand%2F&data=02%7C01%7Caharui%40adobe.com%7C9f9fa6f357c74ddd43fb08d7df051cfd%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223085366319686&sdata=%2Fq01Kgdo28ZEr%2BnR9Rh8uwXZz4TGt%2FdV60cx7XW9ixs%3D&reserved=0>
> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>
> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>
> -Alex
>
> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>
> I’m willing to do this.
>
> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>
> The only complication would be that each RM would need valid credentials to spin up the server.
>
> Harbs
>
>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Harbs <ha...@gmail.com>.
My experience is with AWS.
I assume Microsoft has similar offerings, but I don’t have experience with Azure.
AWS has on-demand EC2 instances which you pay for only the actual time that they are running.[1]
Instances can be started and stopped via command line (or via the web interface) as long as you have valid credentials to do so.
For example: an m5.4xlarge instance has 16 cores and costs about $1.5 per hour. On a machine like that, a full build would probably take less than 10 minutes. It’s probably possible to do a full release with only a few hours of server time.
Leaving a server like that running all the time would get expensive, but if it’s just spun up for releases, you’d get very fast builds at a reasonable price.
I’d be happy to pay $10-$50 (and possibly more) per release to make the release process painless for the RM.
[1]https://aws.amazon.com/ec2/pricing/on-demand/ <https://aws.amazon.com/ec2/pricing/on-demand/>
> On Apr 12, 2020, at 7:45 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
>
> Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
>
> -Alex
>
> On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
>
> I’m willing to do this.
>
> Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
>
> The only complication would be that each RM would need valid credentials to spin up the server.
>
> Harbs
>
>> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>>
>> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
>
>
>
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
I'm not very experienced with spinning up servers. The CI server we are using is effectively free, based on a generous donation from Microsoft of MSDN accounts to ASF committers. So I leave it up 24/7, and share the RDP access on private@. I think any other ASF committer could do the same. IIRC, if that server actually is stopped, I have to use my personal (unshared) MSDN credentials to start it again. AIUI, if I actually paid for the server, it would cost me to leave it running even if it didn't run jobs between releases.
Is that what you are basically saying? I think it might be best if another committer got a CI server going via the MS donation and could leave it up 24/7.
-Alex
On 4/12/20, 9:28 AM, "Harbs" <ha...@gmail.com> wrote:
I’m willing to do this.
Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
The only complication would be that each RM would need valid credentials to spin up the server.
Harbs
> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
Re: Prioritize Release Jobs on CI
Posted by Harbs <ha...@gmail.com>.
I’m willing to do this.
Considering that the release will be run infrequently, it should be doable to have a relatively powerful server that could be spun up on demand. This is something I have setup for my own releases.
The only complication would be that each RM would need valid credentials to spin up the server.
Harbs
> On Apr 12, 2020, at 7:10 PM, Alex Harui <ah...@adobe.com.INVALID> wrote:
>
> A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
Re: Prioritize Release Jobs on CI
Posted by Alex Harui <ah...@adobe.com.INVALID>.
On 4/12/20, 8:10 AM, "Yishay Weiss" <yi...@hotmail.com> wrote:
One thing that bothers me with the CI is that if there are jobs already running or in the queue, it might take a long time to see the results of a release step. I’d like to be able to tell Jenkins to prioritize the release steps and reschedule all running or waiting jobs, which is what this plugin [1] seems to do. Should we install it?
Having to wait for other jobs is definitely a pain point. I generally kill jobs in the queue. But I've found that killing running jobs often leaves them in a state where they can't run again without manual clean up so I just go do something else while the running job finishes up and make sure my next job is the only thing in the queue.
A better solution, IMO, is for someone else to offer up a CI server only for release jobs.
A second-best solution, IMO, is to disable the slow jobs, especially Tour De Flex Migration, when we're trying to get a release out. Unfortunately, my experience is that disabling a job makes the last known artifacts unavailable, which is undesirable. I've pondered how to make it easier to temporarily edit the slow jobs to make them run only on manual trigger and restore the timer and other triggers when done. Maybe there's a way to do that.
HTH,
-Alex
[1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplugins.jenkins.io%2Faccelerated-build-now-plugin%2F&data=02%7C01%7Caharui%40adobe.com%7Cc07205e6034d4a1e5c6808d7def39a55%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637223010153382080&sdata=%2BmbdkWSphZVgY9rKGjcqjtZlOM89XzPbo%2FH6f3NUVWk%3D&reserved=0