You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by Weiwei Yang <ww...@apache.org> on 2021/01/28 23:58:41 UTC
Travis job on github
Hi,
The Apache YuniKorn (Incubating) team leverages Travis to run pre-commit
checks, but recently the Travis Job stays in the queue for long hours (6+
hours, sometimes more than 10 hours) . This is highly impacting the
productivity. I have reached the Travis support and the response I got was
the jobs got rate limited under Apache repo. Is there any suggestion how to
fix this issue?
Thanks
Weiwei
Re: Travis job on github
Posted by Daniel Widdis <wi...@gmail.com>.
The delays at Travis were primarily due to a few things:
- Limited capacity and high demand
- Abuse of the free service by cryptocurrency miners
The problem of the crypto miners has been pretty much resolved, but 1 would still be an issue on Travis if there hadn't been a mass exit to GHA last year.
As GHA runs on the Azure cloud, where there's hundreds of thousands of servers available and typically a lot of idle capacity, I doubt we'll see anything like the delays at Travis.
If capacity does become an issue there are many simple steps Microsoft/Github could take first to reduce the load, such as:
- limiting concurrent jobs for free accounts
- allowing auto-terminating a set of jobs when it's triggered again in a short time frame
- allowing re-run of only a single failed job instead of an entire matrix
All of these were features/requirements at Travis because they were capacity limited. The fact that such features don't (yet) exist indicates there is not a capacity concern (yet). Seems they're focusing more on building out the service and gaining more customers and open source contributions to the available actions.
On 2/3/21, 6:07 PM, "Weiwei Yang" <ww...@apache.org> wrote:
Hi Greg
Agreed. No assumption has been made.
I was just hoping that GitHub can hold it up. Just in case the delays come
back again, the Apache community can look for a solution together.
Asking for help from Microsoft is just one possible option.
Weiwei
On Wed, Feb 3, 2021 at 2:40 AM Greg Stein <gs...@gmail.com> wrote:
> On Wed, Feb 3, 2021, 01:36 Weiwei Yang <ww...@apache.org> wrote:
> >...
>
> > we can communicate with Microsoft about giving the Apache
> > repo some extra resources.
> > I guess it won't be a big problem to such a wealthy company 😉
> >
>
> Their wealth does not mean they can give us anything we want. That is a
> fallacy. Their wealth means they can be kind to us, and we should be
> thankful. Microsoft is extremely generous to the Foundation, across many
> paths (sponsorship, Azure, MSDN, etc). Let us not presume that we can keep
> asking for more.
>
> Regards,
> -g
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: Travis job on github
Posted by Weiwei Yang <ww...@apache.org>.
Hi Greg
Agreed. No assumption has been made.
I was just hoping that GitHub can hold it up. Just in case the delays come
back again, the Apache community can look for a solution together.
Asking for help from Microsoft is just one possible option.
Weiwei
On Wed, Feb 3, 2021 at 2:40 AM Greg Stein <gs...@gmail.com> wrote:
> On Wed, Feb 3, 2021, 01:36 Weiwei Yang <ww...@apache.org> wrote:
> >...
>
> > we can communicate with Microsoft about giving the Apache
> > repo some extra resources.
> > I guess it won't be a big problem to such a wealthy company 😉
> >
>
> Their wealth does not mean they can give us anything we want. That is a
> fallacy. Their wealth means they can be kind to us, and we should be
> thankful. Microsoft is extremely generous to the Foundation, across many
> paths (sponsorship, Azure, MSDN, etc). Let us not presume that we can keep
> asking for more.
>
> Regards,
> -g
>
Re: Travis job on github
Posted by Greg Stein <gs...@gmail.com>.
On Wed, Feb 3, 2021, 01:36 Weiwei Yang <ww...@apache.org> wrote:
>...
> we can communicate with Microsoft about giving the Apache
> repo some extra resources.
> I guess it won't be a big problem to such a wealthy company 😉
>
Their wealth does not mean they can give us anything we want. That is a
fallacy. Their wealth means they can be kind to us, and we should be
thankful. Microsoft is extremely generous to the Foundation, across many
paths (sponsorship, Azure, MSDN, etc). Let us not presume that we can keep
asking for more.
Regards,
-g
Re: Travis job on github
Posted by Weiwei Yang <ww...@apache.org>.
At the beginning, the latency of running Travis jobs was not so bad. I have
the same concern when more and more projects move to GHA free plans, delays
may occur.
As a community, I suggest to monitor the state of our jobs, if things
really go badly, we can communicate with Microsoft about giving the Apache
repo some extra resources.
I guess it won't be a big problem to such a wealthy company 😉
Weiwei
On Tue, Feb 2, 2021 at 9:50 PM Daniel Widdis <wi...@gmail.com> wrote:
> GHA is backed by Microsoft's Azure cloud. I'm sure they can handle the
> load.
>
> If they cared, they'd change the rerun all jobs option to allow rerunning
> a single job!
>
> On 2/2/21, 9:43 PM, "leerho" <le...@gmail.com> wrote:
>
> Agreed! We are processing GitHub Actions in less than 2 minutes,
> compared
> to 10 hours with Travis-CI.
> Of course, as more teams pile onto GHA, this will certainly change :)
>
> On Tue, Feb 2, 2021 at 6:07 PM Xiangdong Huang <sa...@gmail.com>
> wrote:
>
> > Hi Leerho,
> >
> > Yes, indeed that is what we need to do.
> >
> > @Wewei Yang, Congrats!
> >
> > Best,
> > -----------------------------------
> > Xiangdong Huang
> > School of Software, Tsinghua University
> >
> >
> >
> > leerho <le...@gmail.com> 于2021年2月3日周三 上午4:17写道：
> >
> > > Xiangdong, I noticed in your GHA yaml script you included the
> > > Coveralls-repo-token in plaintext, which is not recommended. You
> can
> > have
> > > INFRA load the token into the GitHub repo, which you can then
> acquire
> > > securely using GHA secrets.
> > >
> > > That is what we do anyway :)
> > >
> > > Cheers,
> > > Lee.
> > >
> > > On Tue, Feb 2, 2021 at 12:18 AM Yuanbo Liu <li...@gmail.com>
> > wrote:
> > >
> > > > It would be great if we could run a travis job on a private
> machine. I
> > > > believe some companies would be glad to donate machines
> > > > for unit testing of open source projects.
> > > >
> > > > On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
> > > >
> > > > > Xiangdong,
> > > > > Thank you, I pretty much came up with the same solution.
> > Nonetheless,
> > > It
> > > > > will be interesting to see how your approach differs from
> mine, I'm
> > > sure
> > > > I
> > > > > will learn something!
> > > > >
> > > > > Cheers,
> > > > >
> > > > > Lee.
> > > > >
> > > > > On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <
> sainthxd@gmail.com>
> > > > wrote:
> > > > >
> > > > > > Hi leerho,
> > > > > >
> > > > > > > because the current GHA
> > > > > > adapter for Coveralls only supports LCOV format which Jacoco
> > doesn’t
> > > > > > generate.
> > > > > >
> > > > > > Actually, we can find some way to bypass the LCOV
> requirements,
> > > > > > that is... do not use official github action provided by
> coverall.
> > > > > >
> > > > > > In our project (Apache IoTDB), we use maven to compile the
> project
> > > and
> > > > > > use maven plugin to upload code coverage results to
> Coveralls.
> > > > > >
> > > > > > see [1] (search "coveralls"), [2], and [3] (search
> "Coveralls)".
> > > > > >
> > > > > > It works well.
> > > > > >
> > > > > > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > > > > > [2]
> https://github.com/apache/iotdb/tree/master/code-coverage
> > > > > > [3]
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> > > > > >
> > > > > > Best,
> > > > > > -----------------------------------
> > > > > > Xiangdong Huang
> > > > > > School of Software, Tsinghua University
> > > > > >
> > > > > > 黄向东
> > > > > > 清华大学 软件学院
> > > > > >
> > > > > >
> > > > > > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> > > > > >
> > > > > > > Sorry, I must be missing something. I don't see LCOV
> format in
> > the
> > > > > list
> > > > > > :)
> > > > > > > Doesn't this mean a complete rework of our toolchain ?
> > > > > > >
> > > > > > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <
> boards@gmail.com>
> > > > wrote:
> > > > > > >
> > > > > > > > Using https://github.com/jenkinsci/warnings-ng-plugin
> (already
> > > > > > > > installed) combined with the github integration (also
> > installed),
> > > > you
> > > > > > > > can get that in our CloudBees CI instance. They support
> a lot
> > of
> > > > > > > > formats:
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > > > > > >
> > > > > > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com>
> wrote:
> > > > > > > > >
> > > > > > > > > I am trying to move from Travis to GitHub actions for
> exactly
> > > > this
> > > > > > > > reason,
> > > > > > > > > but in that process discovered that our coverage
> reporting
> > > chain
> > > > of
> > > > > > > > > Maven/Java/Jacoco/Coveralls does not port to GHA
> because the
> > > > > current
> > > > > > > GHA
> > > > > > > > > adapter for Coveralls only supports LCOV format which
> Jacoco
> > > > > doesn’t
> > > > > > > > > generate. Converting to CodeCov is a nonstarter
> because
> > > CodeCov
> > > > is
> > > > > > $$!
> > > > > > > > >
> > > > > > > > > If anybody has any ideas, please let me know!
> > > > > > > > >
> > > > > > > > > Lee.
> > > > > > > > >
> > > > > > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <
> > wwei@apache.org>
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > > > > > Thank you Daniel for pointing this out : )
> > > > > > > > > >
> > > > > > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <
> > > > widdis@gmail.com>
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > The quota is for private repos.
> Public/open-source repos
> > > are
> > > > > > > > essentially
> > > > > > > > > > > unlimited.
> > > > > > > > > > >
> > > > > > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <
> wwei@apache.org>
> > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > Thank you all for the suggestions.
> > > > > > > > > > > Looks like github action is an option, we'll
> give a
> > > try.
> > > > > > > > > > > Noticed they offer 2000 action
> minutes/month[1] for
> > > > free, I
> > > > > > > think
> > > > > > > > > > that
> > > > > > > > > > > should be enough for most cases.
> > > > > > > > > > >
> > > > > > > > > > > [1]
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > > > > > boards@gmail.com>
> > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > There's also some hosted CI services here
> like
> > > Jenkins,
> > > > > > > > BuildBot,
> > > > > > > > > > > > etc., which may have less queueing issues
> depending
> > > on
> > > > > > which
> > > > > > > > > > service
> > > > > > > > > > > > attracts the most build minute usage.
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > > > > > jon.malkin@gmail.com
> > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > There was an issue a few months ago where
> the
> > > GitHub
> > > > > > > Actions
> > > > > > > > > > queue
> > > > > > > > > > > was
> > > > > > > > > > > > very
> > > > > > > > > > > > > laggy for Apache jobs, so just make sure
> you're
> > > > trying
> > > > > to
> > > > > > > be
> > > > > > > > > > > efficient
> > > > > > > > > > > > > about it. It's also a shared resource.
> > > > > > > > > > > > >
> > > > > > > > > > > > > That said, (part of) our recently graduated
> > project
> > > > > uses
> > > > > > > > GitHub
> > > > > > > > > > > Actions
> > > > > > > > > > > > and
> > > > > > > > > > > > > we've been happy overall. Another part is
> > currently
> > > > > > moving
> > > > > > > > to it
> > > > > > > > > > > from
> > > > > > > > > > > > > Travis for the exact same reason.
> > > > > > > > > > > > >
> > > > > > > > > > > > > jon
> > > > > > > > > > > > >
> > > > > > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > > > > > panjuan@apache.org
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > > > >
> > > > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > > > > > We also transfer to GitHub Action, and It
> > > generally
> > > > > > works
> > > > > > > > well
> > > > > > > > > > > so far.
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > >
> > > > ----------------------------------------------------------------
> > > > > > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<
> > zjffdu@gmail.com>
> > > > > > wrote：
> > > > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > May you can consider to use github
> action for
> > CI
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Weiwei Yang <ww...@apache.org>
> 于2021年1月29日周五
> > > > > 上午7:58写道：
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Hi,
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > The Apache YuniKorn (Incubating) team
> leverages
> > > > > Travis
> > > > > > to
> > > > > > > > run
> > > > > > > > > > > > pre-commit
> > > > > > > > > > > > > > checks, but recently the Travis Job
> stays in
> > the
> > > > > queue
> > > > > > > for
> > > > > > > > long
> > > > > > > > > > > hours
> > > > > > > > > > > > (6+
> > > > > > > > > > > > > > hours, sometimes more than 10 hours) .
> This is
> > > > highly
> > > > > > > > impacting
> > > > > > > > > > > the
> > > > > > > > > > > > > > productivity. I have reached the Travis
> support
> > > and
> > > > > the
> > > > > > > > > > response
> > > > > > > > > > > I got
> > > > > > > > > > > > was
> > > > > > > > > > > > > > the jobs got rate limited under Apache
> repo. Is
> > > > there
> > > > > > any
> > > > > > > > > > > suggestion
> > > > > > > > > > > > how to
> > > > > > > > > > > > > > fix this issue?
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Thanks
> > > > > > > > > > > > > > Weiwei
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > --
> > > > > > > > > > > > > > Best Regards
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > Jeff Zhang
> > > > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > > > > > > > To unsubscribe, e-mail:
> > > > > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > > > For additional commands, e-mail:
> > > > > > > > general-help@incubator.apache.org
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > >
> > >
> ---------------------------------------------------------------------
> > > > > > > > > > > To unsubscribe, e-mail:
> > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > > For additional commands, e-mail:
> > > > > > general-help@incubator.apache.org
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > --
> > > > > > > > > From my cell phone.
> > > > > > > >
> > > > > > > >
> > > >
> ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail:
> > general-unsubscribe@incubator.apache.org
> > > > > > > > For additional commands, e-mail:
> > > general-help@incubator.apache.org
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
Re: Travis job on github
Posted by Daniel Widdis <wi...@gmail.com>.
GHA is backed by Microsoft's Azure cloud. I'm sure they can handle the load.
If they cared, they'd change the rerun all jobs option to allow rerunning a single job!
On 2/2/21, 9:43 PM, "leerho" <le...@gmail.com> wrote:
Agreed! We are processing GitHub Actions in less than 2 minutes, compared
to 10 hours with Travis-CI.
Of course, as more teams pile onto GHA, this will certainly change :)
On Tue, Feb 2, 2021 at 6:07 PM Xiangdong Huang <sa...@gmail.com> wrote:
> Hi Leerho,
>
> Yes, indeed that is what we need to do.
>
> @Wewei Yang, Congrats!
>
> Best,
> -----------------------------------
> Xiangdong Huang
> School of Software, Tsinghua University
>
>
>
> leerho <le...@gmail.com> 于2021年2月3日周三 上午4:17写道：
>
> > Xiangdong, I noticed in your GHA yaml script you included the
> > Coveralls-repo-token in plaintext, which is not recommended. You can
> have
> > INFRA load the token into the GitHub repo, which you can then acquire
> > securely using GHA secrets.
> >
> > That is what we do anyway :)
> >
> > Cheers,
> > Lee.
> >
> > On Tue, Feb 2, 2021 at 12:18 AM Yuanbo Liu <li...@gmail.com>
> wrote:
> >
> > > It would be great if we could run a travis job on a private machine. I
> > > believe some companies would be glad to donate machines
> > > for unit testing of open source projects.
> > >
> > > On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
> > >
> > > > Xiangdong,
> > > > Thank you, I pretty much came up with the same solution.
> Nonetheless,
> > It
> > > > will be interesting to see how your approach differs from mine, I'm
> > sure
> > > I
> > > > will learn something!
> > > >
> > > > Cheers,
> > > >
> > > > Lee.
> > > >
> > > > On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com>
> > > wrote:
> > > >
> > > > > Hi leerho,
> > > > >
> > > > > > because the current GHA
> > > > > adapter for Coveralls only supports LCOV format which Jacoco
> doesn’t
> > > > > generate.
> > > > >
> > > > > Actually, we can find some way to bypass the LCOV requirements,
> > > > > that is... do not use official github action provided by coverall.
> > > > >
> > > > > In our project (Apache IoTDB), we use maven to compile the project
> > and
> > > > > use maven plugin to upload code coverage results to Coveralls.
> > > > >
> > > > > see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
> > > > >
> > > > > It works well.
> > > > >
> > > > > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > > > > [2] https://github.com/apache/iotdb/tree/master/code-coverage
> > > > > [3]
> > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> > > > >
> > > > > Best,
> > > > > -----------------------------------
> > > > > Xiangdong Huang
> > > > > School of Software, Tsinghua University
> > > > >
> > > > > 黄向东
> > > > > 清华大学 软件学院
> > > > >
> > > > >
> > > > > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> > > > >
> > > > > > Sorry, I must be missing something. I don't see LCOV format in
> the
> > > > list
> > > > > :)
> > > > > > Doesn't this mean a complete rework of our toolchain ?
> > > > > >
> > > > > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com>
> > > wrote:
> > > > > >
> > > > > > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > > > > > installed) combined with the github integration (also
> installed),
> > > you
> > > > > > > can get that in our CloudBees CI instance. They support a lot
> of
> > > > > > > formats:
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > > > > >
> > > > > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > > > > > >
> > > > > > > > I am trying to move from Travis to GitHub actions for exactly
> > > this
> > > > > > > reason,
> > > > > > > > but in that process discovered that our coverage reporting
> > chain
> > > of
> > > > > > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the
> > > > current
> > > > > > GHA
> > > > > > > > adapter for Coveralls only supports LCOV format which Jacoco
> > > > doesn’t
> > > > > > > > generate. Converting to CodeCov is a nonstarter because
> > CodeCov
> > > is
> > > > > $$!
> > > > > > > >
> > > > > > > > If anybody has any ideas, please let me know!
> > > > > > > >
> > > > > > > > Lee.
> > > > > > > >
> > > > > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <
> wwei@apache.org>
> > > > > wrote:
> > > > > > > >
> > > > > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > > > > Thank you Daniel for pointing this out : )
> > > > > > > > >
> > > > > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <
> > > widdis@gmail.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > The quota is for private repos. Public/open-source repos
> > are
> > > > > > > essentially
> > > > > > > > > > unlimited.
> > > > > > > > > >
> > > > > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org>
> > wrote:
> > > > > > > > > >
> > > > > > > > > > Thank you all for the suggestions.
> > > > > > > > > > Looks like github action is an option, we'll give a
> > try.
> > > > > > > > > > Noticed they offer 2000 action minutes/month[1] for
> > > free, I
> > > > > > think
> > > > > > > > > that
> > > > > > > > > > should be enough for most cases.
> > > > > > > > > >
> > > > > > > > > > [1]
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > > > > >
> > > > > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > > > > boards@gmail.com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > There's also some hosted CI services here like
> > Jenkins,
> > > > > > > BuildBot,
> > > > > > > > > > > etc., which may have less queueing issues depending
> > on
> > > > > which
> > > > > > > > > service
> > > > > > > > > > > attracts the most build minute usage.
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > > > > jon.malkin@gmail.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > There was an issue a few months ago where the
> > GitHub
> > > > > > Actions
> > > > > > > > > queue
> > > > > > > > > > was
> > > > > > > > > > > very
> > > > > > > > > > > > laggy for Apache jobs, so just make sure you're
> > > trying
> > > > to
> > > > > > be
> > > > > > > > > > efficient
> > > > > > > > > > > > about it. It's also a shared resource.
> > > > > > > > > > > >
> > > > > > > > > > > > That said, (part of) our recently graduated
> project
> > > > uses
> > > > > > > GitHub
> > > > > > > > > > Actions
> > > > > > > > > > > and
> > > > > > > > > > > > we've been happy overall. Another part is
> currently
> > > > > moving
> > > > > > > to it
> > > > > > > > > > from
> > > > > > > > > > > > Travis for the exact same reason.
> > > > > > > > > > > >
> > > > > > > > > > > > jon
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > > > > panjuan@apache.org
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > > > > We also transfer to GitHub Action, and It
> > generally
> > > > > works
> > > > > > > well
> > > > > > > > > > so far.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > >
> > > ----------------------------------------------------------------
> > > > > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > > > > >
> > > > > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<
> zjffdu@gmail.com>
> > > > > wrote：
> > > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > > >
> > > > > > > > > > > > > May you can consider to use github action for
> CI
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五
> > > > 上午7:58写道：
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hi,
> > > > > > > > > > > > >
> > > > > > > > > > > > > The Apache YuniKorn (Incubating) team leverages
> > > > Travis
> > > > > to
> > > > > > > run
> > > > > > > > > > > pre-commit
> > > > > > > > > > > > > checks, but recently the Travis Job stays in
> the
> > > > queue
> > > > > > for
> > > > > > > long
> > > > > > > > > > hours
> > > > > > > > > > > (6+
> > > > > > > > > > > > > hours, sometimes more than 10 hours) . This is
> > > highly
> > > > > > > impacting
> > > > > > > > > > the
> > > > > > > > > > > > > productivity. I have reached the Travis support
> > and
> > > > the
> > > > > > > > > response
> > > > > > > > > > I got
> > > > > > > > > > > was
> > > > > > > > > > > > > the jobs got rate limited under Apache repo. Is
> > > there
> > > > > any
> > > > > > > > > > suggestion
> > > > > > > > > > > how to
> > > > > > > > > > > > > fix this issue?
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks
> > > > > > > > > > > > > Weiwei
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Best Regards
> > > > > > > > > > > > >
> > > > > > > > > > > > > Jeff Zhang
> > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > > > > > To unsubscribe, e-mail:
> > > > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > > For additional commands, e-mail:
> > > > > > > general-help@incubator.apache.org
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > > > > > To unsubscribe, e-mail:
> > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > For additional commands, e-mail:
> > > > > general-help@incubator.apache.org
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > --
> > > > > > > > From my cell phone.
> > > > > > >
> > > > > > >
> > > ---------------------------------------------------------------------
> > > > > > > To unsubscribe, e-mail:
> general-unsubscribe@incubator.apache.org
> > > > > > > For additional commands, e-mail:
> > general-help@incubator.apache.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: Travis job on github
Posted by leerho <le...@gmail.com>.
Agreed! We are processing GitHub Actions in less than 2 minutes, compared
to 10 hours with Travis-CI.
Of course, as more teams pile onto GHA, this will certainly change :)
On Tue, Feb 2, 2021 at 6:07 PM Xiangdong Huang <sa...@gmail.com> wrote:
> Hi Leerho,
>
> Yes, indeed that is what we need to do.
>
> @Wewei Yang, Congrats!
>
> Best,
> -----------------------------------
> Xiangdong Huang
> School of Software, Tsinghua University
>
>
>
> leerho <le...@gmail.com> 于2021年2月3日周三 上午4:17写道：
>
> > Xiangdong, I noticed in your GHA yaml script you included the
> > Coveralls-repo-token in plaintext, which is not recommended. You can
> have
> > INFRA load the token into the GitHub repo, which you can then acquire
> > securely using GHA secrets.
> >
> > That is what we do anyway :)
> >
> > Cheers,
> > Lee.
> >
> > On Tue, Feb 2, 2021 at 12:18 AM Yuanbo Liu <li...@gmail.com>
> wrote:
> >
> > > It would be great if we could run a travis job on a private machine. I
> > > believe some companies would be glad to donate machines
> > > for unit testing of open source projects.
> > >
> > > On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
> > >
> > > > Xiangdong,
> > > > Thank you, I pretty much came up with the same solution.
> Nonetheless,
> > It
> > > > will be interesting to see how your approach differs from mine, I'm
> > sure
> > > I
> > > > will learn something!
> > > >
> > > > Cheers,
> > > >
> > > > Lee.
> > > >
> > > > On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com>
> > > wrote:
> > > >
> > > > > Hi leerho,
> > > > >
> > > > > > because the current GHA
> > > > > adapter for Coveralls only supports LCOV format which Jacoco
> doesn’t
> > > > > generate.
> > > > >
> > > > > Actually, we can find some way to bypass the LCOV requirements,
> > > > > that is... do not use official github action provided by coverall.
> > > > >
> > > > > In our project (Apache IoTDB), we use maven to compile the project
> > and
> > > > > use maven plugin to upload code coverage results to Coveralls.
> > > > >
> > > > > see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
> > > > >
> > > > > It works well.
> > > > >
> > > > > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > > > > [2] https://github.com/apache/iotdb/tree/master/code-coverage
> > > > > [3]
> > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> > > > >
> > > > > Best,
> > > > > -----------------------------------
> > > > > Xiangdong Huang
> > > > > School of Software, Tsinghua University
> > > > >
> > > > > 黄向东
> > > > > 清华大学 软件学院
> > > > >
> > > > >
> > > > > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> > > > >
> > > > > > Sorry, I must be missing something. I don't see LCOV format in
> the
> > > > list
> > > > > :)
> > > > > > Doesn't this mean a complete rework of our toolchain ?
> > > > > >
> > > > > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com>
> > > wrote:
> > > > > >
> > > > > > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > > > > > installed) combined with the github integration (also
> installed),
> > > you
> > > > > > > can get that in our CloudBees CI instance. They support a lot
> of
> > > > > > > formats:
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > > > > >
> > > > > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > > > > > >
> > > > > > > > I am trying to move from Travis to GitHub actions for exactly
> > > this
> > > > > > > reason,
> > > > > > > > but in that process discovered that our coverage reporting
> > chain
> > > of
> > > > > > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the
> > > > current
> > > > > > GHA
> > > > > > > > adapter for Coveralls only supports LCOV format which Jacoco
> > > > doesn’t
> > > > > > > > generate. Converting to CodeCov is a nonstarter because
> > CodeCov
> > > is
> > > > > $$!
> > > > > > > >
> > > > > > > > If anybody has any ideas, please let me know!
> > > > > > > >
> > > > > > > > Lee.
> > > > > > > >
> > > > > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <
> wwei@apache.org>
> > > > > wrote:
> > > > > > > >
> > > > > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > > > > Thank you Daniel for pointing this out : )
> > > > > > > > >
> > > > > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <
> > > widdis@gmail.com>
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > The quota is for private repos. Public/open-source repos
> > are
> > > > > > > essentially
> > > > > > > > > > unlimited.
> > > > > > > > > >
> > > > > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org>
> > wrote:
> > > > > > > > > >
> > > > > > > > > > Thank you all for the suggestions.
> > > > > > > > > > Looks like github action is an option, we'll give a
> > try.
> > > > > > > > > > Noticed they offer 2000 action minutes/month[1] for
> > > free, I
> > > > > > think
> > > > > > > > > that
> > > > > > > > > > should be enough for most cases.
> > > > > > > > > >
> > > > > > > > > > [1]
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > > > > >
> > > > > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > > > > boards@gmail.com>
> > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > There's also some hosted CI services here like
> > Jenkins,
> > > > > > > BuildBot,
> > > > > > > > > > > etc., which may have less queueing issues depending
> > on
> > > > > which
> > > > > > > > > service
> > > > > > > > > > > attracts the most build minute usage.
> > > > > > > > > > >
> > > > > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > > > > jon.malkin@gmail.com
> > > > > > > >
> > > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > There was an issue a few months ago where the
> > GitHub
> > > > > > Actions
> > > > > > > > > queue
> > > > > > > > > > was
> > > > > > > > > > > very
> > > > > > > > > > > > laggy for Apache jobs, so just make sure you're
> > > trying
> > > > to
> > > > > > be
> > > > > > > > > > efficient
> > > > > > > > > > > > about it. It's also a shared resource.
> > > > > > > > > > > >
> > > > > > > > > > > > That said, (part of) our recently graduated
> project
> > > > uses
> > > > > > > GitHub
> > > > > > > > > > Actions
> > > > > > > > > > > and
> > > > > > > > > > > > we've been happy overall. Another part is
> currently
> > > > > moving
> > > > > > > to it
> > > > > > > > > > from
> > > > > > > > > > > > Travis for the exact same reason.
> > > > > > > > > > > >
> > > > > > > > > > > > jon
> > > > > > > > > > > >
> > > > > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > > > > panjuan@apache.org
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > > >
> > > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > > > > We also transfer to GitHub Action, and It
> > generally
> > > > > works
> > > > > > > well
> > > > > > > > > > so far.
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > >
> > > ----------------------------------------------------------------
> > > > > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > > > > >
> > > > > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<
> zjffdu@gmail.com>
> > > > > wrote：
> > > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > > >
> > > > > > > > > > > > > May you can consider to use github action for
> CI
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五
> > > > 上午7:58写道：
> > > > > > > > > > > > >
> > > > > > > > > > > > > Hi,
> > > > > > > > > > > > >
> > > > > > > > > > > > > The Apache YuniKorn (Incubating) team leverages
> > > > Travis
> > > > > to
> > > > > > > run
> > > > > > > > > > > pre-commit
> > > > > > > > > > > > > checks, but recently the Travis Job stays in
> the
> > > > queue
> > > > > > for
> > > > > > > long
> > > > > > > > > > hours
> > > > > > > > > > > (6+
> > > > > > > > > > > > > hours, sometimes more than 10 hours) . This is
> > > highly
> > > > > > > impacting
> > > > > > > > > > the
> > > > > > > > > > > > > productivity. I have reached the Travis support
> > and
> > > > the
> > > > > > > > > response
> > > > > > > > > > I got
> > > > > > > > > > > was
> > > > > > > > > > > > > the jobs got rate limited under Apache repo. Is
> > > there
> > > > > any
> > > > > > > > > > suggestion
> > > > > > > > > > > how to
> > > > > > > > > > > > > fix this issue?
> > > > > > > > > > > > >
> > > > > > > > > > > > > Thanks
> > > > > > > > > > > > > Weiwei
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > > --
> > > > > > > > > > > > > Best Regards
> > > > > > > > > > > > >
> > > > > > > > > > > > > Jeff Zhang
> > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > > > > > To unsubscribe, e-mail:
> > > > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > > For additional commands, e-mail:
> > > > > > > general-help@incubator.apache.org
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > > > > > To unsubscribe, e-mail:
> > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > For additional commands, e-mail:
> > > > > general-help@incubator.apache.org
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > --
> > > > > > > > From my cell phone.
> > > > > > >
> > > > > > >
> > > ---------------------------------------------------------------------
> > > > > > > To unsubscribe, e-mail:
> general-unsubscribe@incubator.apache.org
> > > > > > > For additional commands, e-mail:
> > general-help@incubator.apache.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Travis job on github
Posted by Xiangdong Huang <sa...@gmail.com>.
Hi Leerho,
Yes, indeed that is what we need to do.
@Wewei Yang, Congrats!
Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University
leerho <le...@gmail.com> 于2021年2月3日周三 上午4:17写道：
> Xiangdong, I noticed in your GHA yaml script you included the
> Coveralls-repo-token in plaintext, which is not recommended. You can have
> INFRA load the token into the GitHub repo, which you can then acquire
> securely using GHA secrets.
>
> That is what we do anyway :)
>
> Cheers,
> Lee.
>
> On Tue, Feb 2, 2021 at 12:18 AM Yuanbo Liu <li...@gmail.com> wrote:
>
> > It would be great if we could run a travis job on a private machine. I
> > believe some companies would be glad to donate machines
> > for unit testing of open source projects.
> >
> > On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
> >
> > > Xiangdong,
> > > Thank you, I pretty much came up with the same solution. Nonetheless,
> It
> > > will be interesting to see how your approach differs from mine, I'm
> sure
> > I
> > > will learn something!
> > >
> > > Cheers,
> > >
> > > Lee.
> > >
> > > On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com>
> > wrote:
> > >
> > > > Hi leerho,
> > > >
> > > > > because the current GHA
> > > > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > > > generate.
> > > >
> > > > Actually, we can find some way to bypass the LCOV requirements,
> > > > that is... do not use official github action provided by coverall.
> > > >
> > > > In our project (Apache IoTDB), we use maven to compile the project
> and
> > > > use maven plugin to upload code coverage results to Coveralls.
> > > >
> > > > see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
> > > >
> > > > It works well.
> > > >
> > > > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > > > [2] https://github.com/apache/iotdb/tree/master/code-coverage
> > > > [3]
> > > >
> > > >
> > >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> > > >
> > > > Best,
> > > > -----------------------------------
> > > > Xiangdong Huang
> > > > School of Software, Tsinghua University
> > > >
> > > > 黄向东
> > > > 清华大学 软件学院
> > > >
> > > >
> > > > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> > > >
> > > > > Sorry, I must be missing something. I don't see LCOV format in the
> > > list
> > > > :)
> > > > > Doesn't this mean a complete rework of our toolchain ?
> > > > >
> > > > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com>
> > wrote:
> > > > >
> > > > > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > > > > installed) combined with the github integration (also installed),
> > you
> > > > > > can get that in our CloudBees CI instance. They support a lot of
> > > > > > formats:
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > > > >
> > > > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > > > > >
> > > > > > > I am trying to move from Travis to GitHub actions for exactly
> > this
> > > > > > reason,
> > > > > > > but in that process discovered that our coverage reporting
> chain
> > of
> > > > > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the
> > > current
> > > > > GHA
> > > > > > > adapter for Coveralls only supports LCOV format which Jacoco
> > > doesn’t
> > > > > > > generate. Converting to CodeCov is a nonstarter because
> CodeCov
> > is
> > > > $$!
> > > > > > >
> > > > > > > If anybody has any ideas, please let me know!
> > > > > > >
> > > > > > > Lee.
> > > > > > >
> > > > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org>
> > > > wrote:
> > > > > > >
> > > > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > > > Thank you Daniel for pointing this out : )
> > > > > > > >
> > > > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <
> > widdis@gmail.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > The quota is for private repos. Public/open-source repos
> are
> > > > > > essentially
> > > > > > > > > unlimited.
> > > > > > > > >
> > > > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org>
> wrote:
> > > > > > > > >
> > > > > > > > > Thank you all for the suggestions.
> > > > > > > > > Looks like github action is an option, we'll give a
> try.
> > > > > > > > > Noticed they offer 2000 action minutes/month[1] for
> > free, I
> > > > > think
> > > > > > > > that
> > > > > > > > > should be enough for most cases.
> > > > > > > > >
> > > > > > > > > [1]
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > > > >
> > > > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > > > boards@gmail.com>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > There's also some hosted CI services here like
> Jenkins,
> > > > > > BuildBot,
> > > > > > > > > > etc., which may have less queueing issues depending
> on
> > > > which
> > > > > > > > service
> > > > > > > > > > attracts the most build minute usage.
> > > > > > > > > >
> > > > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > > > jon.malkin@gmail.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > There was an issue a few months ago where the
> GitHub
> > > > > Actions
> > > > > > > > queue
> > > > > > > > > was
> > > > > > > > > > very
> > > > > > > > > > > laggy for Apache jobs, so just make sure you're
> > trying
> > > to
> > > > > be
> > > > > > > > > efficient
> > > > > > > > > > > about it. It's also a shared resource.
> > > > > > > > > > >
> > > > > > > > > > > That said, (part of) our recently graduated project
> > > uses
> > > > > > GitHub
> > > > > > > > > Actions
> > > > > > > > > > and
> > > > > > > > > > > we've been happy overall. Another part is currently
> > > > moving
> > > > > > to it
> > > > > > > > > from
> > > > > > > > > > > Travis for the exact same reason.
> > > > > > > > > > >
> > > > > > > > > > > jon
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > > > panjuan@apache.org
> > > > > >
> > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > > > We also transfer to GitHub Action, and It
> generally
> > > > works
> > > > > > well
> > > > > > > > > so far.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > >
> > ----------------------------------------------------------------
> > > > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > > > >
> > > > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com>
> > > > wrote：
> > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > >
> > > > > > > > > > > > May you can consider to use github action for CI
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五
> > > 上午7:58写道：
> > > > > > > > > > > >
> > > > > > > > > > > > Hi,
> > > > > > > > > > > >
> > > > > > > > > > > > The Apache YuniKorn (Incubating) team leverages
> > > Travis
> > > > to
> > > > > > run
> > > > > > > > > > pre-commit
> > > > > > > > > > > > checks, but recently the Travis Job stays in the
> > > queue
> > > > > for
> > > > > > long
> > > > > > > > > hours
> > > > > > > > > > (6+
> > > > > > > > > > > > hours, sometimes more than 10 hours) . This is
> > highly
> > > > > > impacting
> > > > > > > > > the
> > > > > > > > > > > > productivity. I have reached the Travis support
> and
> > > the
> > > > > > > > response
> > > > > > > > > I got
> > > > > > > > > > was
> > > > > > > > > > > > the jobs got rate limited under Apache repo. Is
> > there
> > > > any
> > > > > > > > > suggestion
> > > > > > > > > > how to
> > > > > > > > > > > > fix this issue?
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks
> > > > > > > > > > > > Weiwei
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Best Regards
> > > > > > > > > > > >
> > > > > > > > > > > > Jeff Zhang
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > ---------------------------------------------------------------------
> > > > > > > > > > To unsubscribe, e-mail:
> > > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > For additional commands, e-mail:
> > > > > > general-help@incubator.apache.org
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > > > To unsubscribe, e-mail:
> > > general-unsubscribe@incubator.apache.org
> > > > > > > > > For additional commands, e-mail:
> > > > general-help@incubator.apache.org
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > --
> > > > > > > From my cell phone.
> > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail:
> general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Travis job on github
Posted by Weiwei Yang <ww...@apache.org>.
Just a quick update.
The YuniKorn team has done the migration from Travis to the github action,
so far it looks great.
The pipeline now only needs ~20 minutes comparing to the past 6~12hours. We
also use codecov and it also works great with github action.
We are pretty happy with this migration, hope github can keep this up.
Thanks!
Weiwei
On Tue, Feb 2, 2021 at 12:17 PM leerho <le...@gmail.com> wrote:
> Xiangdong, I noticed in your GHA yaml script you included the
> Coveralls-repo-token in plaintext, which is not recommended. You can have
> INFRA load the token into the GitHub repo, which you can then acquire
> securely using GHA secrets.
>
> That is what we do anyway :)
>
> Cheers,
> Lee.
>
> On Tue, Feb 2, 2021 at 12:18 AM Yuanbo Liu <li...@gmail.com> wrote:
>
> > It would be great if we could run a travis job on a private machine. I
> > believe some companies would be glad to donate machines
> > for unit testing of open source projects.
> >
> > On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
> >
> > > Xiangdong,
> > > Thank you, I pretty much came up with the same solution. Nonetheless,
> It
> > > will be interesting to see how your approach differs from mine, I'm
> sure
> > I
> > > will learn something!
> > >
> > > Cheers,
> > >
> > > Lee.
> > >
> > > On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com>
> > wrote:
> > >
> > > > Hi leerho,
> > > >
> > > > > because the current GHA
> > > > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > > > generate.
> > > >
> > > > Actually, we can find some way to bypass the LCOV requirements,
> > > > that is... do not use official github action provided by coverall.
> > > >
> > > > In our project (Apache IoTDB), we use maven to compile the project
> and
> > > > use maven plugin to upload code coverage results to Coveralls.
> > > >
> > > > see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
> > > >
> > > > It works well.
> > > >
> > > > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > > > [2] https://github.com/apache/iotdb/tree/master/code-coverage
> > > > [3]
> > > >
> > > >
> > >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> > > >
> > > > Best,
> > > > -----------------------------------
> > > > Xiangdong Huang
> > > > School of Software, Tsinghua University
> > > >
> > > > 黄向东
> > > > 清华大学 软件学院
> > > >
> > > >
> > > > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> > > >
> > > > > Sorry, I must be missing something. I don't see LCOV format in the
> > > list
> > > > :)
> > > > > Doesn't this mean a complete rework of our toolchain ?
> > > > >
> > > > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com>
> > wrote:
> > > > >
> > > > > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > > > > installed) combined with the github integration (also installed),
> > you
> > > > > > can get that in our CloudBees CI instance. They support a lot of
> > > > > > formats:
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > > > >
> > > > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > > > > >
> > > > > > > I am trying to move from Travis to GitHub actions for exactly
> > this
> > > > > > reason,
> > > > > > > but in that process discovered that our coverage reporting
> chain
> > of
> > > > > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the
> > > current
> > > > > GHA
> > > > > > > adapter for Coveralls only supports LCOV format which Jacoco
> > > doesn’t
> > > > > > > generate. Converting to CodeCov is a nonstarter because
> CodeCov
> > is
> > > > $$!
> > > > > > >
> > > > > > > If anybody has any ideas, please let me know!
> > > > > > >
> > > > > > > Lee.
> > > > > > >
> > > > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org>
> > > > wrote:
> > > > > > >
> > > > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > > > Thank you Daniel for pointing this out : )
> > > > > > > >
> > > > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <
> > widdis@gmail.com>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > The quota is for private repos. Public/open-source repos
> are
> > > > > > essentially
> > > > > > > > > unlimited.
> > > > > > > > >
> > > > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org>
> wrote:
> > > > > > > > >
> > > > > > > > > Thank you all for the suggestions.
> > > > > > > > > Looks like github action is an option, we'll give a
> try.
> > > > > > > > > Noticed they offer 2000 action minutes/month[1] for
> > free, I
> > > > > think
> > > > > > > > that
> > > > > > > > > should be enough for most cases.
> > > > > > > > >
> > > > > > > > > [1]
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > > > >
> > > > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > > > boards@gmail.com>
> > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > There's also some hosted CI services here like
> Jenkins,
> > > > > > BuildBot,
> > > > > > > > > > etc., which may have less queueing issues depending
> on
> > > > which
> > > > > > > > service
> > > > > > > > > > attracts the most build minute usage.
> > > > > > > > > >
> > > > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > > > jon.malkin@gmail.com
> > > > > > >
> > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > There was an issue a few months ago where the
> GitHub
> > > > > Actions
> > > > > > > > queue
> > > > > > > > > was
> > > > > > > > > > very
> > > > > > > > > > > laggy for Apache jobs, so just make sure you're
> > trying
> > > to
> > > > > be
> > > > > > > > > efficient
> > > > > > > > > > > about it. It's also a shared resource.
> > > > > > > > > > >
> > > > > > > > > > > That said, (part of) our recently graduated project
> > > uses
> > > > > > GitHub
> > > > > > > > > Actions
> > > > > > > > > > and
> > > > > > > > > > > we've been happy overall. Another part is currently
> > > > moving
> > > > > > to it
> > > > > > > > > from
> > > > > > > > > > > Travis for the exact same reason.
> > > > > > > > > > >
> > > > > > > > > > > jon
> > > > > > > > > > >
> > > > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > > > panjuan@apache.org
> > > > > >
> > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > > > We also transfer to GitHub Action, and It
> generally
> > > > works
> > > > > > well
> > > > > > > > > so far.
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > >
> > ----------------------------------------------------------------
> > > > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > > > >
> > > > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com>
> > > > wrote：
> > > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > > >
> > > > > > > > > > > > May you can consider to use github action for CI
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五
> > > 上午7:58写道：
> > > > > > > > > > > >
> > > > > > > > > > > > Hi,
> > > > > > > > > > > >
> > > > > > > > > > > > The Apache YuniKorn (Incubating) team leverages
> > > Travis
> > > > to
> > > > > > run
> > > > > > > > > > pre-commit
> > > > > > > > > > > > checks, but recently the Travis Job stays in the
> > > queue
> > > > > for
> > > > > > long
> > > > > > > > > hours
> > > > > > > > > > (6+
> > > > > > > > > > > > hours, sometimes more than 10 hours) . This is
> > highly
> > > > > > impacting
> > > > > > > > > the
> > > > > > > > > > > > productivity. I have reached the Travis support
> and
> > > the
> > > > > > > > response
> > > > > > > > > I got
> > > > > > > > > > was
> > > > > > > > > > > > the jobs got rate limited under Apache repo. Is
> > there
> > > > any
> > > > > > > > > suggestion
> > > > > > > > > > how to
> > > > > > > > > > > > fix this issue?
> > > > > > > > > > > >
> > > > > > > > > > > > Thanks
> > > > > > > > > > > > Weiwei
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > >
> > > > > > > > > > > > --
> > > > > > > > > > > > Best Regards
> > > > > > > > > > > >
> > > > > > > > > > > > Jeff Zhang
> > > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > ---------------------------------------------------------------------
> > > > > > > > > > To unsubscribe, e-mail:
> > > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > > For additional commands, e-mail:
> > > > > > general-help@incubator.apache.org
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > > > To unsubscribe, e-mail:
> > > general-unsubscribe@incubator.apache.org
> > > > > > > > > For additional commands, e-mail:
> > > > general-help@incubator.apache.org
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > --
> > > > > > > From my cell phone.
> > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail:
> general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Travis job on github
Posted by leerho <le...@gmail.com>.
Xiangdong, I noticed in your GHA yaml script you included the
Coveralls-repo-token in plaintext, which is not recommended. You can have
INFRA load the token into the GitHub repo, which you can then acquire
securely using GHA secrets.
That is what we do anyway :)
Cheers,
Lee.
On Tue, Feb 2, 2021 at 12:18 AM Yuanbo Liu <li...@gmail.com> wrote:
> It would be great if we could run a travis job on a private machine. I
> believe some companies would be glad to donate machines
> for unit testing of open source projects.
>
> On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
>
> > Xiangdong,
> > Thank you, I pretty much came up with the same solution. Nonetheless, It
> > will be interesting to see how your approach differs from mine, I'm sure
> I
> > will learn something!
> >
> > Cheers,
> >
> > Lee.
> >
> > On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com>
> wrote:
> >
> > > Hi leerho,
> > >
> > > > because the current GHA
> > > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > > generate.
> > >
> > > Actually, we can find some way to bypass the LCOV requirements,
> > > that is... do not use official github action provided by coverall.
> > >
> > > In our project (Apache IoTDB), we use maven to compile the project and
> > > use maven plugin to upload code coverage results to Coveralls.
> > >
> > > see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
> > >
> > > It works well.
> > >
> > > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > > [2] https://github.com/apache/iotdb/tree/master/code-coverage
> > > [3]
> > >
> > >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> > >
> > > Best,
> > > -----------------------------------
> > > Xiangdong Huang
> > > School of Software, Tsinghua University
> > >
> > > 黄向东
> > > 清华大学 软件学院
> > >
> > >
> > > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> > >
> > > > Sorry, I must be missing something. I don't see LCOV format in the
> > list
> > > :)
> > > > Doesn't this mean a complete rework of our toolchain ?
> > > >
> > > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com>
> wrote:
> > > >
> > > > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > > > installed) combined with the github integration (also installed),
> you
> > > > > can get that in our CloudBees CI instance. They support a lot of
> > > > > formats:
> > > > >
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > > >
> > > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > > > >
> > > > > > I am trying to move from Travis to GitHub actions for exactly
> this
> > > > > reason,
> > > > > > but in that process discovered that our coverage reporting chain
> of
> > > > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the
> > current
> > > > GHA
> > > > > > adapter for Coveralls only supports LCOV format which Jacoco
> > doesn’t
> > > > > > generate. Converting to CodeCov is a nonstarter because CodeCov
> is
> > > $$!
> > > > > >
> > > > > > If anybody has any ideas, please let me know!
> > > > > >
> > > > > > Lee.
> > > > > >
> > > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org>
> > > wrote:
> > > > > >
> > > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > > Thank you Daniel for pointing this out : )
> > > > > > >
> > > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <
> widdis@gmail.com>
> > > > > wrote:
> > > > > > >
> > > > > > > > The quota is for private repos. Public/open-source repos are
> > > > > essentially
> > > > > > > > unlimited.
> > > > > > > >
> > > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > > > > > > >
> > > > > > > > Thank you all for the suggestions.
> > > > > > > > Looks like github action is an option, we'll give a try.
> > > > > > > > Noticed they offer 2000 action minutes/month[1] for
> free, I
> > > > think
> > > > > > > that
> > > > > > > > should be enough for most cases.
> > > > > > > >
> > > > > > > > [1]
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > > >
> > > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > > boards@gmail.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > There's also some hosted CI services here like Jenkins,
> > > > > BuildBot,
> > > > > > > > > etc., which may have less queueing issues depending on
> > > which
> > > > > > > service
> > > > > > > > > attracts the most build minute usage.
> > > > > > > > >
> > > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > > jon.malkin@gmail.com
> > > > > >
> > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > There was an issue a few months ago where the GitHub
> > > > Actions
> > > > > > > queue
> > > > > > > > was
> > > > > > > > > very
> > > > > > > > > > laggy for Apache jobs, so just make sure you're
> trying
> > to
> > > > be
> > > > > > > > efficient
> > > > > > > > > > about it. It's also a shared resource.
> > > > > > > > > >
> > > > > > > > > > That said, (part of) our recently graduated project
> > uses
> > > > > GitHub
> > > > > > > > Actions
> > > > > > > > > and
> > > > > > > > > > we've been happy overall. Another part is currently
> > > moving
> > > > > to it
> > > > > > > > from
> > > > > > > > > > Travis for the exact same reason.
> > > > > > > > > >
> > > > > > > > > > jon
> > > > > > > > > >
> > > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > > panjuan@apache.org
> > > > >
> > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > > We also transfer to GitHub Action, and It generally
> > > works
> > > > > well
> > > > > > > > so far.
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > >
> ----------------------------------------------------------------
> > > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > > >
> > > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com>
> > > wrote：
> > > > > > > > > > > Hi Weiwei,
> > > > > > > > > > >
> > > > > > > > > > > May you can consider to use github action for CI
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五
> > 上午7:58写道：
> > > > > > > > > > >
> > > > > > > > > > > Hi,
> > > > > > > > > > >
> > > > > > > > > > > The Apache YuniKorn (Incubating) team leverages
> > Travis
> > > to
> > > > > run
> > > > > > > > > pre-commit
> > > > > > > > > > > checks, but recently the Travis Job stays in the
> > queue
> > > > for
> > > > > long
> > > > > > > > hours
> > > > > > > > > (6+
> > > > > > > > > > > hours, sometimes more than 10 hours) . This is
> highly
> > > > > impacting
> > > > > > > > the
> > > > > > > > > > > productivity. I have reached the Travis support and
> > the
> > > > > > > response
> > > > > > > > I got
> > > > > > > > > was
> > > > > > > > > > > the jobs got rate limited under Apache repo. Is
> there
> > > any
> > > > > > > > suggestion
> > > > > > > > > how to
> > > > > > > > > > > fix this issue?
> > > > > > > > > > >
> > > > > > > > > > > Thanks
> > > > > > > > > > > Weiwei
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > --
> > > > > > > > > > > Best Regards
> > > > > > > > > > >
> > > > > > > > > > > Jeff Zhang
> > > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > ---------------------------------------------------------------------
> > > > > > > > > To unsubscribe, e-mail:
> > > > > general-unsubscribe@incubator.apache.org
> > > > > > > > > For additional commands, e-mail:
> > > > > general-help@incubator.apache.org
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail:
> > general-unsubscribe@incubator.apache.org
> > > > > > > > For additional commands, e-mail:
> > > general-help@incubator.apache.org
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > --
> > > > > > From my cell phone.
> > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > >
> > > > >
> > > >
> > >
> >
>
Re: Travis job on github
Posted by Yuanbo Liu <li...@gmail.com>.
It would be great if we could run a travis job on a private machine. I
believe some companies would be glad to donate machines
for unit testing of open source projects.
On Tue, Feb 2, 2021 at 3:10 PM leerho <le...@gmail.com> wrote:
> Xiangdong,
> Thank you, I pretty much came up with the same solution. Nonetheless, It
> will be interesting to see how your approach differs from mine, I'm sure I
> will learn something!
>
> Cheers,
>
> Lee.
>
> On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com> wrote:
>
> > Hi leerho,
> >
> > > because the current GHA
> > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > generate.
> >
> > Actually, we can find some way to bypass the LCOV requirements,
> > that is... do not use official github action provided by coverall.
> >
> > In our project (Apache IoTDB), we use maven to compile the project and
> > use maven plugin to upload code coverage results to Coveralls.
> >
> > see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
> >
> > It works well.
> >
> > [1] https://github.com/apache/iotdb/blob/master/pom.xml
> > [2] https://github.com/apache/iotdb/tree/master/code-coverage
> > [3]
> >
> >
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
> >
> > Best,
> > -----------------------------------
> > Xiangdong Huang
> > School of Software, Tsinghua University
> >
> > 黄向东
> > 清华大学 软件学院
> >
> >
> > leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> >
> > > Sorry, I must be missing something. I don't see LCOV format in the
> list
> > :)
> > > Doesn't this mean a complete rework of our toolchain ?
> > >
> > > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com> wrote:
> > >
> > > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > > installed) combined with the github integration (also installed), you
> > > > can get that in our CloudBees CI instance. They support a lot of
> > > > formats:
> > > >
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > > >
> > > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > > >
> > > > > I am trying to move from Travis to GitHub actions for exactly this
> > > > reason,
> > > > > but in that process discovered that our coverage reporting chain of
> > > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the
> current
> > > GHA
> > > > > adapter for Coveralls only supports LCOV format which Jacoco
> doesn’t
> > > > > generate. Converting to CodeCov is a nonstarter because CodeCov is
> > $$!
> > > > >
> > > > > If anybody has any ideas, please let me know!
> > > > >
> > > > > Lee.
> > > > >
> > > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org>
> > wrote:
> > > > >
> > > > > > Oh, that's good. Then we have no problem at all.
> > > > > > Thank you Daniel for pointing this out : )
> > > > > >
> > > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com>
> > > > wrote:
> > > > > >
> > > > > > > The quota is for private repos. Public/open-source repos are
> > > > essentially
> > > > > > > unlimited.
> > > > > > >
> > > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > > > > > >
> > > > > > > Thank you all for the suggestions.
> > > > > > > Looks like github action is an option, we'll give a try.
> > > > > > > Noticed they offer 2000 action minutes/month[1] for free, I
> > > think
> > > > > > that
> > > > > > > should be enough for most cases.
> > > > > > >
> > > > > > > [1]
> > > > > > >
> > > > > > >
> > > > > >
> > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > > >
> > > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> > boards@gmail.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > There's also some hosted CI services here like Jenkins,
> > > > BuildBot,
> > > > > > > > etc., which may have less queueing issues depending on
> > which
> > > > > > service
> > > > > > > > attracts the most build minute usage.
> > > > > > > >
> > > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > > jon.malkin@gmail.com
> > > > >
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > There was an issue a few months ago where the GitHub
> > > Actions
> > > > > > queue
> > > > > > > was
> > > > > > > > very
> > > > > > > > > laggy for Apache jobs, so just make sure you're trying
> to
> > > be
> > > > > > > efficient
> > > > > > > > > about it. It's also a shared resource.
> > > > > > > > >
> > > > > > > > > That said, (part of) our recently graduated project
> uses
> > > > GitHub
> > > > > > > Actions
> > > > > > > > and
> > > > > > > > > we've been happy overall. Another part is currently
> > moving
> > > > to it
> > > > > > > from
> > > > > > > > > Travis for the exact same reason.
> > > > > > > > >
> > > > > > > > > jon
> > > > > > > > >
> > > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> > panjuan@apache.org
> > > >
> > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi Weiwei,
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > > We also transfer to GitHub Action, and It generally
> > works
> > > > well
> > > > > > > so far.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > ----------------------------------------------------------------
> > > > > > > > > > Juan Pan (Trista)
> > > > > > > > > >
> > > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com>
> > wrote：
> > > > > > > > > > Hi Weiwei,
> > > > > > > > > >
> > > > > > > > > > May you can consider to use github action for CI
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五
> 上午7:58写道：
> > > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > The Apache YuniKorn (Incubating) team leverages
> Travis
> > to
> > > > run
> > > > > > > > pre-commit
> > > > > > > > > > checks, but recently the Travis Job stays in the
> queue
> > > for
> > > > long
> > > > > > > hours
> > > > > > > > (6+
> > > > > > > > > > hours, sometimes more than 10 hours) . This is highly
> > > > impacting
> > > > > > > the
> > > > > > > > > > productivity. I have reached the Travis support and
> the
> > > > > > response
> > > > > > > I got
> > > > > > > > was
> > > > > > > > > > the jobs got rate limited under Apache repo. Is there
> > any
> > > > > > > suggestion
> > > > > > > > how to
> > > > > > > > > > fix this issue?
> > > > > > > > > >
> > > > > > > > > > Thanks
> > > > > > > > > > Weiwei
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Best Regards
> > > > > > > > > >
> > > > > > > > > > Jeff Zhang
> > > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > > > To unsubscribe, e-mail:
> > > > general-unsubscribe@incubator.apache.org
> > > > > > > > For additional commands, e-mail:
> > > > general-help@incubator.apache.org
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > ---------------------------------------------------------------------
> > > > > > > To unsubscribe, e-mail:
> general-unsubscribe@incubator.apache.org
> > > > > > > For additional commands, e-mail:
> > general-help@incubator.apache.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > > --
> > > > > From my cell phone.
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > > >
> > >
> >
>
Re: Travis job on github
Posted by leerho <le...@gmail.com>.
Xiangdong,
Thank you, I pretty much came up with the same solution. Nonetheless, It
will be interesting to see how your approach differs from mine, I'm sure I
will learn something!
Cheers,
Lee.
On Mon, Feb 1, 2021 at 8:04 PM Xiangdong Huang <sa...@gmail.com> wrote:
> Hi leerho,
>
> > because the current GHA
> adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> generate.
>
> Actually, we can find some way to bypass the LCOV requirements,
> that is... do not use official github action provided by coverall.
>
> In our project (Apache IoTDB), we use maven to compile the project and
> use maven plugin to upload code coverage results to Coveralls.
>
> see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
>
> It works well.
>
> [1] https://github.com/apache/iotdb/blob/master/pom.xml
> [2] https://github.com/apache/iotdb/tree/master/code-coverage
> [3]
>
> https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
>
> Best,
> -----------------------------------
> Xiangdong Huang
> School of Software, Tsinghua University
>
> 黄向东
> 清华大学 软件学院
>
>
> leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
>
> > Sorry, I must be missing something. I don't see LCOV format in the list
> :)
> > Doesn't this mean a complete rework of our toolchain ?
> >
> > On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com> wrote:
> >
> > > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > > installed) combined with the github integration (also installed), you
> > > can get that in our CloudBees CI instance. They support a lot of
> > > formats:
> > >
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> > >
> > > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > > >
> > > > I am trying to move from Travis to GitHub actions for exactly this
> > > reason,
> > > > but in that process discovered that our coverage reporting chain of
> > > > Maven/Java/Jacoco/Coveralls does not port to GHA because the current
> > GHA
> > > > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > > > generate. Converting to CodeCov is a nonstarter because CodeCov is
> $$!
> > > >
> > > > If anybody has any ideas, please let me know!
> > > >
> > > > Lee.
> > > >
> > > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org>
> wrote:
> > > >
> > > > > Oh, that's good. Then we have no problem at all.
> > > > > Thank you Daniel for pointing this out : )
> > > > >
> > > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com>
> > > wrote:
> > > > >
> > > > > > The quota is for private repos. Public/open-source repos are
> > > essentially
> > > > > > unlimited.
> > > > > >
> > > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > > > > >
> > > > > > Thank you all for the suggestions.
> > > > > > Looks like github action is an option, we'll give a try.
> > > > > > Noticed they offer 2000 action minutes/month[1] for free, I
> > think
> > > > > that
> > > > > > should be enough for most cases.
> > > > > >
> > > > > > [1]
> > > > > >
> > > > > >
> > > > >
> > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > > >
> > > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <
> boards@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > > > There's also some hosted CI services here like Jenkins,
> > > BuildBot,
> > > > > > > etc., which may have less queueing issues depending on
> which
> > > > > service
> > > > > > > attracts the most build minute usage.
> > > > > > >
> > > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> > jon.malkin@gmail.com
> > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > > There was an issue a few months ago where the GitHub
> > Actions
> > > > > queue
> > > > > > was
> > > > > > > very
> > > > > > > > laggy for Apache jobs, so just make sure you're trying to
> > be
> > > > > > efficient
> > > > > > > > about it. It's also a shared resource.
> > > > > > > >
> > > > > > > > That said, (part of) our recently graduated project uses
> > > GitHub
> > > > > > Actions
> > > > > > > and
> > > > > > > > we've been happy overall. Another part is currently
> moving
> > > to it
> > > > > > from
> > > > > > > > Travis for the exact same reason.
> > > > > > > >
> > > > > > > > jon
> > > > > > > >
> > > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <
> panjuan@apache.org
> > >
> > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi Weiwei,
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > > We also transfer to GitHub Action, and It generally
> works
> > > well
> > > > > > so far.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > ----------------------------------------------------------------
> > > > > > > > > Juan Pan (Trista)
> > > > > > > > >
> > > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > > E-mail: panjuan@apache.org
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com>
> wrote：
> > > > > > > > > Hi Weiwei,
> > > > > > > > >
> > > > > > > > > May you can consider to use github action for CI
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > The Apache YuniKorn (Incubating) team leverages Travis
> to
> > > run
> > > > > > > pre-commit
> > > > > > > > > checks, but recently the Travis Job stays in the queue
> > for
> > > long
> > > > > > hours
> > > > > > > (6+
> > > > > > > > > hours, sometimes more than 10 hours) . This is highly
> > > impacting
> > > > > > the
> > > > > > > > > productivity. I have reached the Travis support and the
> > > > > response
> > > > > > I got
> > > > > > > was
> > > > > > > > > the jobs got rate limited under Apache repo. Is there
> any
> > > > > > suggestion
> > > > > > > how to
> > > > > > > > > fix this issue?
> > > > > > > > >
> > > > > > > > > Thanks
> > > > > > > > > Weiwei
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Best Regards
> > > > > > > > >
> > > > > > > > > Jeff Zhang
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > To unsubscribe, e-mail:
> > > general-unsubscribe@incubator.apache.org
> > > > > > > For additional commands, e-mail:
> > > general-help@incubator.apache.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail:
> general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > > >
> > > > --
> > > > From my cell phone.
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> > >
> >
>
Re: Travis job on github
Posted by Xiangdong Huang <sa...@gmail.com>.
Hi leerho,
> because the current GHA
adapter for Coveralls only supports LCOV format which Jacoco doesn’t
generate.
Actually, we can find some way to bypass the LCOV requirements,
that is... do not use official github action provided by coverall.
In our project (Apache IoTDB), we use maven to compile the project and
use maven plugin to upload code coverage results to Coveralls.
see [1] (search "coveralls"), [2], and [3] (search "Coveralls)".
It works well.
[1] https://github.com/apache/iotdb/blob/master/pom.xml
[2] https://github.com/apache/iotdb/tree/master/code-coverage
[3]
https://github.com/apache/iotdb/blob/master/.github/workflows/main-linux.yml
Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University
黄向东
清华大学 软件学院
leerho <le...@gmail.com> 于2021年2月1日周一 上午10:25写道：
> Sorry, I must be missing something. I don't see LCOV format in the list :)
> Doesn't this mean a complete rework of our toolchain ?
>
> On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com> wrote:
>
> > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > installed) combined with the github integration (also installed), you
> > can get that in our CloudBees CI instance. They support a lot of
> > formats:
> >
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> >
> > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > >
> > > I am trying to move from Travis to GitHub actions for exactly this
> > reason,
> > > but in that process discovered that our coverage reporting chain of
> > > Maven/Java/Jacoco/Coveralls does not port to GHA because the current
> GHA
> > > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > > generate. Converting to CodeCov is a nonstarter because CodeCov is $$!
> > >
> > > If anybody has any ideas, please let me know!
> > >
> > > Lee.
> > >
> > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org> wrote:
> > >
> > > > Oh, that's good. Then we have no problem at all.
> > > > Thank you Daniel for pointing this out : )
> > > >
> > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com>
> > wrote:
> > > >
> > > > > The quota is for private repos. Public/open-source repos are
> > essentially
> > > > > unlimited.
> > > > >
> > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > > > >
> > > > > Thank you all for the suggestions.
> > > > > Looks like github action is an option, we'll give a try.
> > > > > Noticed they offer 2000 action minutes/month[1] for free, I
> think
> > > > that
> > > > > should be enough for most cases.
> > > > >
> > > > > [1]
> > > > >
> > > > >
> > > >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > >
> > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com>
> > > > wrote:
> > > > >
> > > > > > There's also some hosted CI services here like Jenkins,
> > BuildBot,
> > > > > > etc., which may have less queueing issues depending on which
> > > > service
> > > > > > attracts the most build minute usage.
> > > > > >
> > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <
> jon.malkin@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > There was an issue a few months ago where the GitHub
> Actions
> > > > queue
> > > > > was
> > > > > > very
> > > > > > > laggy for Apache jobs, so just make sure you're trying to
> be
> > > > > efficient
> > > > > > > about it. It's also a shared resource.
> > > > > > >
> > > > > > > That said, (part of) our recently graduated project uses
> > GitHub
> > > > > Actions
> > > > > > and
> > > > > > > we've been happy overall. Another part is currently moving
> > to it
> > > > > from
> > > > > > > Travis for the exact same reason.
> > > > > > >
> > > > > > > jon
> > > > > > >
> > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <panjuan@apache.org
> >
> > > > wrote:
> > > > > > >
> > > > > > > > Hi Weiwei,
> > > > > > > >
> > > > > > > >
> > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > We also transfer to GitHub Action, and It generally works
> > well
> > > > > so far.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > ----------------------------------------------------------------
> > > > > > > > Juan Pan (Trista)
> > > > > > > >
> > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > E-mail: panjuan@apache.org
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > > > > > > Hi Weiwei,
> > > > > > > >
> > > > > > > > May you can consider to use github action for CI
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > The Apache YuniKorn (Incubating) team leverages Travis to
> > run
> > > > > > pre-commit
> > > > > > > > checks, but recently the Travis Job stays in the queue
> for
> > long
> > > > > hours
> > > > > > (6+
> > > > > > > > hours, sometimes more than 10 hours) . This is highly
> > impacting
> > > > > the
> > > > > > > > productivity. I have reached the Travis support and the
> > > > response
> > > > > I got
> > > > > > was
> > > > > > > > the jobs got rate limited under Apache repo. Is there any
> > > > > suggestion
> > > > > > how to
> > > > > > > > fix this issue?
> > > > > > > >
> > > > > > > > Thanks
> > > > > > > > Weiwei
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best Regards
> > > > > > > >
> > > > > > > > Jeff Zhang
> > > > > > > >
> > > > > >
> > > > > >
> > > > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail:
> > general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail:
> > general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > >
> > > > >
> > > >
> > > --
> > > From my cell phone.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>
Re: Travis job on github
Posted by Matt Sicker <bo...@gmail.com>.
It's probably simpler to write some sort of LCOV format converter to
something supported by your destination build system than it would be
to rewrite the rest of your toolchain, but that's just conjecture.
On Sun, 31 Jan 2021 at 20:25, leerho <le...@gmail.com> wrote:
>
> Sorry, I must be missing something. I don't see LCOV format in the list :)
> Doesn't this mean a complete rework of our toolchain ?
>
> On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com> wrote:
>
> > Using https://github.com/jenkinsci/warnings-ng-plugin (already
> > installed) combined with the github integration (also installed), you
> > can get that in our CloudBees CI instance. They support a lot of
> > formats:
> > https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
> >
> > On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> > >
> > > I am trying to move from Travis to GitHub actions for exactly this
> > reason,
> > > but in that process discovered that our coverage reporting chain of
> > > Maven/Java/Jacoco/Coveralls does not port to GHA because the current GHA
> > > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > > generate. Converting to CodeCov is a nonstarter because CodeCov is $$!
> > >
> > > If anybody has any ideas, please let me know!
> > >
> > > Lee.
> > >
> > > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org> wrote:
> > >
> > > > Oh, that's good. Then we have no problem at all.
> > > > Thank you Daniel for pointing this out : )
> > > >
> > > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com>
> > wrote:
> > > >
> > > > > The quota is for private repos. Public/open-source repos are
> > essentially
> > > > > unlimited.
> > > > >
> > > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > > > >
> > > > > Thank you all for the suggestions.
> > > > > Looks like github action is an option, we'll give a try.
> > > > > Noticed they offer 2000 action minutes/month[1] for free, I think
> > > > that
> > > > > should be enough for most cases.
> > > > >
> > > > > [1]
> > > > >
> > > > >
> > > >
> > https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > > >
> > > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com>
> > > > wrote:
> > > > >
> > > > > > There's also some hosted CI services here like Jenkins,
> > BuildBot,
> > > > > > etc., which may have less queueing issues depending on which
> > > > service
> > > > > > attracts the most build minute usage.
> > > > > >
> > > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jon.malkin@gmail.com
> > >
> > > > > wrote:
> > > > > > >
> > > > > > > There was an issue a few months ago where the GitHub Actions
> > > > queue
> > > > > was
> > > > > > very
> > > > > > > laggy for Apache jobs, so just make sure you're trying to be
> > > > > efficient
> > > > > > > about it. It's also a shared resource.
> > > > > > >
> > > > > > > That said, (part of) our recently graduated project uses
> > GitHub
> > > > > Actions
> > > > > > and
> > > > > > > we've been happy overall. Another part is currently moving
> > to it
> > > > > from
> > > > > > > Travis for the exact same reason.
> > > > > > >
> > > > > > > jon
> > > > > > >
> > > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org>
> > > > wrote:
> > > > > > >
> > > > > > > > Hi Weiwei,
> > > > > > > >
> > > > > > > >
> > > > > > > > +1 for Jeff’s suggestion.
> > > > > > > > We also transfer to GitHub Action, and It generally works
> > well
> > > > > so far.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > ----------------------------------------------------------------
> > > > > > > > Juan Pan (Trista)
> > > > > > > >
> > > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > > E-mail: panjuan@apache.org
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > > > > > > Hi Weiwei,
> > > > > > > >
> > > > > > > > May you can consider to use github action for CI
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > The Apache YuniKorn (Incubating) team leverages Travis to
> > run
> > > > > > pre-commit
> > > > > > > > checks, but recently the Travis Job stays in the queue for
> > long
> > > > > hours
> > > > > > (6+
> > > > > > > > hours, sometimes more than 10 hours) . This is highly
> > impacting
> > > > > the
> > > > > > > > productivity. I have reached the Travis support and the
> > > > response
> > > > > I got
> > > > > > was
> > > > > > > > the jobs got rate limited under Apache repo. Is there any
> > > > > suggestion
> > > > > > how to
> > > > > > > > fix this issue?
> > > > > > > >
> > > > > > > > Thanks
> > > > > > > > Weiwei
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best Regards
> > > > > > > >
> > > > > > > > Jeff Zhang
> > > > > > > >
> > > > > >
> > > > > >
> > > > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail:
> > general-unsubscribe@incubator.apache.org
> > > > > > For additional commands, e-mail:
> > general-help@incubator.apache.org
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > > >
> > > > >
> > > >
> > > --
> > > From my cell phone.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: Travis job on github
Posted by leerho <le...@gmail.com>.
Sorry, I must be missing something. I don't see LCOV format in the list :)
Doesn't this mean a complete rework of our toolchain ?
On Sun, Jan 31, 2021 at 1:19 PM Matt Sicker <bo...@gmail.com> wrote:
> Using https://github.com/jenkinsci/warnings-ng-plugin (already
> installed) combined with the github integration (also installed), you
> can get that in our CloudBees CI instance. They support a lot of
> formats:
> https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
>
> On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
> >
> > I am trying to move from Travis to GitHub actions for exactly this
> reason,
> > but in that process discovered that our coverage reporting chain of
> > Maven/Java/Jacoco/Coveralls does not port to GHA because the current GHA
> > adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> > generate. Converting to CodeCov is a nonstarter because CodeCov is $$!
> >
> > If anybody has any ideas, please let me know!
> >
> > Lee.
> >
> > On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org> wrote:
> >
> > > Oh, that's good. Then we have no problem at all.
> > > Thank you Daniel for pointing this out : )
> > >
> > > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com>
> wrote:
> > >
> > > > The quota is for private repos. Public/open-source repos are
> essentially
> > > > unlimited.
> > > >
> > > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > > >
> > > > Thank you all for the suggestions.
> > > > Looks like github action is an option, we'll give a try.
> > > > Noticed they offer 2000 action minutes/month[1] for free, I think
> > > that
> > > > should be enough for most cases.
> > > >
> > > > [1]
> > > >
> > > >
> > >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > > >
> > > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com>
> > > wrote:
> > > >
> > > > > There's also some hosted CI services here like Jenkins,
> BuildBot,
> > > > > etc., which may have less queueing issues depending on which
> > > service
> > > > > attracts the most build minute usage.
> > > > >
> > > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jon.malkin@gmail.com
> >
> > > > wrote:
> > > > > >
> > > > > > There was an issue a few months ago where the GitHub Actions
> > > queue
> > > > was
> > > > > very
> > > > > > laggy for Apache jobs, so just make sure you're trying to be
> > > > efficient
> > > > > > about it. It's also a shared resource.
> > > > > >
> > > > > > That said, (part of) our recently graduated project uses
> GitHub
> > > > Actions
> > > > > and
> > > > > > we've been happy overall. Another part is currently moving
> to it
> > > > from
> > > > > > Travis for the exact same reason.
> > > > > >
> > > > > > jon
> > > > > >
> > > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org>
> > > wrote:
> > > > > >
> > > > > > > Hi Weiwei,
> > > > > > >
> > > > > > >
> > > > > > > +1 for Jeff’s suggestion.
> > > > > > > We also transfer to GitHub Action, and It generally works
> well
> > > > so far.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > ----------------------------------------------------------------
> > > > > > > Juan Pan (Trista)
> > > > > > >
> > > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > > E-mail: panjuan@apache.org
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > > > > > Hi Weiwei,
> > > > > > >
> > > > > > > May you can consider to use github action for CI
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > The Apache YuniKorn (Incubating) team leverages Travis to
> run
> > > > > pre-commit
> > > > > > > checks, but recently the Travis Job stays in the queue for
> long
> > > > hours
> > > > > (6+
> > > > > > > hours, sometimes more than 10 hours) . This is highly
> impacting
> > > > the
> > > > > > > productivity. I have reached the Travis support and the
> > > response
> > > > I got
> > > > > was
> > > > > > > the jobs got rate limited under Apache repo. Is there any
> > > > suggestion
> > > > > how to
> > > > > > > fix this issue?
> > > > > > >
> > > > > > > Thanks
> > > > > > > Weiwei
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Best Regards
> > > > > > >
> > > > > > > Jeff Zhang
> > > > > > >
> > > > >
> > > > >
> > > ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail:
> general-unsubscribe@incubator.apache.org
> > > > > For additional commands, e-mail:
> general-help@incubator.apache.org
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > > >
> > >
> > --
> > From my cell phone.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
Re: Travis job on github
Posted by Matt Sicker <bo...@gmail.com>.
Using https://github.com/jenkinsci/warnings-ng-plugin (already
installed) combined with the github integration (also installed), you
can get that in our CloudBees CI instance. They support a lot of
formats: https://github.com/jenkinsci/warnings-ng-plugin/blob/master/SUPPORTED-FORMATS.md
On Sun, 31 Jan 2021 at 00:53, leerho <le...@gmail.com> wrote:
>
> I am trying to move from Travis to GitHub actions for exactly this reason,
> but in that process discovered that our coverage reporting chain of
> Maven/Java/Jacoco/Coveralls does not port to GHA because the current GHA
> adapter for Coveralls only supports LCOV format which Jacoco doesn’t
> generate. Converting to CodeCov is a nonstarter because CodeCov is $$!
>
> If anybody has any ideas, please let me know!
>
> Lee.
>
> On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org> wrote:
>
> > Oh, that's good. Then we have no problem at all.
> > Thank you Daniel for pointing this out : )
> >
> > On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com> wrote:
> >
> > > The quota is for private repos. Public/open-source repos are essentially
> > > unlimited.
> > >
> > > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> > >
> > > Thank you all for the suggestions.
> > > Looks like github action is an option, we'll give a try.
> > > Noticed they offer 2000 action minutes/month[1] for free, I think
> > that
> > > should be enough for most cases.
> > >
> > > [1]
> > >
> > >
> > https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> > >
> > > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com>
> > wrote:
> > >
> > > > There's also some hosted CI services here like Jenkins, BuildBot,
> > > > etc., which may have less queueing issues depending on which
> > service
> > > > attracts the most build minute usage.
> > > >
> > > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jo...@gmail.com>
> > > wrote:
> > > > >
> > > > > There was an issue a few months ago where the GitHub Actions
> > queue
> > > was
> > > > very
> > > > > laggy for Apache jobs, so just make sure you're trying to be
> > > efficient
> > > > > about it. It's also a shared resource.
> > > > >
> > > > > That said, (part of) our recently graduated project uses GitHub
> > > Actions
> > > > and
> > > > > we've been happy overall. Another part is currently moving to it
> > > from
> > > > > Travis for the exact same reason.
> > > > >
> > > > > jon
> > > > >
> > > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org>
> > wrote:
> > > > >
> > > > > > Hi Weiwei,
> > > > > >
> > > > > >
> > > > > > +1 for Jeff’s suggestion.
> > > > > > We also transfer to GitHub Action, and It generally works well
> > > so far.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > ----------------------------------------------------------------
> > > > > > Juan Pan (Trista)
> > > > > >
> > > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > > E-mail: panjuan@apache.org
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > > > > Hi Weiwei,
> > > > > >
> > > > > > May you can consider to use github action for CI
> > > > > >
> > > > > >
> > > > > >
> > > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > > > >
> > > > > > Hi,
> > > > > >
> > > > > > The Apache YuniKorn (Incubating) team leverages Travis to run
> > > > pre-commit
> > > > > > checks, but recently the Travis Job stays in the queue for long
> > > hours
> > > > (6+
> > > > > > hours, sometimes more than 10 hours) . This is highly impacting
> > > the
> > > > > > productivity. I have reached the Travis support and the
> > response
> > > I got
> > > > was
> > > > > > the jobs got rate limited under Apache repo. Is there any
> > > suggestion
> > > > how to
> > > > > > fix this issue?
> > > > > >
> > > > > > Thanks
> > > > > > Weiwei
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best Regards
> > > > > >
> > > > > > Jeff Zhang
> > > > > >
> > > >
> > > >
> > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > > For additional commands, e-mail: general-help@incubator.apache.org
> > > >
> > > >
> > >
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> > >
> >
> --
> From my cell phone.
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: Travis job on github
Posted by leerho <le...@gmail.com>.
I am trying to move from Travis to GitHub actions for exactly this reason,
but in that process discovered that our coverage reporting chain of
Maven/Java/Jacoco/Coveralls does not port to GHA because the current GHA
adapter for Coveralls only supports LCOV format which Jacoco doesn’t
generate. Converting to CodeCov is a nonstarter because CodeCov is $$!
If anybody has any ideas, please let me know!
Lee.
On Thu, Jan 28, 2021 at 10:02 PM Weiwei Yang <ww...@apache.org> wrote:
> Oh, that's good. Then we have no problem at all.
> Thank you Daniel for pointing this out : )
>
> On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com> wrote:
>
> > The quota is for private repos. Public/open-source repos are essentially
> > unlimited.
> >
> > On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
> >
> > Thank you all for the suggestions.
> > Looks like github action is an option, we'll give a try.
> > Noticed they offer 2000 action minutes/month[1] for free, I think
> that
> > should be enough for most cases.
> >
> > [1]
> >
> >
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
> >
> > On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com>
> wrote:
> >
> > > There's also some hosted CI services here like Jenkins, BuildBot,
> > > etc., which may have less queueing issues depending on which
> service
> > > attracts the most build minute usage.
> > >
> > > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jo...@gmail.com>
> > wrote:
> > > >
> > > > There was an issue a few months ago where the GitHub Actions
> queue
> > was
> > > very
> > > > laggy for Apache jobs, so just make sure you're trying to be
> > efficient
> > > > about it. It's also a shared resource.
> > > >
> > > > That said, (part of) our recently graduated project uses GitHub
> > Actions
> > > and
> > > > we've been happy overall. Another part is currently moving to it
> > from
> > > > Travis for the exact same reason.
> > > >
> > > > jon
> > > >
> > > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org>
> wrote:
> > > >
> > > > > Hi Weiwei,
> > > > >
> > > > >
> > > > > +1 for Jeff’s suggestion.
> > > > > We also transfer to GitHub Action, and It generally works well
> > so far.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> ----------------------------------------------------------------
> > > > > Juan Pan (Trista)
> > > > >
> > > > > Senior DBA & PMC of Apache ShardingSphere
> > > > > E-mail: panjuan@apache.org
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > > > Hi Weiwei,
> > > > >
> > > > > May you can consider to use github action for CI
> > > > >
> > > > >
> > > > >
> > > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > > >
> > > > > Hi,
> > > > >
> > > > > The Apache YuniKorn (Incubating) team leverages Travis to run
> > > pre-commit
> > > > > checks, but recently the Travis Job stays in the queue for long
> > hours
> > > (6+
> > > > > hours, sometimes more than 10 hours) . This is highly impacting
> > the
> > > > > productivity. I have reached the Travis support and the
> response
> > I got
> > > was
> > > > > the jobs got rate limited under Apache repo. Is there any
> > suggestion
> > > how to
> > > > > fix this issue?
> > > > >
> > > > > Thanks
> > > > > Weiwei
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best Regards
> > > > >
> > > > > Jeff Zhang
> > > > >
> > >
> > >
> ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: general-help@incubator.apache.org
> > >
> > >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>
--
From my cell phone.
Re: Travis job on github
Posted by Weiwei Yang <ww...@apache.org>.
Oh, that's good. Then we have no problem at all.
Thank you Daniel for pointing this out : )
On Thu, Jan 28, 2021 at 9:48 PM Daniel Widdis <wi...@gmail.com> wrote:
> The quota is for private repos. Public/open-source repos are essentially
> unlimited.
>
> On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
>
> Thank you all for the suggestions.
> Looks like github action is an option, we'll give a try.
> Noticed they offer 2000 action minutes/month[1] for free, I think that
> should be enough for most cases.
>
> [1]
>
> https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
>
> On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com> wrote:
>
> > There's also some hosted CI services here like Jenkins, BuildBot,
> > etc., which may have less queueing issues depending on which service
> > attracts the most build minute usage.
> >
> > On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jo...@gmail.com>
> wrote:
> > >
> > > There was an issue a few months ago where the GitHub Actions queue
> was
> > very
> > > laggy for Apache jobs, so just make sure you're trying to be
> efficient
> > > about it. It's also a shared resource.
> > >
> > > That said, (part of) our recently graduated project uses GitHub
> Actions
> > and
> > > we've been happy overall. Another part is currently moving to it
> from
> > > Travis for the exact same reason.
> > >
> > > jon
> > >
> > > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org> wrote:
> > >
> > > > Hi Weiwei,
> > > >
> > > >
> > > > +1 for Jeff’s suggestion.
> > > > We also transfer to GitHub Action, and It generally works well
> so far.
> > > >
> > > >
> > > >
> > > >
> > > > ----------------------------------------------------------------
> > > > Juan Pan (Trista)
> > > >
> > > > Senior DBA & PMC of Apache ShardingSphere
> > > > E-mail: panjuan@apache.org
> > > >
> > > >
> > > >
> > > >
> > > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > > Hi Weiwei,
> > > >
> > > > May you can consider to use github action for CI
> > > >
> > > >
> > > >
> > > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > > >
> > > > Hi,
> > > >
> > > > The Apache YuniKorn (Incubating) team leverages Travis to run
> > pre-commit
> > > > checks, but recently the Travis Job stays in the queue for long
> hours
> > (6+
> > > > hours, sometimes more than 10 hours) . This is highly impacting
> the
> > > > productivity. I have reached the Travis support and the response
> I got
> > was
> > > > the jobs got rate limited under Apache repo. Is there any
> suggestion
> > how to
> > > > fix this issue?
> > > >
> > > > Thanks
> > > > Weiwei
> > > >
> > > >
> > > >
> > > > --
> > > > Best Regards
> > > >
> > > > Jeff Zhang
> > > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: general-help@incubator.apache.org
> >
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
Re: Travis job on github
Posted by Daniel Widdis <wi...@gmail.com>.
The quota is for private repos. Public/open-source repos are essentially unlimited.
On 1/28/21, 9:44 PM, "Weiwei Yang" <ww...@apache.org> wrote:
Thank you all for the suggestions.
Looks like github action is an option, we'll give a try.
Noticed they offer 2000 action minutes/month[1] for free, I think that
should be enough for most cases.
[1]
https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com> wrote:
> There's also some hosted CI services here like Jenkins, BuildBot,
> etc., which may have less queueing issues depending on which service
> attracts the most build minute usage.
>
> On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jo...@gmail.com> wrote:
> >
> > There was an issue a few months ago where the GitHub Actions queue was
> very
> > laggy for Apache jobs, so just make sure you're trying to be efficient
> > about it. It's also a shared resource.
> >
> > That said, (part of) our recently graduated project uses GitHub Actions
> and
> > we've been happy overall. Another part is currently moving to it from
> > Travis for the exact same reason.
> >
> > jon
> >
> > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org> wrote:
> >
> > > Hi Weiwei,
> > >
> > >
> > > +1 for Jeff’s suggestion.
> > > We also transfer to GitHub Action, and It generally works well so far.
> > >
> > >
> > >
> > >
> > > ----------------------------------------------------------------
> > > Juan Pan (Trista)
> > >
> > > Senior DBA & PMC of Apache ShardingSphere
> > > E-mail: panjuan@apache.org
> > >
> > >
> > >
> > >
> > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > Hi Weiwei,
> > >
> > > May you can consider to use github action for CI
> > >
> > >
> > >
> > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > >
> > > Hi,
> > >
> > > The Apache YuniKorn (Incubating) team leverages Travis to run
> pre-commit
> > > checks, but recently the Travis Job stays in the queue for long hours
> (6+
> > > hours, sometimes more than 10 hours) . This is highly impacting the
> > > productivity. I have reached the Travis support and the response I got
> was
> > > the jobs got rate limited under Apache repo. Is there any suggestion
> how to
> > > fix this issue?
> > >
> > > Thanks
> > > Weiwei
> > >
> > >
> > >
> > > --
> > > Best Regards
> > >
> > > Jeff Zhang
> > >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: Travis job on github
Posted by Weiwei Yang <ww...@apache.org>.
Thank you all for the suggestions.
Looks like github action is an option, we'll give a try.
Noticed they offer 2000 action minutes/month[1] for free, I think that
should be enough for most cases.
[1]
https://docs.github.com/en/github/setting-up-and-managing-billing-and-payments-on-github/about-billing-for-github-actions
On Thu, Jan 28, 2021 at 6:36 PM Matt Sicker <bo...@gmail.com> wrote:
> There's also some hosted CI services here like Jenkins, BuildBot,
> etc., which may have less queueing issues depending on which service
> attracts the most build minute usage.
>
> On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jo...@gmail.com> wrote:
> >
> > There was an issue a few months ago where the GitHub Actions queue was
> very
> > laggy for Apache jobs, so just make sure you're trying to be efficient
> > about it. It's also a shared resource.
> >
> > That said, (part of) our recently graduated project uses GitHub Actions
> and
> > we've been happy overall. Another part is currently moving to it from
> > Travis for the exact same reason.
> >
> > jon
> >
> > On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org> wrote:
> >
> > > Hi Weiwei,
> > >
> > >
> > > +1 for Jeff’s suggestion.
> > > We also transfer to GitHub Action, and It generally works well so far.
> > >
> > >
> > >
> > >
> > > ----------------------------------------------------------------
> > > Juan Pan (Trista)
> > >
> > > Senior DBA & PMC of Apache ShardingSphere
> > > E-mail: panjuan@apache.org
> > >
> > >
> > >
> > >
> > > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > > Hi Weiwei,
> > >
> > > May you can consider to use github action for CI
> > >
> > >
> > >
> > > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> > >
> > > Hi,
> > >
> > > The Apache YuniKorn (Incubating) team leverages Travis to run
> pre-commit
> > > checks, but recently the Travis Job stays in the queue for long hours
> (6+
> > > hours, sometimes more than 10 hours) . This is highly impacting the
> > > productivity. I have reached the Travis support and the response I got
> was
> > > the jobs got rate limited under Apache repo. Is there any suggestion
> how to
> > > fix this issue?
> > >
> > > Thanks
> > > Weiwei
> > >
> > >
> > >
> > > --
> > > Best Regards
> > >
> > > Jeff Zhang
> > >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
>
Re: Travis job on github
Posted by Matt Sicker <bo...@gmail.com>.
There's also some hosted CI services here like Jenkins, BuildBot,
etc., which may have less queueing issues depending on which service
attracts the most build minute usage.
On Thu, 28 Jan 2021 at 20:23, Jon Malkin <jo...@gmail.com> wrote:
>
> There was an issue a few months ago where the GitHub Actions queue was very
> laggy for Apache jobs, so just make sure you're trying to be efficient
> about it. It's also a shared resource.
>
> That said, (part of) our recently graduated project uses GitHub Actions and
> we've been happy overall. Another part is currently moving to it from
> Travis for the exact same reason.
>
> jon
>
> On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org> wrote:
>
> > Hi Weiwei,
> >
> >
> > +1 for Jeff’s suggestion.
> > We also transfer to GitHub Action, and It generally works well so far.
> >
> >
> >
> >
> > ----------------------------------------------------------------
> > Juan Pan (Trista)
> >
> > Senior DBA & PMC of Apache ShardingSphere
> > E-mail: panjuan@apache.org
> >
> >
> >
> >
> > On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> > Hi Weiwei,
> >
> > May you can consider to use github action for CI
> >
> >
> >
> > Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> >
> > Hi,
> >
> > The Apache YuniKorn (Incubating) team leverages Travis to run pre-commit
> > checks, but recently the Travis Job stays in the queue for long hours (6+
> > hours, sometimes more than 10 hours) . This is highly impacting the
> > productivity. I have reached the Travis support and the response I got was
> > the jobs got rate limited under Apache repo. Is there any suggestion how to
> > fix this issue?
> >
> > Thanks
> > Weiwei
> >
> >
> >
> > --
> > Best Regards
> >
> > Jeff Zhang
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: Travis job on github
Posted by Jon Malkin <jo...@gmail.com>.
There was an issue a few months ago where the GitHub Actions queue was very
laggy for Apache jobs, so just make sure you're trying to be efficient
about it. It's also a shared resource.
That said, (part of) our recently graduated project uses GitHub Actions and
we've been happy overall. Another part is currently moving to it from
Travis for the exact same reason.
jon
On Thu, Jan 28, 2021, 6:15 PM Juan Pan <pa...@apache.org> wrote:
> Hi Weiwei,
>
>
> +1 for Jeff’s suggestion.
> We also transfer to GitHub Action, and It generally works well so far.
>
>
>
>
> ----------------------------------------------------------------
> Juan Pan (Trista)
>
> Senior DBA & PMC of Apache ShardingSphere
> E-mail: panjuan@apache.org
>
>
>
>
> On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
> Hi Weiwei,
>
> May you can consider to use github action for CI
>
>
>
> Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
>
> Hi,
>
> The Apache YuniKorn (Incubating) team leverages Travis to run pre-commit
> checks, but recently the Travis Job stays in the queue for long hours (6+
> hours, sometimes more than 10 hours) . This is highly impacting the
> productivity. I have reached the Travis support and the response I got was
> the jobs got rate limited under Apache repo. Is there any suggestion how to
> fix this issue?
>
> Thanks
> Weiwei
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>
Re: Travis job on github
Posted by Juan Pan <pa...@apache.org>.
Hi Weiwei,
+1 for Jeff’s suggestion.
We also transfer to GitHub Action, and It generally works well so far.
----------------------------------------------------------------
Juan Pan (Trista)
Senior DBA & PMC of Apache ShardingSphere
E-mail: panjuan@apache.org
On 01/29/2021 08:00，Jeff Zhang<zj...@gmail.com> wrote：
Hi Weiwei,
May you can consider to use github action for CI
Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
Hi,
The Apache YuniKorn (Incubating) team leverages Travis to run pre-commit
checks, but recently the Travis Job stays in the queue for long hours (6+
hours, sometimes more than 10 hours) . This is highly impacting the
productivity. I have reached the Travis support and the response I got was
the jobs got rate limited under Apache repo. Is there any suggestion how to
fix this issue?
Thanks
Weiwei
--
Best Regards
Jeff Zhang
Re: Travis job on github
Posted by Jeff Zhang <zj...@gmail.com>.
Hi Weiwei,
May you can consider to use github action for CI
Weiwei Yang <ww...@apache.org> 于2021年1月29日周五 上午7:58写道：
> Hi,
>
> The Apache YuniKorn (Incubating) team leverages Travis to run pre-commit
> checks, but recently the Travis Job stays in the queue for long hours (6+
> hours, sometimes more than 10 hours) . This is highly impacting the
> productivity. I have reached the Travis support and the response I got was
> the jobs got rate limited under Apache repo. Is there any suggestion how to
> fix this issue?
>
> Thanks
> Weiwei
>
--
Best Regards
Jeff Zhang