You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hudi.apache.org by nishith agarwal <n3...@gmail.com> on 2020/08/01 03:20:57 UTC

Re: PSA: master integ-tests failing

All,

I've added new log4j properties to the docker setup to limit the spark logs
from the spark driver. Master should be stable. One thing I noticed during
this is that the class `HoodieSparkSqlWriter` also runs as part of the
integration tests which it should not, thus adding to the logs.

@raymond - any ideas why this is happening? I noticed you made some changes
to the functional tests and from cursory looks of the parent pom.xml I
couldn't find anything wrong.

Thanks,
Nishith

On Fri, Jul 31, 2020 at 8:23 AM Vinoth Chandar <vi...@apache.org> wrote:

> Hello all,
>
> integ-tests are currently failing due to exceeding the log limit on master
> branch. Nishith is actively debugging what's going on.
>
> I request you to hold off merging more PRs in the meantime, until we
> resolve this.
>
> @ nishith , please update this thread, when master is stable again
>
> thanks
> vinoth
>

Re: PSA: master integ-tests failing

Posted by nishith agarwal <n3...@gmail.com>.

Thanks Raymond!

-Nishith

On Sun, Aug 2, 2020 at 8:26 PM Vinoth Chandar <vi...@apache.org> wrote:

> Thanks Raymond, for jumping in. Just one comment on the PR
>
> On Sat, Aug 1, 2020 at 10:53 AM Shiyan Xu <xu...@gmail.com>
> wrote:
>
> > looks like this is caused by scalatest-maven-plugin, which is controlled
> by
> > skipTests property.
> > had a fix for changing to skipUTs
> > https://github.com/apache/hudi/pull/1897/files
> >
> > On Fri, Jul 31, 2020 at 8:21 PM nishith agarwal <n3...@gmail.com>
> > wrote:
> >
> > > All,
> > >
> > > I've added new log4j properties to the docker setup to limit the spark
> > logs
> > > from the spark driver. Master should be stable. One thing I noticed
> > during
> > > this is that the class `HoodieSparkSqlWriter` also runs as part of the
> > > integration tests which it should not, thus adding to the logs.
> > >
> > > @raymond - any ideas why this is happening? I noticed you made some
> > changes
> > > to the functional tests and from cursory looks of the parent pom.xml I
> > > couldn't find anything wrong.
> > >
> > > Thanks,
> > > Nishith
> > >
> > > On Fri, Jul 31, 2020 at 8:23 AM Vinoth Chandar <vi...@apache.org>
> > wrote:
> > >
> > > > Hello all,
> > > >
> > > > integ-tests are currently failing due to exceeding the log limit on
> > > master
> > > > branch. Nishith is actively debugging what's going on.
> > > >
> > > > I request you to hold off merging more PRs in the meantime, until we
> > > > resolve this.
> > > >
> > > > @ nishith , please update this thread, when master is stable again
> > > >
> > > > thanks
> > > > vinoth
> > > >
> > >
> >
>

Re: PSA: master integ-tests failing

Posted by Vinoth Chandar <vi...@apache.org>.

Thanks Raymond, for jumping in. Just one comment on the PR

On Sat, Aug 1, 2020 at 10:53 AM Shiyan Xu <xu...@gmail.com>
wrote:

> looks like this is caused by scalatest-maven-plugin, which is controlled by
> skipTests property.
> had a fix for changing to skipUTs
> https://github.com/apache/hudi/pull/1897/files
>
> On Fri, Jul 31, 2020 at 8:21 PM nishith agarwal <n3...@gmail.com>
> wrote:
>
> > All,
> >
> > I've added new log4j properties to the docker setup to limit the spark
> logs
> > from the spark driver. Master should be stable. One thing I noticed
> during
> > this is that the class `HoodieSparkSqlWriter` also runs as part of the
> > integration tests which it should not, thus adding to the logs.
> >
> > @raymond - any ideas why this is happening? I noticed you made some
> changes
> > to the functional tests and from cursory looks of the parent pom.xml I
> > couldn't find anything wrong.
> >
> > Thanks,
> > Nishith
> >
> > On Fri, Jul 31, 2020 at 8:23 AM Vinoth Chandar <vi...@apache.org>
> wrote:
> >
> > > Hello all,
> > >
> > > integ-tests are currently failing due to exceeding the log limit on
> > master
> > > branch. Nishith is actively debugging what's going on.
> > >
> > > I request you to hold off merging more PRs in the meantime, until we
> > > resolve this.
> > >
> > > @ nishith , please update this thread, when master is stable again
> > >
> > > thanks
> > > vinoth
> > >
> >
>

Re: PSA: master integ-tests failing

Posted by Shiyan Xu <xu...@gmail.com>.

looks like this is caused by scalatest-maven-plugin, which is controlled by
skipTests property.
had a fix for changing to skipUTs
https://github.com/apache/hudi/pull/1897/files

On Fri, Jul 31, 2020 at 8:21 PM nishith agarwal <n3...@gmail.com> wrote:

> All,
>
> I've added new log4j properties to the docker setup to limit the spark logs
> from the spark driver. Master should be stable. One thing I noticed during
> this is that the class `HoodieSparkSqlWriter` also runs as part of the
> integration tests which it should not, thus adding to the logs.
>
> @raymond - any ideas why this is happening? I noticed you made some changes
> to the functional tests and from cursory looks of the parent pom.xml I
> couldn't find anything wrong.
>
> Thanks,
> Nishith
>
> On Fri, Jul 31, 2020 at 8:23 AM Vinoth Chandar <vi...@apache.org> wrote:
>
> > Hello all,
> >
> > integ-tests are currently failing due to exceeding the log limit on
> master
> > branch. Nishith is actively debugging what's going on.
> >
> > I request you to hold off merging more PRs in the meantime, until we
> > resolve this.
> >
> > @ nishith , please update this thread, when master is stable again
> >
> > thanks
> > vinoth
> >
>