You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@geode.apache.org by Kirk Lund <kl...@apache.org> on 2017/08/21 21:19:12 UTC

geode-old-versions dependencies is slooooowwww

Why does "geode-old-versions" download previous versions every time I
rebuild from the command-line? And why is it soooo slow? Can't we cache
these like other dependencies?

:geode-old-versions:compileJava UP-TO-DATE
:geode-old-versions:downloadSHAtest120
Download
https://www.apache.org/dist/geode/1.2.0/apache-geode-1.2.0.tar.gz.sha256
:geode-old-versions:downloadZipFiletest120
Download
https://www.apache.org/dyn/closer.cgi?action=download&filename=geode/1.2.0/apache-geode-1.2.0.tar.gz
> Building 13% > :geode-old-versions:downloadZipFiletest120 > 32.81
MB/87.14 MB downloaded

A *couple minutes later* and it's still 13% and very slow...

> Building 13% > :geode-old-versions:downloadZipFiletest120 > 51.41
MB/87.14 MB downloaded

Re: geode-old-versions dependencies is slooooowwww

Posted by Patrick Rhomberg <pr...@pivotal.io>.
Victory!

Thanks.

On Mon, Aug 21, 2017 at 3:30 PM, Dan Smith <ds...@pivotal.io> wrote:

> On Mon, Aug 21, 2017 at 3:14 PM, Patrick Rhomberg <pr...@pivotal.io>
> wrote:
>
> > I am also in favor of skipping the download, but now I'm failing my build
> >
>
> Yes, but the important part is that it didn't download anything :)
>
> Sorry about that, it looks like I screwed something up. Can you pull and
> try again?
>
> -Dan
>

Re: geode-old-versions dependencies is slooooowwww

Posted by Dan Smith <ds...@pivotal.io>.
On Mon, Aug 21, 2017 at 3:14 PM, Patrick Rhomberg <pr...@pivotal.io>
wrote:

> I am also in favor of skipping the download, but now I'm failing my build
>

Yes, but the important part is that it didn't download anything :)

Sorry about that, it looks like I screwed something up. Can you pull and
try again?

-Dan

Re: geode-old-versions dependencies is slooooowwww

Posted by Patrick Rhomberg <pr...@pivotal.io>.
I am also in favor of skipping the download, but now I'm failing my build
with

All test reports at /.../build/reports/combined

FAILURE: Build failed with an exception.

* Where:
Build file '/.../geode-old-versions/build.gradle' line: 60

* What went wrong:
Execution failed for task ':geode-old-versions:verifyGeodetest120'.
> java.io.FileNotFoundException:
/.../geode-old-versions/build/apache-geode-1.2.0.tar.gz.sha256 (No such
file or directory)



On Mon, Aug 21, 2017 at 2:28 PM, Kirk Lund <kl...@apache.org> wrote:

> Awesome! Thank you Dan!
>
> On Mon, Aug 21, 2017 at 2:26 PM, Dan Smith <ds...@pivotal.io> wrote:
>
> > Hi Kirk,
> >
> > I just pushed a fix for this. It should only download geode.1.2.0 the
> first
> > time you build.
> >
> > -Dan
> >
> > On Mon, Aug 21, 2017 at 2:19 PM, Kirk Lund <kl...@apache.org> wrote:
> >
> > > Why does "geode-old-versions" download previous versions every time I
> > > rebuild from the command-line? And why is it soooo slow? Can't we cache
> > > these like other dependencies?
> > >
> > > :geode-old-versions:compileJava UP-TO-DATE
> > > :geode-old-versions:downloadSHAtest120
> > > Download
> > > https://www.apache.org/dist/geode/1.2.0/apache-geode-1.2.
> 0.tar.gz.sha256
> > > :geode-old-versions:downloadZipFiletest120
> > > Download
> > > https://www.apache.org/dyn/closer.cgi?action=download&
> > > filename=geode/1.2.0/apache-geode-1.2.0.tar.gz
> > > > Building 13% > :geode-old-versions:downloadZipFiletest120 > 32.81
> > > MB/87.14 MB downloaded
> > >
> > > A *couple minutes later* and it's still 13% and very slow...
> > >
> > > > Building 13% > :geode-old-versions:downloadZipFiletest120 > 51.41
> > > MB/87.14 MB downloaded
> > >
> >
>

Re: geode-old-versions dependencies is slooooowwww

Posted by Kirk Lund <kl...@apache.org>.
Awesome! Thank you Dan!

On Mon, Aug 21, 2017 at 2:26 PM, Dan Smith <ds...@pivotal.io> wrote:

> Hi Kirk,
>
> I just pushed a fix for this. It should only download geode.1.2.0 the first
> time you build.
>
> -Dan
>
> On Mon, Aug 21, 2017 at 2:19 PM, Kirk Lund <kl...@apache.org> wrote:
>
> > Why does "geode-old-versions" download previous versions every time I
> > rebuild from the command-line? And why is it soooo slow? Can't we cache
> > these like other dependencies?
> >
> > :geode-old-versions:compileJava UP-TO-DATE
> > :geode-old-versions:downloadSHAtest120
> > Download
> > https://www.apache.org/dist/geode/1.2.0/apache-geode-1.2.0.tar.gz.sha256
> > :geode-old-versions:downloadZipFiletest120
> > Download
> > https://www.apache.org/dyn/closer.cgi?action=download&
> > filename=geode/1.2.0/apache-geode-1.2.0.tar.gz
> > > Building 13% > :geode-old-versions:downloadZipFiletest120 > 32.81
> > MB/87.14 MB downloaded
> >
> > A *couple minutes later* and it's still 13% and very slow...
> >
> > > Building 13% > :geode-old-versions:downloadZipFiletest120 > 51.41
> > MB/87.14 MB downloaded
> >
>

Re: geode-old-versions dependencies is slooooowwww

Posted by Dan Smith <ds...@pivotal.io>.
Hi Kirk,

I just pushed a fix for this. It should only download geode.1.2.0 the first
time you build.

-Dan

On Mon, Aug 21, 2017 at 2:19 PM, Kirk Lund <kl...@apache.org> wrote:

> Why does "geode-old-versions" download previous versions every time I
> rebuild from the command-line? And why is it soooo slow? Can't we cache
> these like other dependencies?
>
> :geode-old-versions:compileJava UP-TO-DATE
> :geode-old-versions:downloadSHAtest120
> Download
> https://www.apache.org/dist/geode/1.2.0/apache-geode-1.2.0.tar.gz.sha256
> :geode-old-versions:downloadZipFiletest120
> Download
> https://www.apache.org/dyn/closer.cgi?action=download&
> filename=geode/1.2.0/apache-geode-1.2.0.tar.gz
> > Building 13% > :geode-old-versions:downloadZipFiletest120 > 32.81
> MB/87.14 MB downloaded
>
> A *couple minutes later* and it's still 13% and very slow...
>
> > Building 13% > :geode-old-versions:downloadZipFiletest120 > 51.41
> MB/87.14 MB downloaded
>

Re: geode-old-versions dependencies is slooooowwww

Posted by Kirk Lund <kl...@apache.org>.
So I gave up after 10 minutes, killed my build and restarted it. Now it
finished much faster. I had the same thing happen earlier today around
9:15am.

"geode-old-versions" is definitely a problem now... either we're not
fetching the previous versions correctly or the infra it's on is broken or
we should be caching this like other dependencies. I don't see why I need
to re-download Geode 1.2.0 EVERY single time I do a clean build.

On Mon, Aug 21, 2017 at 2:19 PM, Kirk Lund <kl...@apache.org> wrote:

> Why does "geode-old-versions" download previous versions every time I
> rebuild from the command-line? And why is it soooo slow? Can't we cache
> these like other dependencies?
>
> :geode-old-versions:compileJava UP-TO-DATE
> :geode-old-versions:downloadSHAtest120
> Download https://www.apache.org/dist/geode/1.2.0/apache-geode-1.2.
> 0.tar.gz.sha256
> :geode-old-versions:downloadZipFiletest120
> Download https://www.apache.org/dyn/closer.cgi?action=download&
> filename=geode/1.2.0/apache-geode-1.2.0.tar.gz
> > Building 13% > :geode-old-versions:downloadZipFiletest120 > 32.81
> MB/87.14 MB downloaded
>
> A *couple minutes later* and it's still 13% and very slow...
>
> > Building 13% > :geode-old-versions:downloadZipFiletest120 > 51.41
> MB/87.14 MB downloaded
>
>