You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by László Bodor <bo...@gmail.com> on 2020/07/27 14:46:01 UTC
tez 0.10 SNAPSHOT artifacts
Hi!
I'm wondering what's the policy of generating tez SNAPSHOT artifacts.
Seems like the "current" tez jar doesn't contain some changes:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
I need to see and compile against TezSpillRecord changes introduced in
TEZ-4145, but after extracting TezSpillRecord.class I get this for javap:
javap TezSpillRecord.class
Compiled from "TezSpillRecord.java"
...
public
org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(int);
public
org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
org.apache.hadoop.conf.Configuration) throws java.io.IOException;
public
org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
org.apache.hadoop.conf.Configuration, java.lang.String) throws
java.io.IOException;
public
org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
org.apache.hadoop.conf.Configuration, java.util.zip.Checksum,
java.lang.String) throws java.io.IOException;
...
}
I'm expecting the new constructor to be here (Path, FileSystem, String):
https://github.com/apache/tez/commit/7dbec63e1f97eea95ab998e16ffcd592ff6be332#diff-358f7c423b64e350b9cae8462c24de20R60
How could I proceed with this?
I would be also happy to use another repo for newer snapshots, if that
makes sense.
Currently, without setting.xml, maven downloads above jar from
repository.apache.org/snapshots:
Downloading from repository-release:
https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading from apache.snapshots:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
Downloaded from apache.snapshots:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
(1.0 kB at 3.7 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
Downloading from repository-release:
https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
Downloading from apache.snapshots:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
Downloaded from apache.snapshots:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
(5.7 kB at 33 kB/s)
Downloading from apache.snapshots:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
Downloaded from apache.snapshots:
https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
(779 kB at 2.6 MB/s)
Regards,
Laszlo Bodor
Re: tez 0.10 SNAPSHOT artifacts
Posted by László Bodor <bo...@gmail.com>.
Thanks Jonathan, it's working now as expected.
On Mon, 27 Jul 2020 at 19:54, Jonathan Eagles <je...@gmail.com> wrote:
> I have uploaded a new set of 0.10.1 snapshots with
> version 0.10.1-20200727.165306-21. This will need to be a manual step for
> now until I finish getting the automatic snapshot build working again.
>
> On Mon, Jul 27, 2020 at 9:46 AM László Bodor <bo...@gmail.com>
> wrote:
>
> > Hi!
> >
> > I'm wondering what's the policy of generating tez SNAPSHOT artifacts.
> >
> > Seems like the "current" tez jar doesn't contain some changes:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> >
> > I need to see and compile against TezSpillRecord changes introduced in
> > TEZ-4145, but after extracting TezSpillRecord.class I get this for javap:
> >
> > javap TezSpillRecord.class
> > Compiled from "TezSpillRecord.java"
> > ...
> > public
> > org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(int);
> > public
> >
> >
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> > org.apache.hadoop.conf.Configuration) throws java.io.IOException;
> > public
> >
> >
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> > org.apache.hadoop.conf.Configuration, java.lang.String) throws
> > java.io.IOException;
> > public
> >
> >
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> > org.apache.hadoop.conf.Configuration, java.util.zip.Checksum,
> > java.lang.String) throws java.io.IOException;
> > ...
> > }
> >
> > I'm expecting the new constructor to be here (Path, FileSystem, String):
> >
> >
> https://github.com/apache/tez/commit/7dbec63e1f97eea95ab998e16ffcd592ff6be332#diff-358f7c423b64e350b9cae8462c24de20R60
> >
> > How could I proceed with this?
> > I would be also happy to use another repo for newer snapshots, if that
> > makes sense.
> > Currently, without setting.xml, maven downloads above jar from
> > repository.apache.org/snapshots:
> >
> > Downloading from repository-release:
> >
> >
> https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> > Downloading from apache.snapshots:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> > Downloading from central:
> >
> >
> https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> > Downloaded from apache.snapshots:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> > (1.0 kB at 3.7 kB/s)
> > Downloading from central:
> >
> >
> https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> > Downloading from repository-release:
> >
> >
> https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> > Downloading from apache.snapshots:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> > Downloaded from apache.snapshots:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> > (5.7 kB at 33 kB/s)
> > Downloading from apache.snapshots:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> > Downloaded from apache.snapshots:
> >
> >
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> > (779 kB at 2.6 MB/s)
> >
> >
> > Regards,
> > Laszlo Bodor
> >
>
Re: tez 0.10 SNAPSHOT artifacts
Posted by Jonathan Eagles <je...@gmail.com>.
I have uploaded a new set of 0.10.1 snapshots with
version 0.10.1-20200727.165306-21. This will need to be a manual step for
now until I finish getting the automatic snapshot build working again.
On Mon, Jul 27, 2020 at 9:46 AM László Bodor <bo...@gmail.com>
wrote:
> Hi!
>
> I'm wondering what's the policy of generating tez SNAPSHOT artifacts.
>
> Seems like the "current" tez jar doesn't contain some changes:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
>
> I need to see and compile against TezSpillRecord changes introduced in
> TEZ-4145, but after extracting TezSpillRecord.class I get this for javap:
>
> javap TezSpillRecord.class
> Compiled from "TezSpillRecord.java"
> ...
> public
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(int);
> public
>
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> org.apache.hadoop.conf.Configuration) throws java.io.IOException;
> public
>
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> org.apache.hadoop.conf.Configuration, java.lang.String) throws
> java.io.IOException;
> public
>
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> org.apache.hadoop.conf.Configuration, java.util.zip.Checksum,
> java.lang.String) throws java.io.IOException;
> ...
> }
>
> I'm expecting the new constructor to be here (Path, FileSystem, String):
>
> https://github.com/apache/tez/commit/7dbec63e1f97eea95ab998e16ffcd592ff6be332#diff-358f7c423b64e350b9cae8462c24de20R60
>
> How could I proceed with this?
> I would be also happy to use another repo for newer snapshots, if that
> makes sense.
> Currently, without setting.xml, maven downloads above jar from
> repository.apache.org/snapshots:
>
> Downloading from repository-release:
>
> https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> Downloading from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> Downloading from central:
>
> https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> Downloaded from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> (1.0 kB at 3.7 kB/s)
> Downloading from central:
>
> https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> Downloading from repository-release:
>
> https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> Downloading from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> Downloaded from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> (5.7 kB at 33 kB/s)
> Downloading from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> Downloaded from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> (779 kB at 2.6 MB/s)
>
>
> Regards,
> Laszlo Bodor
>
Re: tez 0.10 SNAPSHOT artifacts
Posted by Jonathan Eagles <je...@gmail.com>.
The snapshot build has stopped working apparently a long time ago. When
build machines OS was updated. The migration to yetus for snapshot builds
was forgotten. I'll see if it can be easily fixed. Otherwise, I'll push a
new snapshot artifact manually for this release branch.
https://builds.apache.org/job/Tez-Build/
On Mon, Jul 27, 2020 at 9:46 AM László Bodor <bo...@gmail.com>
wrote:
> Hi!
>
> I'm wondering what's the policy of generating tez SNAPSHOT artifacts.
>
> Seems like the "current" tez jar doesn't contain some changes:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
>
> I need to see and compile against TezSpillRecord changes introduced in
> TEZ-4145, but after extracting TezSpillRecord.class I get this for javap:
>
> javap TezSpillRecord.class
> Compiled from "TezSpillRecord.java"
> ...
> public
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(int);
> public
>
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> org.apache.hadoop.conf.Configuration) throws java.io.IOException;
> public
>
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> org.apache.hadoop.conf.Configuration, java.lang.String) throws
> java.io.IOException;
> public
>
> org.apache.tez.runtime.library.common.sort.impl.TezSpillRecord(org.apache.hadoop.fs.Path,
> org.apache.hadoop.conf.Configuration, java.util.zip.Checksum,
> java.lang.String) throws java.io.IOException;
> ...
> }
>
> I'm expecting the new constructor to be here (Path, FileSystem, String):
>
> https://github.com/apache/tez/commit/7dbec63e1f97eea95ab998e16ffcd592ff6be332#diff-358f7c423b64e350b9cae8462c24de20R60
>
> How could I proceed with this?
> I would be also happy to use another repo for newer snapshots, if that
> makes sense.
> Currently, without setting.xml, maven downloads above jar from
> repository.apache.org/snapshots:
>
> Downloading from repository-release:
>
> https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> Downloading from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> Downloading from central:
>
> https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> Downloaded from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/maven-metadata.xml
> (1.0 kB at 3.7 kB/s)
> Downloading from central:
>
> https://repo.maven.apache.org/maven2/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> Downloading from repository-release:
>
> https://repository.apache.org/content/repositories/releases/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> Downloading from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> Downloaded from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.pom
> (5.7 kB at 33 kB/s)
> Downloading from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> Downloaded from apache.snapshots:
>
> https://repository.apache.org/snapshots/org/apache/tez/tez-runtime-library/0.10.1-SNAPSHOT/tez-runtime-library-0.10.1-20190426.191641-20.jar
> (779 kB at 2.6 MB/s)
>
>
> Regards,
> Laszlo Bodor
>