You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by Andras Piros <an...@apache.org> on 2018/03/27 12:39:45 UTC
[VOTE] Release Oozie 5.0.0 (candidate 0)
Hi there,
I have created a build for Oozie 5.0.0, release candidate 0.
This release introduces major changes:
- moved launcher from MapReduce AM to YARN AM,
- switched from Tomcat to embedded Jetty,
- updated third party libraries,
- completely rewritten workflow graph generator,
- JDK 8 support,
- deprecated Instrumentation in favor of Metrics,
- added indexes to speed up DB queries,
- fixed CVE-2017-15712
Keys to verify the signature of the release artifact are available at
http://www.apache.org/dist/oozie/KEYS
Please download, test, and try it out:
http://people.apache.org/~andras/oozie-5.0.0-rc0/
The release candidate, sha512 signature, gpg signature, and rat report can
all be found
at the above address.
The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
Thanks,
Andras Piros
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Artem Ervits <ar...@gmail.com>.
created https://issues.apache.org/jira/browse/OOZIE-3210 and
https://issues.apache.org/jira/browse/OOZIE-3211 for some small issues
discovered.
On Tue, Apr 3, 2018 at 11:12 AM, Peter Bacsko <pb...@cloudera.com> wrote:
> +1 from me:
>
> - compiled & run tests with Hadoop 2.6.0
> - compiled against Hadoop 2.7.2
> - checked RAT report & hash
>
> Peter
>
> On Tue, Apr 3, 2018 at 1:32 PM, Julia Kinga Marton <km...@cloudera.com>
> wrote:
>
> > Hi,
> >
> > +1 (non-binding)
> >
> > Here is what I did:
> > - verified sha512, signiture, rat report
> > - built against hadoop 2.6.0 and tested out in a pseudo-distributed mode
> > - run some examples
> > - clicked around UI and tried some CLI commands.
> >
> > I have opened a jira (OOZIE-3209
> > <https://issues.apache.org/jira/browse/OOZIE-3209>), which is a very
> small
> > bug in the pyspark example workflow, not in the Oozie itself.
> >
> >
> > Regards,
> > Kinga
> >
> >
> > On Sat, Mar 31, 2018 at 12:01 PM, Andras Piros <
> andras.piros@cloudera.com>
> > wrote:
> >
> > > Hi there,
> > >
> > > extending the voting deadline for 5.0.0 RC0 as we didn't receive enough
> > > votes.
> > >
> > > New deadline for votes is Tuesday, April 3, 2018 at 12:00am PDT.
> > >
> > > Thanks,
> > >
> > > Andras Piros
> > >
> > > On Sat, Mar 31, 2018 at 4:11 AM, Robert Kanter <rk...@apache.org>
> > wrote:
> > >
> > > > Did you set oozie.service.HadoopAccessorService.hadoop.
> configurations
> > > and
> > > > point it at your Hadoop configs?
> > > >
> > > > On Fri, Mar 30, 2018 at 4:12 AM, Artem Ervits <artemervits@gmail.com
> >
> > > > wrote:
> > > >
> > > > > I ran into a similar issue to Oozie-3208 except I did install
> > > sharelib. I
> > > > > can see it in hdfs and yet I get /user/share/lib does not exist.
> That
> > > > > message prevented me from running successful workflows except for
> > > no-op.
> > > > >
> > > > > On Thu, Mar 29, 2018, 5:52 PM Robert Kanter <rk...@apache.org>
> > > wrote:
> > > > >
> > > > > > Here's what I did:
> > > > > > - Verified sha512
> > > > > > - Verified signature (gpg)
> > > > > > - Looked at rat report
> > > > > > - Looked at release log
> > > > > > - Built Oozie against Hadoop 2.7.2, using an empty local maven
> repo
> > > > > > - Ran a few of the examples, clicked around the UI, tried various
> > CLI
> > > > > > commands, looked at the REST output, launcher log output, etc
> > > > > >
> > > > > > +1 LGTM
> > > > > >
> > > > > > Non-blocker issues which I've filed JIRAs for
> > > > > > - OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>:
> > The
> > > > > > README.txt links to the 4.3.0 version of the quickstart page:
> > > > > > http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
> > > > > > - OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>:
> > > We're
> > > > > > using version 17 of the ASF root pom, and the latest is 19.
> > version
> > > 17
> > > > > is
> > > > > > from 2015!
> > > > > > - OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>:
> > If
> > > > the
> > > > > > sharelib isn't installed, you get a "It should never happen"
> error
> > > code
> > > > > > when submitting an action
> > > > > >
> > > > > > If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
> > > > > > nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise,
> we
> > > can
> > > > > save
> > > > > > them for Oozie 5.1.0.
> > > > > >
> > > > > >
> > > > > > thanks
> > > > > > - Robert
> > > > > >
> > > > > >
> > > > > > On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <
> > > > asasvari@cloudera.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks Andras for driving the release!
> > > > > > >
> > > > > > > +1
> > > > > > >
> > > > > > > Here is what I did:
> > > > > > > - Verified signature, hash
> > > > > > > - Created Oozie 5.0.0 distro using hadoop-2.6
> > > > > > > - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> > > > > > > yarn-cluster, yarn-client mode), custom-main-wf,
> > > > > datelist-java-main-wf,
> > > > > > > demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf,
> > > > > no-op-wf,
> > > > > > > pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf,
> > > streaming-wf,
> > > > > > > subwf-wf - all the workflows have succeeded
> > > > > > > - Verified Web UI: version, getting logs and Job DAG
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <
> > > artemervits@gmail.com
> > > > >
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > additionally, I've ran the mvn verify and after some time it
> > > failed
> > > > > due
> > > > > > > to
> > > > > > > > timeout, still OK in my opinion.
> > > > > > > >
> > > > > > > > INFO] Results:
> > > > > > > > [INFO]
> > > > > > > > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > > > > > > > [INFO]
> > > > > > > > [INFO]
> > > > > > > >
> > > > > > ------------------------------------------------------------
> > > > ------------
> > > > > > > > [INFO] Reactor Summary:
> > > > > > > > [INFO]
> > > > > > > > [INFO] Apache Oozie Main 5.0.0 ............................
> > > > SUCCESS [
> > > > > > > > 3.859 s]
> > > > > > > > [INFO] Apache Oozie Client ................................
> > > > SUCCESS
> > > > > [
> > > > > > > > 34.826 s]
> > > > > > > > [INFO] Apache Oozie Share Lib Oozie .......................
> > > > SUCCESS [
> > > > > > > > 25.740 s]
> > > > > > > > [INFO] Apache Oozie Share Lib HCatalog ....................
> > > > SUCCESS [
> > > > > > > > 11.842 s]
> > > > > > > > [INFO] Apache Oozie Share Lib Distcp ......................
> > > > SUCCESS [
> > > > > > > > 7.465 s]
> > > > > > > > [INFO] Apache Oozie Core ..................................
> > > > FAILURE
> > > > > [
> > > > > > > > 01:30 h]
> > > > > > > > [INFO] Apache Oozie Share Lib Streaming ...................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Share Lib Pig .........................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Share Lib Hive ........................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Share Lib Hive 2 ......................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Share Lib Sqoop .......................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Examples ..............................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Share Lib Spark .......................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Share Lib .............................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Docs ..................................
> > > > SKIPPED
> > > > > > > > [INFO] Apache Oozie WebApp ................................
> > > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Tools .................................
> > > > SKIPPED
> > > > > > > > [INFO] Apache Oozie MiniOozie .............................
> > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Server ................................
> > > > SKIPPED
> > > > > > > > [INFO] Apache Oozie Distro ................................
> > > > SKIPPED
> > > > > > > > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........
> > > SKIPPED
> > > > > > > > [INFO]
> > > > > > > >
> > > > > > ------------------------------------------------------------
> > > > ------------
> > > > > > > > [INFO] BUILD FAILURE
> > > > > > > > [INFO]
> > > > > > > >
> > > > > > ------------------------------------------------------------
> > > > ------------
> > > > > > > > [INFO] Total time: 01:32 h
> > > > > > > > [INFO] Finished at: 2018-03-28T14:21:30Z
> > > > > > > > [INFO]
> > > > > > > >
> > > > > > ------------------------------------------------------------
> > > > ------------
> > > > > > > > [ERROR] Failed to execute goal
> > > > > > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > > > > > (default-test)
> > > > > > > > on project oozie-core: There was a timeout or other error in
> > the
> > > > fork
> > > > > > ->
> > > > > > > > [Help 1]
> > > > > > > > [ERROR]
> > > > > > > > [ERROR] To see the full stack trace of the errors, re-run
> Maven
> > > > with
> > > > > > the
> > > > > > > -e
> > > > > > > > switch.
> > > > > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> > > > > logging.
> > > > > > > > [ERROR]
> > > > > > > > [ERROR] For more information about the errors and possible
> > > > solutions,
> > > > > > > > please read the following articles:
> > > > > > > > [ERROR] [Help 1]
> > > > > > > > http://cwiki.apache.org/confluence/display/MAVEN/
> > > > > MojoFailureException
> > > > > > > > [ERROR]
> > > > > > > > [ERROR] After correcting the problems, you can resume the
> build
> > > > with
> > > > > > the
> > > > > > > > command
> > > > > > > > [ERROR] mvn <goals> -rf :oozie-core
> > > > > > > >
> > > > > > > > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <
> > > > artemervits@gmail.com
> > > > > >
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > +1 non-binding
> > > > > > > > >
> > > > > > > > > signatures and checksum: OK
> > > > > > > > > build with Hadoop 2.7.5: OK
> > > > > > > > > install on a single-node pseudo-distributed cluster: OK
> > > > > > > > > ran no-op workflow: OK
> > > > > > > > >
> > > > > > > > > the directions to install sharelib on 5.0 are unclear and
> I'm
> > > not
> > > > > > able
> > > > > > > to
> > > > > > > > > execute other workflows due to share lib problems. (not a
> > > blocker
> > > > > in
> > > > > > my
> > > > > > > > > opinion).
> > > > > > > > >
> > > > > > > > > Thank you
> > > > > > > > >
> > > > > > > > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <
> > > andras@apache.org
> > > > >
> > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >> Hi there,
> > > > > > > > >>
> > > > > > > > >> I have created a build for Oozie 5.0.0, release candidate
> 0.
> > > > > > > > >>
> > > > > > > > >> This release introduces major changes:
> > > > > > > > >> - moved launcher from MapReduce AM to YARN AM,
> > > > > > > > >> - switched from Tomcat to embedded Jetty,
> > > > > > > > >> - updated third party libraries,
> > > > > > > > >> - completely rewritten workflow graph generator,
> > > > > > > > >> - JDK 8 support,
> > > > > > > > >> - deprecated Instrumentation in favor of Metrics,
> > > > > > > > >> - added indexes to speed up DB queries,
> > > > > > > > >> - fixed CVE-2017-15712
> > > > > > > > >>
> > > > > > > > >> Keys to verify the signature of the release artifact are
> > > > available
> > > > > > at
> > > > > > > > >>
> > > > > > > > >> http://www.apache.org/dist/oozie/KEYS
> > > > > > > > >>
> > > > > > > > >> Please download, test, and try it out:
> > > > > > > > >>
> > > > > > > > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > > > > > > > >>
> > > > > > > > >> The release candidate, sha512 signature, gpg signature,
> and
> > > rat
> > > > > > report
> > > > > > > can
> > > > > > > > >> all be found
> > > > > > > > >> at the above address.
> > > > > > > > >>
> > > > > > > > >> The vote is open until Saturday, March 31, 2018 at 12:00am
> > > PDT.
> > > > > > > > >>
> > > > > > > > >> Thanks,
> > > > > > > > >>
> > > > > > > > >> Andras Piros
> > > > > > > > >>
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > --
> > > > > > > Attila Sasvari
> > > > > > > Software Engineer
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Peter Bacsko <pb...@cloudera.com>.
+1 from me:
- compiled & run tests with Hadoop 2.6.0
- compiled against Hadoop 2.7.2
- checked RAT report & hash
Peter
On Tue, Apr 3, 2018 at 1:32 PM, Julia Kinga Marton <km...@cloudera.com>
wrote:
> Hi,
>
> +1 (non-binding)
>
> Here is what I did:
> - verified sha512, signiture, rat report
> - built against hadoop 2.6.0 and tested out in a pseudo-distributed mode
> - run some examples
> - clicked around UI and tried some CLI commands.
>
> I have opened a jira (OOZIE-3209
> <https://issues.apache.org/jira/browse/OOZIE-3209>), which is a very small
> bug in the pyspark example workflow, not in the Oozie itself.
>
>
> Regards,
> Kinga
>
>
> On Sat, Mar 31, 2018 at 12:01 PM, Andras Piros <an...@cloudera.com>
> wrote:
>
> > Hi there,
> >
> > extending the voting deadline for 5.0.0 RC0 as we didn't receive enough
> > votes.
> >
> > New deadline for votes is Tuesday, April 3, 2018 at 12:00am PDT.
> >
> > Thanks,
> >
> > Andras Piros
> >
> > On Sat, Mar 31, 2018 at 4:11 AM, Robert Kanter <rk...@apache.org>
> wrote:
> >
> > > Did you set oozie.service.HadoopAccessorService.hadoop.configurations
> > and
> > > point it at your Hadoop configs?
> > >
> > > On Fri, Mar 30, 2018 at 4:12 AM, Artem Ervits <ar...@gmail.com>
> > > wrote:
> > >
> > > > I ran into a similar issue to Oozie-3208 except I did install
> > sharelib. I
> > > > can see it in hdfs and yet I get /user/share/lib does not exist. That
> > > > message prevented me from running successful workflows except for
> > no-op.
> > > >
> > > > On Thu, Mar 29, 2018, 5:52 PM Robert Kanter <rk...@apache.org>
> > wrote:
> > > >
> > > > > Here's what I did:
> > > > > - Verified sha512
> > > > > - Verified signature (gpg)
> > > > > - Looked at rat report
> > > > > - Looked at release log
> > > > > - Built Oozie against Hadoop 2.7.2, using an empty local maven repo
> > > > > - Ran a few of the examples, clicked around the UI, tried various
> CLI
> > > > > commands, looked at the REST output, launcher log output, etc
> > > > >
> > > > > +1 LGTM
> > > > >
> > > > > Non-blocker issues which I've filed JIRAs for
> > > > > - OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>:
> The
> > > > > README.txt links to the 4.3.0 version of the quickstart page:
> > > > > http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
> > > > > - OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>:
> > We're
> > > > > using version 17 of the ASF root pom, and the latest is 19.
> version
> > 17
> > > > is
> > > > > from 2015!
> > > > > - OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>:
> If
> > > the
> > > > > sharelib isn't installed, you get a "It should never happen" error
> > code
> > > > > when submitting an action
> > > > >
> > > > > If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
> > > > > nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise, we
> > can
> > > > save
> > > > > them for Oozie 5.1.0.
> > > > >
> > > > >
> > > > > thanks
> > > > > - Robert
> > > > >
> > > > >
> > > > > On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <
> > > asasvari@cloudera.com>
> > > > > wrote:
> > > > >
> > > > > > Thanks Andras for driving the release!
> > > > > >
> > > > > > +1
> > > > > >
> > > > > > Here is what I did:
> > > > > > - Verified signature, hash
> > > > > > - Created Oozie 5.0.0 distro using hadoop-2.6
> > > > > > - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> > > > > > yarn-cluster, yarn-client mode), custom-main-wf,
> > > > datelist-java-main-wf,
> > > > > > demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf,
> > > > no-op-wf,
> > > > > > pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf,
> > streaming-wf,
> > > > > > subwf-wf - all the workflows have succeeded
> > > > > > - Verified Web UI: version, getting logs and Job DAG
> > > > > >
> > > > > >
> > > > > > On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <
> > artemervits@gmail.com
> > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > additionally, I've ran the mvn verify and after some time it
> > failed
> > > > due
> > > > > > to
> > > > > > > timeout, still OK in my opinion.
> > > > > > >
> > > > > > > INFO] Results:
> > > > > > > [INFO]
> > > > > > > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > > > > > > [INFO]
> > > > > > > [INFO]
> > > > > > >
> > > > > ------------------------------------------------------------
> > > ------------
> > > > > > > [INFO] Reactor Summary:
> > > > > > > [INFO]
> > > > > > > [INFO] Apache Oozie Main 5.0.0 ............................
> > > SUCCESS [
> > > > > > > 3.859 s]
> > > > > > > [INFO] Apache Oozie Client ................................
> > > SUCCESS
> > > > [
> > > > > > > 34.826 s]
> > > > > > > [INFO] Apache Oozie Share Lib Oozie .......................
> > > SUCCESS [
> > > > > > > 25.740 s]
> > > > > > > [INFO] Apache Oozie Share Lib HCatalog ....................
> > > SUCCESS [
> > > > > > > 11.842 s]
> > > > > > > [INFO] Apache Oozie Share Lib Distcp ......................
> > > SUCCESS [
> > > > > > > 7.465 s]
> > > > > > > [INFO] Apache Oozie Core ..................................
> > > FAILURE
> > > > [
> > > > > > > 01:30 h]
> > > > > > > [INFO] Apache Oozie Share Lib Streaming ...................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Share Lib Pig .........................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Share Lib Hive ........................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Share Lib Hive 2 ......................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Share Lib Sqoop .......................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Examples ..............................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Share Lib Spark .......................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Share Lib .............................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Docs ..................................
> > > SKIPPED
> > > > > > > [INFO] Apache Oozie WebApp ................................
> > > SKIPPED
> > > > > > > [INFO] Apache Oozie Tools .................................
> > > SKIPPED
> > > > > > > [INFO] Apache Oozie MiniOozie .............................
> > SKIPPED
> > > > > > > [INFO] Apache Oozie Server ................................
> > > SKIPPED
> > > > > > > [INFO] Apache Oozie Distro ................................
> > > SKIPPED
> > > > > > > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........
> > SKIPPED
> > > > > > > [INFO]
> > > > > > >
> > > > > ------------------------------------------------------------
> > > ------------
> > > > > > > [INFO] BUILD FAILURE
> > > > > > > [INFO]
> > > > > > >
> > > > > ------------------------------------------------------------
> > > ------------
> > > > > > > [INFO] Total time: 01:32 h
> > > > > > > [INFO] Finished at: 2018-03-28T14:21:30Z
> > > > > > > [INFO]
> > > > > > >
> > > > > ------------------------------------------------------------
> > > ------------
> > > > > > > [ERROR] Failed to execute goal
> > > > > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > > > > (default-test)
> > > > > > > on project oozie-core: There was a timeout or other error in
> the
> > > fork
> > > > > ->
> > > > > > > [Help 1]
> > > > > > > [ERROR]
> > > > > > > [ERROR] To see the full stack trace of the errors, re-run Maven
> > > with
> > > > > the
> > > > > > -e
> > > > > > > switch.
> > > > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> > > > logging.
> > > > > > > [ERROR]
> > > > > > > [ERROR] For more information about the errors and possible
> > > solutions,
> > > > > > > please read the following articles:
> > > > > > > [ERROR] [Help 1]
> > > > > > > http://cwiki.apache.org/confluence/display/MAVEN/
> > > > MojoFailureException
> > > > > > > [ERROR]
> > > > > > > [ERROR] After correcting the problems, you can resume the build
> > > with
> > > > > the
> > > > > > > command
> > > > > > > [ERROR] mvn <goals> -rf :oozie-core
> > > > > > >
> > > > > > > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <
> > > artemervits@gmail.com
> > > > >
> > > > > > wrote:
> > > > > > >
> > > > > > > > +1 non-binding
> > > > > > > >
> > > > > > > > signatures and checksum: OK
> > > > > > > > build with Hadoop 2.7.5: OK
> > > > > > > > install on a single-node pseudo-distributed cluster: OK
> > > > > > > > ran no-op workflow: OK
> > > > > > > >
> > > > > > > > the directions to install sharelib on 5.0 are unclear and I'm
> > not
> > > > > able
> > > > > > to
> > > > > > > > execute other workflows due to share lib problems. (not a
> > blocker
> > > > in
> > > > > my
> > > > > > > > opinion).
> > > > > > > >
> > > > > > > > Thank you
> > > > > > > >
> > > > > > > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <
> > andras@apache.org
> > > >
> > > > > > wrote:
> > > > > > > >
> > > > > > > >> Hi there,
> > > > > > > >>
> > > > > > > >> I have created a build for Oozie 5.0.0, release candidate 0.
> > > > > > > >>
> > > > > > > >> This release introduces major changes:
> > > > > > > >> - moved launcher from MapReduce AM to YARN AM,
> > > > > > > >> - switched from Tomcat to embedded Jetty,
> > > > > > > >> - updated third party libraries,
> > > > > > > >> - completely rewritten workflow graph generator,
> > > > > > > >> - JDK 8 support,
> > > > > > > >> - deprecated Instrumentation in favor of Metrics,
> > > > > > > >> - added indexes to speed up DB queries,
> > > > > > > >> - fixed CVE-2017-15712
> > > > > > > >>
> > > > > > > >> Keys to verify the signature of the release artifact are
> > > available
> > > > > at
> > > > > > > >>
> > > > > > > >> http://www.apache.org/dist/oozie/KEYS
> > > > > > > >>
> > > > > > > >> Please download, test, and try it out:
> > > > > > > >>
> > > > > > > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > > > > > > >>
> > > > > > > >> The release candidate, sha512 signature, gpg signature, and
> > rat
> > > > > report
> > > > > > can
> > > > > > > >> all be found
> > > > > > > >> at the above address.
> > > > > > > >>
> > > > > > > >> The vote is open until Saturday, March 31, 2018 at 12:00am
> > PDT.
> > > > > > > >>
> > > > > > > >> Thanks,
> > > > > > > >>
> > > > > > > >> Andras Piros
> > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > --
> > > > > > Attila Sasvari
> > > > > > Software Engineer
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Julia Kinga Marton <km...@cloudera.com>.
Hi,
+1 (non-binding)
Here is what I did:
- verified sha512, signiture, rat report
- built against hadoop 2.6.0 and tested out in a pseudo-distributed mode
- run some examples
- clicked around UI and tried some CLI commands.
I have opened a jira (OOZIE-3209
<https://issues.apache.org/jira/browse/OOZIE-3209>), which is a very small
bug in the pyspark example workflow, not in the Oozie itself.
Regards,
Kinga
On Sat, Mar 31, 2018 at 12:01 PM, Andras Piros <an...@cloudera.com>
wrote:
> Hi there,
>
> extending the voting deadline for 5.0.0 RC0 as we didn't receive enough
> votes.
>
> New deadline for votes is Tuesday, April 3, 2018 at 12:00am PDT.
>
> Thanks,
>
> Andras Piros
>
> On Sat, Mar 31, 2018 at 4:11 AM, Robert Kanter <rk...@apache.org> wrote:
>
> > Did you set oozie.service.HadoopAccessorService.hadoop.configurations
> and
> > point it at your Hadoop configs?
> >
> > On Fri, Mar 30, 2018 at 4:12 AM, Artem Ervits <ar...@gmail.com>
> > wrote:
> >
> > > I ran into a similar issue to Oozie-3208 except I did install
> sharelib. I
> > > can see it in hdfs and yet I get /user/share/lib does not exist. That
> > > message prevented me from running successful workflows except for
> no-op.
> > >
> > > On Thu, Mar 29, 2018, 5:52 PM Robert Kanter <rk...@apache.org>
> wrote:
> > >
> > > > Here's what I did:
> > > > - Verified sha512
> > > > - Verified signature (gpg)
> > > > - Looked at rat report
> > > > - Looked at release log
> > > > - Built Oozie against Hadoop 2.7.2, using an empty local maven repo
> > > > - Ran a few of the examples, clicked around the UI, tried various CLI
> > > > commands, looked at the REST output, launcher log output, etc
> > > >
> > > > +1 LGTM
> > > >
> > > > Non-blocker issues which I've filed JIRAs for
> > > > - OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>: The
> > > > README.txt links to the 4.3.0 version of the quickstart page:
> > > > http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
> > > > - OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>:
> We're
> > > > using version 17 of the ASF root pom, and the latest is 19. version
> 17
> > > is
> > > > from 2015!
> > > > - OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>: If
> > the
> > > > sharelib isn't installed, you get a "It should never happen" error
> code
> > > > when submitting an action
> > > >
> > > > If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
> > > > nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise, we
> can
> > > save
> > > > them for Oozie 5.1.0.
> > > >
> > > >
> > > > thanks
> > > > - Robert
> > > >
> > > >
> > > > On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <
> > asasvari@cloudera.com>
> > > > wrote:
> > > >
> > > > > Thanks Andras for driving the release!
> > > > >
> > > > > +1
> > > > >
> > > > > Here is what I did:
> > > > > - Verified signature, hash
> > > > > - Created Oozie 5.0.0 distro using hadoop-2.6
> > > > > - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> > > > > yarn-cluster, yarn-client mode), custom-main-wf,
> > > datelist-java-main-wf,
> > > > > demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf,
> > > no-op-wf,
> > > > > pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf,
> streaming-wf,
> > > > > subwf-wf - all the workflows have succeeded
> > > > > - Verified Web UI: version, getting logs and Job DAG
> > > > >
> > > > >
> > > > > On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <
> artemervits@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > additionally, I've ran the mvn verify and after some time it
> failed
> > > due
> > > > > to
> > > > > > timeout, still OK in my opinion.
> > > > > >
> > > > > > INFO] Results:
> > > > > > [INFO]
> > > > > > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > > > > > [INFO]
> > > > > > [INFO]
> > > > > >
> > > > ------------------------------------------------------------
> > ------------
> > > > > > [INFO] Reactor Summary:
> > > > > > [INFO]
> > > > > > [INFO] Apache Oozie Main 5.0.0 ............................
> > SUCCESS [
> > > > > > 3.859 s]
> > > > > > [INFO] Apache Oozie Client ................................
> > SUCCESS
> > > [
> > > > > > 34.826 s]
> > > > > > [INFO] Apache Oozie Share Lib Oozie .......................
> > SUCCESS [
> > > > > > 25.740 s]
> > > > > > [INFO] Apache Oozie Share Lib HCatalog ....................
> > SUCCESS [
> > > > > > 11.842 s]
> > > > > > [INFO] Apache Oozie Share Lib Distcp ......................
> > SUCCESS [
> > > > > > 7.465 s]
> > > > > > [INFO] Apache Oozie Core ..................................
> > FAILURE
> > > [
> > > > > > 01:30 h]
> > > > > > [INFO] Apache Oozie Share Lib Streaming ...................
> SKIPPED
> > > > > > [INFO] Apache Oozie Share Lib Pig .........................
> SKIPPED
> > > > > > [INFO] Apache Oozie Share Lib Hive ........................
> SKIPPED
> > > > > > [INFO] Apache Oozie Share Lib Hive 2 ......................
> SKIPPED
> > > > > > [INFO] Apache Oozie Share Lib Sqoop .......................
> SKIPPED
> > > > > > [INFO] Apache Oozie Examples ..............................
> SKIPPED
> > > > > > [INFO] Apache Oozie Share Lib Spark .......................
> SKIPPED
> > > > > > [INFO] Apache Oozie Share Lib .............................
> SKIPPED
> > > > > > [INFO] Apache Oozie Docs ..................................
> > SKIPPED
> > > > > > [INFO] Apache Oozie WebApp ................................
> > SKIPPED
> > > > > > [INFO] Apache Oozie Tools .................................
> > SKIPPED
> > > > > > [INFO] Apache Oozie MiniOozie .............................
> SKIPPED
> > > > > > [INFO] Apache Oozie Server ................................
> > SKIPPED
> > > > > > [INFO] Apache Oozie Distro ................................
> > SKIPPED
> > > > > > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........
> SKIPPED
> > > > > > [INFO]
> > > > > >
> > > > ------------------------------------------------------------
> > ------------
> > > > > > [INFO] BUILD FAILURE
> > > > > > [INFO]
> > > > > >
> > > > ------------------------------------------------------------
> > ------------
> > > > > > [INFO] Total time: 01:32 h
> > > > > > [INFO] Finished at: 2018-03-28T14:21:30Z
> > > > > > [INFO]
> > > > > >
> > > > ------------------------------------------------------------
> > ------------
> > > > > > [ERROR] Failed to execute goal
> > > > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > > > (default-test)
> > > > > > on project oozie-core: There was a timeout or other error in the
> > fork
> > > > ->
> > > > > > [Help 1]
> > > > > > [ERROR]
> > > > > > [ERROR] To see the full stack trace of the errors, re-run Maven
> > with
> > > > the
> > > > > -e
> > > > > > switch.
> > > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> > > logging.
> > > > > > [ERROR]
> > > > > > [ERROR] For more information about the errors and possible
> > solutions,
> > > > > > please read the following articles:
> > > > > > [ERROR] [Help 1]
> > > > > > http://cwiki.apache.org/confluence/display/MAVEN/
> > > MojoFailureException
> > > > > > [ERROR]
> > > > > > [ERROR] After correcting the problems, you can resume the build
> > with
> > > > the
> > > > > > command
> > > > > > [ERROR] mvn <goals> -rf :oozie-core
> > > > > >
> > > > > > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <
> > artemervits@gmail.com
> > > >
> > > > > wrote:
> > > > > >
> > > > > > > +1 non-binding
> > > > > > >
> > > > > > > signatures and checksum: OK
> > > > > > > build with Hadoop 2.7.5: OK
> > > > > > > install on a single-node pseudo-distributed cluster: OK
> > > > > > > ran no-op workflow: OK
> > > > > > >
> > > > > > > the directions to install sharelib on 5.0 are unclear and I'm
> not
> > > > able
> > > > > to
> > > > > > > execute other workflows due to share lib problems. (not a
> blocker
> > > in
> > > > my
> > > > > > > opinion).
> > > > > > >
> > > > > > > Thank you
> > > > > > >
> > > > > > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <
> andras@apache.org
> > >
> > > > > wrote:
> > > > > > >
> > > > > > >> Hi there,
> > > > > > >>
> > > > > > >> I have created a build for Oozie 5.0.0, release candidate 0.
> > > > > > >>
> > > > > > >> This release introduces major changes:
> > > > > > >> - moved launcher from MapReduce AM to YARN AM,
> > > > > > >> - switched from Tomcat to embedded Jetty,
> > > > > > >> - updated third party libraries,
> > > > > > >> - completely rewritten workflow graph generator,
> > > > > > >> - JDK 8 support,
> > > > > > >> - deprecated Instrumentation in favor of Metrics,
> > > > > > >> - added indexes to speed up DB queries,
> > > > > > >> - fixed CVE-2017-15712
> > > > > > >>
> > > > > > >> Keys to verify the signature of the release artifact are
> > available
> > > > at
> > > > > > >>
> > > > > > >> http://www.apache.org/dist/oozie/KEYS
> > > > > > >>
> > > > > > >> Please download, test, and try it out:
> > > > > > >>
> > > > > > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > > > > > >>
> > > > > > >> The release candidate, sha512 signature, gpg signature, and
> rat
> > > > report
> > > > > can
> > > > > > >> all be found
> > > > > > >> at the above address.
> > > > > > >>
> > > > > > >> The vote is open until Saturday, March 31, 2018 at 12:00am
> PDT.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >>
> > > > > > >> Andras Piros
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > --
> > > > > Attila Sasvari
> > > > > Software Engineer
> > > > >
> > > >
> > >
> >
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Andras Piros <an...@cloudera.com>.
Hi there,
extending the voting deadline for 5.0.0 RC0 as we didn't receive enough
votes.
New deadline for votes is Tuesday, April 3, 2018 at 12:00am PDT.
Thanks,
Andras Piros
On Sat, Mar 31, 2018 at 4:11 AM, Robert Kanter <rk...@apache.org> wrote:
> Did you set oozie.service.HadoopAccessorService.hadoop.configurations and
> point it at your Hadoop configs?
>
> On Fri, Mar 30, 2018 at 4:12 AM, Artem Ervits <ar...@gmail.com>
> wrote:
>
> > I ran into a similar issue to Oozie-3208 except I did install sharelib. I
> > can see it in hdfs and yet I get /user/share/lib does not exist. That
> > message prevented me from running successful workflows except for no-op.
> >
> > On Thu, Mar 29, 2018, 5:52 PM Robert Kanter <rk...@apache.org> wrote:
> >
> > > Here's what I did:
> > > - Verified sha512
> > > - Verified signature (gpg)
> > > - Looked at rat report
> > > - Looked at release log
> > > - Built Oozie against Hadoop 2.7.2, using an empty local maven repo
> > > - Ran a few of the examples, clicked around the UI, tried various CLI
> > > commands, looked at the REST output, launcher log output, etc
> > >
> > > +1 LGTM
> > >
> > > Non-blocker issues which I've filed JIRAs for
> > > - OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>: The
> > > README.txt links to the 4.3.0 version of the quickstart page:
> > > http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
> > > - OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>: We're
> > > using version 17 of the ASF root pom, and the latest is 19. version 17
> > is
> > > from 2015!
> > > - OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>: If
> the
> > > sharelib isn't installed, you get a "It should never happen" error code
> > > when submitting an action
> > >
> > > If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
> > > nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise, we can
> > save
> > > them for Oozie 5.1.0.
> > >
> > >
> > > thanks
> > > - Robert
> > >
> > >
> > > On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <
> asasvari@cloudera.com>
> > > wrote:
> > >
> > > > Thanks Andras for driving the release!
> > > >
> > > > +1
> > > >
> > > > Here is what I did:
> > > > - Verified signature, hash
> > > > - Created Oozie 5.0.0 distro using hadoop-2.6
> > > > - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> > > > yarn-cluster, yarn-client mode), custom-main-wf,
> > datelist-java-main-wf,
> > > > demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf,
> > no-op-wf,
> > > > pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf, streaming-wf,
> > > > subwf-wf - all the workflows have succeeded
> > > > - Verified Web UI: version, getting logs and Job DAG
> > > >
> > > >
> > > > On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <artemervits@gmail.com
> >
> > > > wrote:
> > > > >
> > > > > additionally, I've ran the mvn verify and after some time it failed
> > due
> > > > to
> > > > > timeout, still OK in my opinion.
> > > > >
> > > > > INFO] Results:
> > > > > [INFO]
> > > > > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > > > > [INFO]
> > > > > [INFO]
> > > > >
> > > ------------------------------------------------------------
> ------------
> > > > > [INFO] Reactor Summary:
> > > > > [INFO]
> > > > > [INFO] Apache Oozie Main 5.0.0 ............................
> SUCCESS [
> > > > > 3.859 s]
> > > > > [INFO] Apache Oozie Client ................................
> SUCCESS
> > [
> > > > > 34.826 s]
> > > > > [INFO] Apache Oozie Share Lib Oozie .......................
> SUCCESS [
> > > > > 25.740 s]
> > > > > [INFO] Apache Oozie Share Lib HCatalog ....................
> SUCCESS [
> > > > > 11.842 s]
> > > > > [INFO] Apache Oozie Share Lib Distcp ......................
> SUCCESS [
> > > > > 7.465 s]
> > > > > [INFO] Apache Oozie Core ..................................
> FAILURE
> > [
> > > > > 01:30 h]
> > > > > [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
> > > > > [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
> > > > > [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
> > > > > [INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
> > > > > [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
> > > > > [INFO] Apache Oozie Examples .............................. SKIPPED
> > > > > [INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
> > > > > [INFO] Apache Oozie Share Lib ............................. SKIPPED
> > > > > [INFO] Apache Oozie Docs ..................................
> SKIPPED
> > > > > [INFO] Apache Oozie WebApp ................................
> SKIPPED
> > > > > [INFO] Apache Oozie Tools .................................
> SKIPPED
> > > > > [INFO] Apache Oozie MiniOozie ............................. SKIPPED
> > > > > [INFO] Apache Oozie Server ................................
> SKIPPED
> > > > > [INFO] Apache Oozie Distro ................................
> SKIPPED
> > > > > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
> > > > > [INFO]
> > > > >
> > > ------------------------------------------------------------
> ------------
> > > > > [INFO] BUILD FAILURE
> > > > > [INFO]
> > > > >
> > > ------------------------------------------------------------
> ------------
> > > > > [INFO] Total time: 01:32 h
> > > > > [INFO] Finished at: 2018-03-28T14:21:30Z
> > > > > [INFO]
> > > > >
> > > ------------------------------------------------------------
> ------------
> > > > > [ERROR] Failed to execute goal
> > > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > > (default-test)
> > > > > on project oozie-core: There was a timeout or other error in the
> fork
> > > ->
> > > > > [Help 1]
> > > > > [ERROR]
> > > > > [ERROR] To see the full stack trace of the errors, re-run Maven
> with
> > > the
> > > > -e
> > > > > switch.
> > > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> > logging.
> > > > > [ERROR]
> > > > > [ERROR] For more information about the errors and possible
> solutions,
> > > > > please read the following articles:
> > > > > [ERROR] [Help 1]
> > > > > http://cwiki.apache.org/confluence/display/MAVEN/
> > MojoFailureException
> > > > > [ERROR]
> > > > > [ERROR] After correcting the problems, you can resume the build
> with
> > > the
> > > > > command
> > > > > [ERROR] mvn <goals> -rf :oozie-core
> > > > >
> > > > > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <
> artemervits@gmail.com
> > >
> > > > wrote:
> > > > >
> > > > > > +1 non-binding
> > > > > >
> > > > > > signatures and checksum: OK
> > > > > > build with Hadoop 2.7.5: OK
> > > > > > install on a single-node pseudo-distributed cluster: OK
> > > > > > ran no-op workflow: OK
> > > > > >
> > > > > > the directions to install sharelib on 5.0 are unclear and I'm not
> > > able
> > > > to
> > > > > > execute other workflows due to share lib problems. (not a blocker
> > in
> > > my
> > > > > > opinion).
> > > > > >
> > > > > > Thank you
> > > > > >
> > > > > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <andras@apache.org
> >
> > > > wrote:
> > > > > >
> > > > > >> Hi there,
> > > > > >>
> > > > > >> I have created a build for Oozie 5.0.0, release candidate 0.
> > > > > >>
> > > > > >> This release introduces major changes:
> > > > > >> - moved launcher from MapReduce AM to YARN AM,
> > > > > >> - switched from Tomcat to embedded Jetty,
> > > > > >> - updated third party libraries,
> > > > > >> - completely rewritten workflow graph generator,
> > > > > >> - JDK 8 support,
> > > > > >> - deprecated Instrumentation in favor of Metrics,
> > > > > >> - added indexes to speed up DB queries,
> > > > > >> - fixed CVE-2017-15712
> > > > > >>
> > > > > >> Keys to verify the signature of the release artifact are
> available
> > > at
> > > > > >>
> > > > > >> http://www.apache.org/dist/oozie/KEYS
> > > > > >>
> > > > > >> Please download, test, and try it out:
> > > > > >>
> > > > > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > > > > >>
> > > > > >> The release candidate, sha512 signature, gpg signature, and rat
> > > report
> > > > can
> > > > > >> all be found
> > > > > >> at the above address.
> > > > > >>
> > > > > >> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
> > > > > >>
> > > > > >> Thanks,
> > > > > >>
> > > > > >> Andras Piros
> > > > > >>
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> > > > --
> > > > --
> > > > Attila Sasvari
> > > > Software Engineer
> > > >
> > >
> >
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Robert Kanter <rk...@apache.org>.
Did you set oozie.service.HadoopAccessorService.hadoop.configurations and
point it at your Hadoop configs?
On Fri, Mar 30, 2018 at 4:12 AM, Artem Ervits <ar...@gmail.com> wrote:
> I ran into a similar issue to Oozie-3208 except I did install sharelib. I
> can see it in hdfs and yet I get /user/share/lib does not exist. That
> message prevented me from running successful workflows except for no-op.
>
> On Thu, Mar 29, 2018, 5:52 PM Robert Kanter <rk...@apache.org> wrote:
>
> > Here's what I did:
> > - Verified sha512
> > - Verified signature (gpg)
> > - Looked at rat report
> > - Looked at release log
> > - Built Oozie against Hadoop 2.7.2, using an empty local maven repo
> > - Ran a few of the examples, clicked around the UI, tried various CLI
> > commands, looked at the REST output, launcher log output, etc
> >
> > +1 LGTM
> >
> > Non-blocker issues which I've filed JIRAs for
> > - OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>: The
> > README.txt links to the 4.3.0 version of the quickstart page:
> > http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
> > - OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>: We're
> > using version 17 of the ASF root pom, and the latest is 19. version 17
> is
> > from 2015!
> > - OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>: If the
> > sharelib isn't installed, you get a "It should never happen" error code
> > when submitting an action
> >
> > If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
> > nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise, we can
> save
> > them for Oozie 5.1.0.
> >
> >
> > thanks
> > - Robert
> >
> >
> > On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <as...@cloudera.com>
> > wrote:
> >
> > > Thanks Andras for driving the release!
> > >
> > > +1
> > >
> > > Here is what I did:
> > > - Verified signature, hash
> > > - Created Oozie 5.0.0 distro using hadoop-2.6
> > > - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> > > yarn-cluster, yarn-client mode), custom-main-wf,
> datelist-java-main-wf,
> > > demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf,
> no-op-wf,
> > > pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf, streaming-wf,
> > > subwf-wf - all the workflows have succeeded
> > > - Verified Web UI: version, getting logs and Job DAG
> > >
> > >
> > > On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <ar...@gmail.com>
> > > wrote:
> > > >
> > > > additionally, I've ran the mvn verify and after some time it failed
> due
> > > to
> > > > timeout, still OK in my opinion.
> > > >
> > > > INFO] Results:
> > > > [INFO]
> > > > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > > > [INFO]
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] Reactor Summary:
> > > > [INFO]
> > > > [INFO] Apache Oozie Main 5.0.0 ............................ SUCCESS [
> > > > 3.859 s]
> > > > [INFO] Apache Oozie Client ................................ SUCCESS
> [
> > > > 34.826 s]
> > > > [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> > > > 25.740 s]
> > > > [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> > > > 11.842 s]
> > > > [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> > > > 7.465 s]
> > > > [INFO] Apache Oozie Core .................................. FAILURE
> [
> > > > 01:30 h]
> > > > [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
> > > > [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
> > > > [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
> > > > [INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
> > > > [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
> > > > [INFO] Apache Oozie Examples .............................. SKIPPED
> > > > [INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
> > > > [INFO] Apache Oozie Share Lib ............................. SKIPPED
> > > > [INFO] Apache Oozie Docs .................................. SKIPPED
> > > > [INFO] Apache Oozie WebApp ................................ SKIPPED
> > > > [INFO] Apache Oozie Tools ................................. SKIPPED
> > > > [INFO] Apache Oozie MiniOozie ............................. SKIPPED
> > > > [INFO] Apache Oozie Server ................................ SKIPPED
> > > > [INFO] Apache Oozie Distro ................................ SKIPPED
> > > > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] BUILD FAILURE
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] Total time: 01:32 h
> > > > [INFO] Finished at: 2018-03-28T14:21:30Z
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [ERROR] Failed to execute goal
> > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > (default-test)
> > > > on project oozie-core: There was a timeout or other error in the fork
> > ->
> > > > [Help 1]
> > > > [ERROR]
> > > > [ERROR] To see the full stack trace of the errors, re-run Maven with
> > the
> > > -e
> > > > switch.
> > > > [ERROR] Re-run Maven using the -X switch to enable full debug
> logging.
> > > > [ERROR]
> > > > [ERROR] For more information about the errors and possible solutions,
> > > > please read the following articles:
> > > > [ERROR] [Help 1]
> > > > http://cwiki.apache.org/confluence/display/MAVEN/
> MojoFailureException
> > > > [ERROR]
> > > > [ERROR] After correcting the problems, you can resume the build with
> > the
> > > > command
> > > > [ERROR] mvn <goals> -rf :oozie-core
> > > >
> > > > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <artemervits@gmail.com
> >
> > > wrote:
> > > >
> > > > > +1 non-binding
> > > > >
> > > > > signatures and checksum: OK
> > > > > build with Hadoop 2.7.5: OK
> > > > > install on a single-node pseudo-distributed cluster: OK
> > > > > ran no-op workflow: OK
> > > > >
> > > > > the directions to install sharelib on 5.0 are unclear and I'm not
> > able
> > > to
> > > > > execute other workflows due to share lib problems. (not a blocker
> in
> > my
> > > > > opinion).
> > > > >
> > > > > Thank you
> > > > >
> > > > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <an...@apache.org>
> > > wrote:
> > > > >
> > > > >> Hi there,
> > > > >>
> > > > >> I have created a build for Oozie 5.0.0, release candidate 0.
> > > > >>
> > > > >> This release introduces major changes:
> > > > >> - moved launcher from MapReduce AM to YARN AM,
> > > > >> - switched from Tomcat to embedded Jetty,
> > > > >> - updated third party libraries,
> > > > >> - completely rewritten workflow graph generator,
> > > > >> - JDK 8 support,
> > > > >> - deprecated Instrumentation in favor of Metrics,
> > > > >> - added indexes to speed up DB queries,
> > > > >> - fixed CVE-2017-15712
> > > > >>
> > > > >> Keys to verify the signature of the release artifact are available
> > at
> > > > >>
> > > > >> http://www.apache.org/dist/oozie/KEYS
> > > > >>
> > > > >> Please download, test, and try it out:
> > > > >>
> > > > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > > > >>
> > > > >> The release candidate, sha512 signature, gpg signature, and rat
> > report
> > > can
> > > > >> all be found
> > > > >> at the above address.
> > > > >>
> > > > >> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
> > > > >>
> > > > >> Thanks,
> > > > >>
> > > > >> Andras Piros
> > > > >>
> > > > >
> > > > >
> > >
> > >
> > >
> > >
> > > --
> > > --
> > > Attila Sasvari
> > > Software Engineer
> > >
> >
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Artem Ervits <ar...@gmail.com>.
I ran into a similar issue to Oozie-3208 except I did install sharelib. I
can see it in hdfs and yet I get /user/share/lib does not exist. That
message prevented me from running successful workflows except for no-op.
On Thu, Mar 29, 2018, 5:52 PM Robert Kanter <rk...@apache.org> wrote:
> Here's what I did:
> - Verified sha512
> - Verified signature (gpg)
> - Looked at rat report
> - Looked at release log
> - Built Oozie against Hadoop 2.7.2, using an empty local maven repo
> - Ran a few of the examples, clicked around the UI, tried various CLI
> commands, looked at the REST output, launcher log output, etc
>
> +1 LGTM
>
> Non-blocker issues which I've filed JIRAs for
> - OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>: The
> README.txt links to the 4.3.0 version of the quickstart page:
> http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
> - OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>: We're
> using version 17 of the ASF root pom, and the latest is 19. version 17 is
> from 2015!
> - OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>: If the
> sharelib isn't installed, you get a "It should never happen" error code
> when submitting an action
>
> If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
> nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise, we can save
> them for Oozie 5.1.0.
>
>
> thanks
> - Robert
>
>
> On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <as...@cloudera.com>
> wrote:
>
> > Thanks Andras for driving the release!
> >
> > +1
> >
> > Here is what I did:
> > - Verified signature, hash
> > - Created Oozie 5.0.0 distro using hadoop-2.6
> > - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> > yarn-cluster, yarn-client mode), custom-main-wf, datelist-java-main-wf,
> > demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf, no-op-wf,
> > pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf, streaming-wf,
> > subwf-wf - all the workflows have succeeded
> > - Verified Web UI: version, getting logs and Job DAG
> >
> >
> > On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <ar...@gmail.com>
> > wrote:
> > >
> > > additionally, I've ran the mvn verify and after some time it failed due
> > to
> > > timeout, still OK in my opinion.
> > >
> > > INFO] Results:
> > > [INFO]
> > > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > > [INFO]
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [INFO] Reactor Summary:
> > > [INFO]
> > > [INFO] Apache Oozie Main 5.0.0 ............................ SUCCESS [
> > > 3.859 s]
> > > [INFO] Apache Oozie Client ................................ SUCCESS [
> > > 34.826 s]
> > > [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> > > 25.740 s]
> > > [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> > > 11.842 s]
> > > [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> > > 7.465 s]
> > > [INFO] Apache Oozie Core .................................. FAILURE [
> > > 01:30 h]
> > > [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
> > > [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
> > > [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
> > > [INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
> > > [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
> > > [INFO] Apache Oozie Examples .............................. SKIPPED
> > > [INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
> > > [INFO] Apache Oozie Share Lib ............................. SKIPPED
> > > [INFO] Apache Oozie Docs .................................. SKIPPED
> > > [INFO] Apache Oozie WebApp ................................ SKIPPED
> > > [INFO] Apache Oozie Tools ................................. SKIPPED
> > > [INFO] Apache Oozie MiniOozie ............................. SKIPPED
> > > [INFO] Apache Oozie Server ................................ SKIPPED
> > > [INFO] Apache Oozie Distro ................................ SKIPPED
> > > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [INFO] BUILD FAILURE
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [INFO] Total time: 01:32 h
> > > [INFO] Finished at: 2018-03-28T14:21:30Z
> > > [INFO]
> > >
> ------------------------------------------------------------------------
> > > [ERROR] Failed to execute goal
> > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > (default-test)
> > > on project oozie-core: There was a timeout or other error in the fork
> ->
> > > [Help 1]
> > > [ERROR]
> > > [ERROR] To see the full stack trace of the errors, re-run Maven with
> the
> > -e
> > > switch.
> > > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > > [ERROR]
> > > [ERROR] For more information about the errors and possible solutions,
> > > please read the following articles:
> > > [ERROR] [Help 1]
> > > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> > > [ERROR]
> > > [ERROR] After correcting the problems, you can resume the build with
> the
> > > command
> > > [ERROR] mvn <goals> -rf :oozie-core
> > >
> > > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <ar...@gmail.com>
> > wrote:
> > >
> > > > +1 non-binding
> > > >
> > > > signatures and checksum: OK
> > > > build with Hadoop 2.7.5: OK
> > > > install on a single-node pseudo-distributed cluster: OK
> > > > ran no-op workflow: OK
> > > >
> > > > the directions to install sharelib on 5.0 are unclear and I'm not
> able
> > to
> > > > execute other workflows due to share lib problems. (not a blocker in
> my
> > > > opinion).
> > > >
> > > > Thank you
> > > >
> > > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <an...@apache.org>
> > wrote:
> > > >
> > > >> Hi there,
> > > >>
> > > >> I have created a build for Oozie 5.0.0, release candidate 0.
> > > >>
> > > >> This release introduces major changes:
> > > >> - moved launcher from MapReduce AM to YARN AM,
> > > >> - switched from Tomcat to embedded Jetty,
> > > >> - updated third party libraries,
> > > >> - completely rewritten workflow graph generator,
> > > >> - JDK 8 support,
> > > >> - deprecated Instrumentation in favor of Metrics,
> > > >> - added indexes to speed up DB queries,
> > > >> - fixed CVE-2017-15712
> > > >>
> > > >> Keys to verify the signature of the release artifact are available
> at
> > > >>
> > > >> http://www.apache.org/dist/oozie/KEYS
> > > >>
> > > >> Please download, test, and try it out:
> > > >>
> > > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > > >>
> > > >> The release candidate, sha512 signature, gpg signature, and rat
> report
> > can
> > > >> all be found
> > > >> at the above address.
> > > >>
> > > >> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
> > > >>
> > > >> Thanks,
> > > >>
> > > >> Andras Piros
> > > >>
> > > >
> > > >
> >
> >
> >
> >
> > --
> > --
> > Attila Sasvari
> > Software Engineer
> >
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Robert Kanter <rk...@apache.org>.
Here's what I did:
- Verified sha512
- Verified signature (gpg)
- Looked at rat report
- Looked at release log
- Built Oozie against Hadoop 2.7.2, using an empty local maven repo
- Ran a few of the examples, clicked around the UI, tried various CLI
commands, looked at the REST output, launcher log output, etc
+1 LGTM
Non-blocker issues which I've filed JIRAs for
- OOZIE-3206 <https://issues.apache.org/jira/browse/OOZIE-3206>: The
README.txt links to the 4.3.0 version of the quickstart page:
http://oozie.apache.org/docs/4.3.0/DG_QuickStart.html
- OOZIE-3207 <https://issues.apache.org/jira/browse/OOZIE-3207>: We're
using version 17 of the ASF root pom, and the latest is 19. version 17 is
from 2015!
- OOZIE-3208 <https://issues.apache.org/jira/browse/OOZIE-3208>: If the
sharelib isn't installed, you get a "It should never happen" error code
when submitting an action
If a blocking issue is found, OOZIE-3206 and OOZIE-3208 would be
nice-to-have's in an RC1 (OOZIE-3207 is too risky). Otherwise, we can save
them for Oozie 5.1.0.
thanks
- Robert
On Thu, Mar 29, 2018 at 11:00 AM, Attila Sasvari <as...@cloudera.com>
wrote:
> Thanks Andras for driving the release!
>
> +1
>
> Here is what I did:
> - Verified signature, hash
> - Created Oozie 5.0.0 distro using hadoop-2.6
> - On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
> yarn-cluster, yarn-client mode), custom-main-wf, datelist-java-main-wf,
> demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf, no-op-wf,
> pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf, streaming-wf,
> subwf-wf - all the workflows have succeeded
> - Verified Web UI: version, getting logs and Job DAG
>
>
> On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <ar...@gmail.com>
> wrote:
> >
> > additionally, I've ran the mvn verify and after some time it failed due
> to
> > timeout, still OK in my opinion.
> >
> > INFO] Results:
> > [INFO]
> > [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> > [INFO]
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Apache Oozie Main 5.0.0 ............................ SUCCESS [
> > 3.859 s]
> > [INFO] Apache Oozie Client ................................ SUCCESS [
> > 34.826 s]
> > [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> > 25.740 s]
> > [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> > 11.842 s]
> > [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> > 7.465 s]
> > [INFO] Apache Oozie Core .................................. FAILURE [
> > 01:30 h]
> > [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
> > [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
> > [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
> > [INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
> > [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
> > [INFO] Apache Oozie Examples .............................. SKIPPED
> > [INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
> > [INFO] Apache Oozie Share Lib ............................. SKIPPED
> > [INFO] Apache Oozie Docs .................................. SKIPPED
> > [INFO] Apache Oozie WebApp ................................ SKIPPED
> > [INFO] Apache Oozie Tools ................................. SKIPPED
> > [INFO] Apache Oozie MiniOozie ............................. SKIPPED
> > [INFO] Apache Oozie Server ................................ SKIPPED
> > [INFO] Apache Oozie Distro ................................ SKIPPED
> > [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] BUILD FAILURE
> > [INFO]
> > ------------------------------------------------------------------------
> > [INFO] Total time: 01:32 h
> > [INFO] Finished at: 2018-03-28T14:21:30Z
> > [INFO]
> > ------------------------------------------------------------------------
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> (default-test)
> > on project oozie-core: There was a timeout or other error in the fork ->
> > [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR] mvn <goals> -rf :oozie-core
> >
> > On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <ar...@gmail.com>
> wrote:
> >
> > > +1 non-binding
> > >
> > > signatures and checksum: OK
> > > build with Hadoop 2.7.5: OK
> > > install on a single-node pseudo-distributed cluster: OK
> > > ran no-op workflow: OK
> > >
> > > the directions to install sharelib on 5.0 are unclear and I'm not able
> to
> > > execute other workflows due to share lib problems. (not a blocker in my
> > > opinion).
> > >
> > > Thank you
> > >
> > > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <an...@apache.org>
> wrote:
> > >
> > >> Hi there,
> > >>
> > >> I have created a build for Oozie 5.0.0, release candidate 0.
> > >>
> > >> This release introduces major changes:
> > >> - moved launcher from MapReduce AM to YARN AM,
> > >> - switched from Tomcat to embedded Jetty,
> > >> - updated third party libraries,
> > >> - completely rewritten workflow graph generator,
> > >> - JDK 8 support,
> > >> - deprecated Instrumentation in favor of Metrics,
> > >> - added indexes to speed up DB queries,
> > >> - fixed CVE-2017-15712
> > >>
> > >> Keys to verify the signature of the release artifact are available at
> > >>
> > >> http://www.apache.org/dist/oozie/KEYS
> > >>
> > >> Please download, test, and try it out:
> > >>
> > >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> > >>
> > >> The release candidate, sha512 signature, gpg signature, and rat report
> can
> > >> all be found
> > >> at the above address.
> > >>
> > >> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
> > >>
> > >> Thanks,
> > >>
> > >> Andras Piros
> > >>
> > >
> > >
>
>
>
>
> --
> --
> Attila Sasvari
> Software Engineer
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Attila Sasvari <as...@cloudera.com>.
Thanks Andras for driving the release!
+1
Here is what I did:
- Verified signature, hash
- Created Oozie 5.0.0 distro using hadoop-2.6
- On a pseudo Hadoop 2.6.0, I executed SparkFileCopy (both in
yarn-cluster, yarn-client mode), custom-main-wf, datelist-java-main-wf,
demo-wf, distcp-wf, hadoop-el-wf, java-main-wf, map-reduce-wf, no-op-wf,
pig-wf, shell-wf, sqoop-freeform-wf, sqoop-wf, ssh-wf, streaming-wf,
subwf-wf - all the workflows have succeeded
- Verified Web UI: version, getting logs and Job DAG
On Wed, Mar 28, 2018 at 4:30 PM, Artem Ervits <ar...@gmail.com> wrote:
>
> additionally, I've ran the mvn verify and after some time it failed due to
> timeout, still OK in my opinion.
>
> INFO] Results:
> [INFO]
> [INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Oozie Main 5.0.0 ............................ SUCCESS [
> 3.859 s]
> [INFO] Apache Oozie Client ................................ SUCCESS [
> 34.826 s]
> [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
> 25.740 s]
> [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
> 11.842 s]
> [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
> 7.465 s]
> [INFO] Apache Oozie Core .................................. FAILURE [
> 01:30 h]
> [INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
> [INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
> [INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
> [INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
> [INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
> [INFO] Apache Oozie Examples .............................. SKIPPED
> [INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
> [INFO] Apache Oozie Share Lib ............................. SKIPPED
> [INFO] Apache Oozie Docs .................................. SKIPPED
> [INFO] Apache Oozie WebApp ................................ SKIPPED
> [INFO] Apache Oozie Tools ................................. SKIPPED
> [INFO] Apache Oozie MiniOozie ............................. SKIPPED
> [INFO] Apache Oozie Server ................................ SKIPPED
> [INFO] Apache Oozie Distro ................................ SKIPPED
> [INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 01:32 h
> [INFO] Finished at: 2018-03-28T14:21:30Z
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test (default-test)
> on project oozie-core: There was a timeout or other error in the fork ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
-e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :oozie-core
>
> On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <ar...@gmail.com>
wrote:
>
> > +1 non-binding
> >
> > signatures and checksum: OK
> > build with Hadoop 2.7.5: OK
> > install on a single-node pseudo-distributed cluster: OK
> > ran no-op workflow: OK
> >
> > the directions to install sharelib on 5.0 are unclear and I'm not able
to
> > execute other workflows due to share lib problems. (not a blocker in my
> > opinion).
> >
> > Thank you
> >
> > On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <an...@apache.org> wrote:
> >
> >> Hi there,
> >>
> >> I have created a build for Oozie 5.0.0, release candidate 0.
> >>
> >> This release introduces major changes:
> >> - moved launcher from MapReduce AM to YARN AM,
> >> - switched from Tomcat to embedded Jetty,
> >> - updated third party libraries,
> >> - completely rewritten workflow graph generator,
> >> - JDK 8 support,
> >> - deprecated Instrumentation in favor of Metrics,
> >> - added indexes to speed up DB queries,
> >> - fixed CVE-2017-15712
> >>
> >> Keys to verify the signature of the release artifact are available at
> >>
> >> http://www.apache.org/dist/oozie/KEYS
> >>
> >> Please download, test, and try it out:
> >>
> >> http://people.apache.org/~andras/oozie-5.0.0-rc0/
> >>
> >> The release candidate, sha512 signature, gpg signature, and rat report
can
> >> all be found
> >> at the above address.
> >>
> >> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
> >>
> >> Thanks,
> >>
> >> Andras Piros
> >>
> >
> >
--
--
Attila Sasvari
Software Engineer
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Artem Ervits <ar...@gmail.com>.
additionally, I've ran the mvn verify and after some time it failed due to
timeout, still OK in my opinion.
INFO] Results:
[INFO]
[INFO] Tests run: 738, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main 5.0.0 ............................ SUCCESS [
3.859 s]
[INFO] Apache Oozie Client ................................ SUCCESS [
34.826 s]
[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [
25.740 s]
[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [
11.842 s]
[INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [
7.465 s]
[INFO] Apache Oozie Core .................................. FAILURE [
01:30 h]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Server ................................ SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests 5.0.0 ........ SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 01:32 h
[INFO] Finished at: 2018-03-28T14:21:30Z
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test (default-test)
on project oozie-core: There was a timeout or other error in the fork ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
On Wed, Mar 28, 2018 at 8:50 AM, Artem Ervits <ar...@gmail.com> wrote:
> +1 non-binding
>
> signatures and checksum: OK
> build with Hadoop 2.7.5: OK
> install on a single-node pseudo-distributed cluster: OK
> ran no-op workflow: OK
>
> the directions to install sharelib on 5.0 are unclear and I'm not able to
> execute other workflows due to share lib problems. (not a blocker in my
> opinion).
>
> Thank you
>
> On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <an...@apache.org> wrote:
>
>> Hi there,
>>
>> I have created a build for Oozie 5.0.0, release candidate 0.
>>
>> This release introduces major changes:
>> - moved launcher from MapReduce AM to YARN AM,
>> - switched from Tomcat to embedded Jetty,
>> - updated third party libraries,
>> - completely rewritten workflow graph generator,
>> - JDK 8 support,
>> - deprecated Instrumentation in favor of Metrics,
>> - added indexes to speed up DB queries,
>> - fixed CVE-2017-15712
>>
>> Keys to verify the signature of the release artifact are available at
>>
>> http://www.apache.org/dist/oozie/KEYS
>>
>> Please download, test, and try it out:
>>
>> http://people.apache.org/~andras/oozie-5.0.0-rc0/
>>
>> The release candidate, sha512 signature, gpg signature, and rat report can
>> all be found
>> at the above address.
>>
>> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
>>
>> Thanks,
>>
>> Andras Piros
>>
>
>
Re: [VOTE] Release Oozie 5.0.0 (candidate 0)
Posted by Artem Ervits <ar...@gmail.com>.
+1 non-binding
signatures and checksum: OK
build with Hadoop 2.7.5: OK
install on a single-node pseudo-distributed cluster: OK
ran no-op workflow: OK
the directions to install sharelib on 5.0 are unclear and I'm not able to
execute other workflows due to share lib problems. (not a blocker in my
opinion).
Thank you
On Tue, Mar 27, 2018 at 8:39 AM, Andras Piros <an...@apache.org> wrote:
> Hi there,
>
> I have created a build for Oozie 5.0.0, release candidate 0.
>
> This release introduces major changes:
> - moved launcher from MapReduce AM to YARN AM,
> - switched from Tomcat to embedded Jetty,
> - updated third party libraries,
> - completely rewritten workflow graph generator,
> - JDK 8 support,
> - deprecated Instrumentation in favor of Metrics,
> - added indexes to speed up DB queries,
> - fixed CVE-2017-15712
>
> Keys to verify the signature of the release artifact are available at
>
> http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
> http://people.apache.org/~andras/oozie-5.0.0-rc0/
>
> The release candidate, sha512 signature, gpg signature, and rat report can
> all be found
> at the above address.
>
> The vote is open until Saturday, March 31, 2018 at 12:00am PDT.
>
> Thanks,
>
> Andras Piros
>