You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by Sumit Mohanty <sm...@hortonworks.com> on 2014/07/09 02:53:58 UTC
Preparing for 0.40 release
In preparation for the 0.40 release, I have finished some preliminary tests
using the Slider app packages and in general it looks good. There are some
document changes that remain followed by a full build and test.
Let me know if we are ready for the release or there are some JIRAs that
you want in 0.40 release.
-Sumit
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Preparing for 0.40 release
Posted by Steve Loughran <st...@hortonworks.com>.
I've got nothing I want to get into this release
On 9 July 2014 04:21, Sumit Mohanty <sm...@hortonworks.com> wrote:
> We are not on a hard deadline for 0.40. We can certainly wait till EOD
> tomorrow and then decide.
>
> -Sumit
>
>
> On Tue, Jul 8, 2014 at 6:02 PM, Jon Maron <jm...@hortonworks.com> wrote:
>
> >
> > On Jul 8, 2014, at 8:53 PM, Sumit Mohanty <sm...@hortonworks.com>
> > wrote:
> >
> > > In preparation for the 0.40 release, I have finished some preliminary
> > tests
> > > using the Slider app packages and in general it looks good. There are
> > some
> > > document changes that remain followed by a full build and test.
> > >
> > > Let me know if we are ready for the release or there are some JIRAs
> that
> > > you want in 0.40 release.
> >
> > As of earlier today I resolved my unit test issues and added some
> security
> > unit tests for the SSL enablement. I plan on pulling the latest to
> ensure
> > all unit tests pass and should be able to merge tomorrow. Not sure where
> > that puts me relative to the 0.40 release. My functional tests on my
> > vagrant cluster as well as the tests I’ve run locally indicate successful
> > launch of storm clusters.
> >
> > >
> > > -Sumit
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Preparing for 0.40 release
Posted by Sumit Mohanty <sm...@hortonworks.com>.
We are not on a hard deadline for 0.40. We can certainly wait till EOD
tomorrow and then decide.
-Sumit
On Tue, Jul 8, 2014 at 6:02 PM, Jon Maron <jm...@hortonworks.com> wrote:
>
> On Jul 8, 2014, at 8:53 PM, Sumit Mohanty <sm...@hortonworks.com>
> wrote:
>
> > In preparation for the 0.40 release, I have finished some preliminary
> tests
> > using the Slider app packages and in general it looks good. There are
> some
> > document changes that remain followed by a full build and test.
> >
> > Let me know if we are ready for the release or there are some JIRAs that
> > you want in 0.40 release.
>
> As of earlier today I resolved my unit test issues and added some security
> unit tests for the SSL enablement. I plan on pulling the latest to ensure
> all unit tests pass and should be able to merge tomorrow. Not sure where
> that puts me relative to the 0.40 release. My functional tests on my
> vagrant cluster as well as the tests I’ve run locally indicate successful
> launch of storm clusters.
>
> >
> > -Sumit
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Preparing for 0.40 release
Posted by Jon Maron <jm...@hortonworks.com>.
On Jul 8, 2014, at 8:53 PM, Sumit Mohanty <sm...@hortonworks.com> wrote:
> In preparation for the 0.40 release, I have finished some preliminary tests
> using the Slider app packages and in general it looks good. There are some
> document changes that remain followed by a full build and test.
>
> Let me know if we are ready for the release or there are some JIRAs that
> you want in 0.40 release.
As of earlier today I resolved my unit test issues and added some security unit tests for the SSL enablement. I plan on pulling the latest to ensure all unit tests pass and should be able to merge tomorrow. Not sure where that puts me relative to the 0.40 release. My functional tests on my vagrant cluster as well as the tests I’ve run locally indicate successful launch of storm clusters.
>
> -Sumit
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Preparing for 0.40 release
Posted by Steve Loughran <st...@hortonworks.com>.
we now have an RPM -initially for testing rather than anything else.
1. Building it is covered in building.md: TL;DR: run mvn -Prpm on a Linux
system with "rpm" installed. That can be linux as well as RHAT, you just
need to test the installation on a redhat VM, or a CentOS image like the
HDP sandbox.
2. Example install and test
# rpm -Uvh slider-0.31.0-incubating_SNAPSHOT20140709153353.noarch.rpm
Preparing... ###########################################
[100%]
1:slider ###########################################
[100%]
# ls -l /usr/lib/slider
total 16
drwxr-xr-x 3 root root 4096 Jul 9 19:57 agent
drwxr-xr-x 2 mapred hadoop 4096 Jul 9 19:57 bin
drwxr-xr-x 2 mapred hadoop 4096 Jul 9 19:57 conf
drw-r--r-- 2 mapred hadoop 4096 Jul 9 19:57 lib
# ls -l /usr/lib/slider/bin
total 12
-rwxr-xr-x 1 mapred hadoop 2345 Jul 9 2014 slider
-rwxr-xr-x 1 mapred hadoop 5096 Jul 9 2014 slider.py
# /usr/lib/slider/bin/slider version
slider_home = "/usr/lib/slider"
slider_jvm_opts = "-Djava.net.preferIPv4Stack=true
-Djava.awt.headless=true
-Xmx256m -Djava.confdir=/usr/lib/slider/conf"
classpath = "/usr/lib/slider/lib/*:/usr/lib/slider/conf:"
command is java -Djava.net.preferIPv4Stack=true
-Djava.awt.headless=true -Xmx256m
-Djava.confdir=/usr/lib/slider/conf --classpath
"/usr/lib/slider/lib/*:/usr/lib/slider/conf:" org.apache.slider.Slider
version
2014-05-16 19:34:34,730 [main] INFO client.RMProxy - Connecting to
ResourceManager at /0.0.0.0:8032
2014-05-16 19:34:35,300 [main] INFO client.SliderClient - Slider
Core-0.31.0-incubating-SNAPSHOT
Built against commit# d44d4c1bf0
2014-05-16 19:34:35,304 [main] INFO client.SliderClient - Compiled
against Hadoop 2.4.0
2014-05-16 19:34:35,310 [main] INFO client.SliderClient - Hadoop
runtime version branch-2.4.0
with source checksum 375b2832a6641759c6eaf6e3e998147 and build date
2014-03-31T08:31Z
2014-05-16 19:34:35,314 [main] INFO util.ExitUtil - Exiting with
status 0
This output shows that slider is not configured yet: the Resource manager
Address of `/0.0.0.0:8032` is invalid.
Uninstallation can also be tested
# rpm -e slider
# /usr/lib/slider/bin/slider version
-bash: /usr/lib/slider/bin/slider: No such file or directory
3. Configurations go into /usr/lib/slider/conf to be manually edited
I'm not trying to do anything clever with environment variables, path
patching, hooking up to existing hadoop installations etc. This is just
the tarball installed into a fixed location and marked as belonging to user
"mapred"
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Preparing for 0.40 release
Posted by Steve Loughran <st...@hortonworks.com>.
Oh, I'm doing a quick RPM today, SLIDER-221. If I'm happy with it, it'd be
nice to add too, just flagging it as unstable and updateability not
guaranteed.
For this to be included people will probably need to do releases on a Linux
machine with rpm tools installed. I think unbuntu boxes can generate RPMs
this way, even if they can't actually install them
On 9 July 2014 01:53, Sumit Mohanty <sm...@hortonworks.com> wrote:
> In preparation for the 0.40 release, I have finished some preliminary tests
> using the Slider app packages and in general it looks good. There are some
> document changes that remain followed by a full build and test.
>
> Let me know if we are ready for the release or there are some JIRAs that
> you want in 0.40 release.
>
> -Sumit
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.