You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by Roman Shaposhnik <rv...@apache.org> on 2012/03/11 04:10:26 UTC
[VOTE] Release for Bigtop version 0.3.0-incubating
This is the third incubator release for Apache Bigtop, version
0.3.0-incubating.
*** Please download, test, and vote by Friday, March 16
Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
Source tarball, checksums, signature:
http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
The tag to be voted on:
https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
Please also make sure to try installing our convenience binary distribution
artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
Fedora 16, SLES 11. The easies way to install Bigtop distribution on
your favorite Linux OS is to pick one of the attached files, and place
it (as root)
in the following folder:
* Ubuntu -- /etc/apt/sources.list.d/
* CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
* SLES 11 -- /etc/zypp/repos.d/
After that you can follow the installation instructions from over here (DO NOT
FORGET TO SKIP STEPS #1 and #2):
https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
Bigtop's KEYS file, containing the PGP keys used to sign the release:
http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
Thanks!
Bigtop 0.3.0 release manager,
Roman Shaposhnik
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Peter Linnell` <pl...@cloudera.com>.
On 03/11/2012 04:02 PM, Roman Shaposhnik wrote:
> On Sun, Mar 11, 2012 at 2:49 PM, Bruno Mahé<bm...@apache.org> wrote:
>> I don't see any attached file
>
> I can clearly see attachments in my Sent folder. I suppose this means that
> Apache strips them somehow. Or may be they strip the ones they don't
> recognize. This time I'm attaching all of them inside of a tarball. Lets
> see if it gets through.
>
> Thanks,
> Roman.
This time they came through :)
Thanks,
Peter
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
On Sun, Mar 11, 2012 at 2:49 PM, Bruno Mahé <bm...@apache.org> wrote:
> I don't see any attached file
I can clearly see attachments in my Sent folder. I suppose this means that
Apache strips them somehow. Or may be they strip the ones they don't
recognize. This time I'm attaching all of them inside of a tarball. Lets
see if it gets through.
Thanks,
Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Bruno Mahé <bm...@apache.org>.
On 03/10/2012 07:10 PM, Roman Shaposhnik wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
I don't see any attached file
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
On Mon, Mar 12, 2012 at 2:11 PM, Bruno Mahé <bm...@apache.org> wrote:
> I have started testing this release yesterday by doing a full deployment
> / tests.
Perfect start! I'll be doing some testing in the kerberized environment
in a few days.
> But I found at least an issue I would consider a blocker for
> this RC: see BIGTOP-446.
Let me mark it.
> 2/ zookeeper wasn't started. Once I manually started the service
> (without any issue), everything got unblocked. Probably worth opening a
> ticket.
Sounds good.
> 5/ I noticed quite a few crashes on the tasktracker/regionservers. Their
> stack traces are from being helpful. But this is an upstream issue (or
> me/puppet doing something stupid).
> 6/ Because of 5/, it would be nice to have some supervisor processes
+many. I filed this one some time ago, but still haven't had time to
work on it: https://issues.apache.org/jira/browse/BIGTOP-263
> 7/ It would also be very helpful to have some
> munin/collectd/ganglia/nagios integration
Agreed.
> 8/ It would be nice to be able to configure HBASE heap
You mean via puppet?
> Overall I really enjoyed it!
> The combination of puppet recipes and packages made it really easy to go
> from nothing to a 20 machine hadoop cluster.
Great to hear! I've been doing some experimenting with a couple
of node, but 20 is quite something.
Thanks,
Roman.
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
On Mon, Mar 12, 2012 at 2:11 PM, Bruno Mahé <bm...@apache.org> wrote:
> I have started testing this release yesterday by doing a full deployment
> / tests.
Perfect start! I'll be doing some testing in the kerberized environment
in a few days.
> But I found at least an issue I would consider a blocker for
> this RC: see BIGTOP-446.
Let me mark it.
> 2/ zookeeper wasn't started. Once I manually started the service
> (without any issue), everything got unblocked. Probably worth opening a
> ticket.
Sounds good.
> 5/ I noticed quite a few crashes on the tasktracker/regionservers. Their
> stack traces are from being helpful. But this is an upstream issue (or
> me/puppet doing something stupid).
> 6/ Because of 5/, it would be nice to have some supervisor processes
+many. I filed this one some time ago, but still haven't had time to
work on it: https://issues.apache.org/jira/browse/BIGTOP-263
> 7/ It would also be very helpful to have some
> munin/collectd/ganglia/nagios integration
Agreed.
> 8/ It would be nice to be able to configure HBASE heap
You mean via puppet?
> Overall I really enjoyed it!
> The combination of puppet recipes and packages made it really easy to go
> from nothing to a 20 machine hadoop cluster.
Great to hear! I've been doing some experimenting with a couple
of node, but 20 is quite something.
Thanks,
Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Bruno Mahé <bm...@apache.org>.
On 03/10/2012 07:10 PM, Roman Shaposhnik wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
I have started testing this release yesterday by doing a full deployment
/ tests. But I found at least an issue I would consider a blocker for
this RC: see BIGTOP-446.
I provisioned 20 CentOS 6 machines (8 core, 23GB RAM each), used our
puppet recipes to deploy this RC and tried to run some of my code on it
(importing a dump of freebase in my triplestore and query it)
Here are some notes:
1/ typo in puppet recipes. BIGTOP-446
2/ zookeeper wasn't started. Once I manually started the service
(without any issue), everything got unblocked. Probably worth opening a
ticket.
3/ hbase-master couldn't start because it could not connect to zookeeper
because of 2/
4/ Somehow, the jobtracker and hdfs directories got set up only after
the zookeeper issue got resolved (because of 2/)
5/ I noticed quite a few crashes on the tasktracker/regionservers. Their
stack traces are from being helpful. But this is an upstream issue (or
me/puppet doing something stupid).
6/ Because of 5/, it would be nice to have some supervisor processes
7/ It would also be very helpful to have some
munin/collectd/ganglia/nagios integration
8/ It would be nice to be able to configure HBASE heap
9/ I would rather configure hadoop heap as a percentage of available
ram, instead of an absolute value
Overall I really enjoyed it!
The combination of puppet recipes and packages made it really easy to go
from nothing to a 20 machine hadoop cluster.
Thanks,
Bruno
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Wing Yew Poon <wy...@cloudera.com>.
Roman,
I believe you mean https://issues.apache.org/jira/browse/BIGTOP-459.
- Wing Yew
On Mon, Mar 19, 2012 at 1:14 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> Hi Patrick!
>
> On Sat, Mar 17, 2012 at 8:45 AM, Patrick Hunt <ph...@apache.org> wrote:
>> The copyright issues I mentioned are serious. Have you addressed them?
>
> Here's a JIRA to track this: https://issues.apache.org/jira/browse/HDFS-2368
>
> I'm going to post a patch that updates all the packaging files (that includes
> copyright files) but I'm going to leave test data the way it is. Please let me
> know if this could be a problem.
>
> Thanks,
> Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Konstantin Boudnik <co...@apache.org>.
+1
Looks fine after basic checks and validations!
Cos
On Tue, Mar 20, 2012 at 08:44AM, Roman Shaposhnik wrote:
> Done. Here's what ended up in the RC1 build:
> http://bigtop01.cloudera.org:8080/view/Releases/job/Bigtop-0.3-RC/2/
>
> I will cut an RC1 once the build is done and tested. Scream now if you
> really want some other favorite fix of yours to end up in a release.
>
> Thanks,
> Roman.
>
> On Tue, Mar 20, 2012 at 2:20 AM, James Page <ja...@ubuntu.com> wrote:
> > -----BEGIN PGP SIGNED MESSAGE-----
> > Hash: SHA256
> >
> > Hi Roman
> >
> > On 20/03/12 00:00, Roman Shaposhnik wrote:
> >> Here's an update on the Bigtop 0.3.0 release: * We've triaged all
> >> the 0.3 issues:
> >> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+BIGTOP+AND+resolution+%3D+Unresolved+AND+fixVersion+%3D+%220.3.0%22+ORDER+BY+priority+DESC&mode=hide
> >>
> >>
> > * We've gotten quite a bit of feedback from the community. All the
> >> issues reported have been addressed and fixes now exist in trunk. I
> >> propose that we pull patches for the following issues into the
> >> branch-0.3 and cut RC1 ASAP: BIGTOP-446. Typo in hadoop module for
> >> puppet BIGTOP-459. remove references to cloudera from the packaging
> >> files BIGTOP-443. deb/oozie/oozie-client.postinst installs an
> >> alternative for a path that isn't there BIGTOP-382.
> >> hadoop-conf-pseudo packages contains subversion metada
> >>
> >> Please let me know noon tomorrow if the above list is
> >> wrong/incomplete for RC1
> >
> > I'd quite like to see https://issues.apache.org/jira/browse/BIGTOP-457
> > in 0.3.0 - I've proposed a patch but not landed it in trunk as yet.
> >
> > This should bring the permissions in /var/lib/hadoop/cache for the deb
> > package inline with those for the rpm package and resolve the issue
> > Vijay had identified when trying to format the namenode on 10.04.
> >
> > Cheers
> >
> > James
> >
> > - --
> > James Page
> > Ubuntu Core Developer
> > -----BEGIN PGP SIGNATURE-----
> > Version: GnuPG v1.4.11 (GNU/Linux)
> > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
> >
> > iQIcBAEBCAAGBQJPaEvnAAoJEL/srsug59jDngUP/2M0oOUhbMnnbW1I+WKapUnZ
> > s36ZzMefDrZ3d3M0KiLAccS9mZFx8EH+3PjRk1a7LIwTAyYdZtb0/JYKBfURMFtN
> > GyJ1QMk9HT8XJDo+ZoOiknqUgrD1BB167GmyxdPieTQ+NBvpzhmmZ0iS3pxbNeeC
> > LmkhbFzuEGbwxVvC1dG64mLPzajkr+M+3XYKyIWO8Zxpigo1J06JRKnMlJ7BIRkE
> > fGBmTLDi49oh71L2d14coDbTg7GFLec/ImXEimRnU6jVYVGrlnOmZPatEv80GgyQ
> > nd99pA/pvj3BX9Eq/EgYYHjY/2+yK9qN9A7ugSMqs0UfY+GY4Wb3hTmiMjWNkidJ
> > QtcPdtJZipJii4LJwCcJE1/ev+KWiWHuNcySEvuKXiJPqGjkWHci8hQ11Y5nzsgM
> > 9MZcvjLnCs5hXM/xGVRis8oNifoY6ymZSr15/DUUbfSYJ/bV9st5s+CXvxcIuM1P
> > S872TkQWGwf4MLJoEoW6qkZ7A0muU1UWP46CWnvjvzEf8/e2lXWmImLMJW8Udypi
> > Ci87e/m+ievs6dXgBcRHJDCyFsI1pFmYlGajVqo38frqzvmi2s4iX8t67aTkRoH8
> > rPquxseO2pVcubznvXGW6IsYJ84fb7BfetecDcz0B/6lhfK39Cw3nNu5pWBlnCwU
> > WskgBybUVMVAOnyA7i/Z
> > =27sR
> > -----END PGP SIGNATURE-----
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
Done. Here's what ended up in the RC1 build:
http://bigtop01.cloudera.org:8080/view/Releases/job/Bigtop-0.3-RC/2/
I will cut an RC1 once the build is done and tested. Scream now if you
really want some other favorite fix of yours to end up in a release.
Thanks,
Roman.
On Tue, Mar 20, 2012 at 2:20 AM, James Page <ja...@ubuntu.com> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> Hi Roman
>
> On 20/03/12 00:00, Roman Shaposhnik wrote:
>> Here's an update on the Bigtop 0.3.0 release: * We've triaged all
>> the 0.3 issues:
>> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+BIGTOP+AND+resolution+%3D+Unresolved+AND+fixVersion+%3D+%220.3.0%22+ORDER+BY+priority+DESC&mode=hide
>>
>>
> * We've gotten quite a bit of feedback from the community. All the
>> issues reported have been addressed and fixes now exist in trunk. I
>> propose that we pull patches for the following issues into the
>> branch-0.3 and cut RC1 ASAP: BIGTOP-446. Typo in hadoop module for
>> puppet BIGTOP-459. remove references to cloudera from the packaging
>> files BIGTOP-443. deb/oozie/oozie-client.postinst installs an
>> alternative for a path that isn't there BIGTOP-382.
>> hadoop-conf-pseudo packages contains subversion metada
>>
>> Please let me know noon tomorrow if the above list is
>> wrong/incomplete for RC1
>
> I'd quite like to see https://issues.apache.org/jira/browse/BIGTOP-457
> in 0.3.0 - I've proposed a patch but not landed it in trunk as yet.
>
> This should bring the permissions in /var/lib/hadoop/cache for the deb
> package inline with those for the rpm package and resolve the issue
> Vijay had identified when trying to format the namenode on 10.04.
>
> Cheers
>
> James
>
> - --
> James Page
> Ubuntu Core Developer
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.11 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iQIcBAEBCAAGBQJPaEvnAAoJEL/srsug59jDngUP/2M0oOUhbMnnbW1I+WKapUnZ
> s36ZzMefDrZ3d3M0KiLAccS9mZFx8EH+3PjRk1a7LIwTAyYdZtb0/JYKBfURMFtN
> GyJ1QMk9HT8XJDo+ZoOiknqUgrD1BB167GmyxdPieTQ+NBvpzhmmZ0iS3pxbNeeC
> LmkhbFzuEGbwxVvC1dG64mLPzajkr+M+3XYKyIWO8Zxpigo1J06JRKnMlJ7BIRkE
> fGBmTLDi49oh71L2d14coDbTg7GFLec/ImXEimRnU6jVYVGrlnOmZPatEv80GgyQ
> nd99pA/pvj3BX9Eq/EgYYHjY/2+yK9qN9A7ugSMqs0UfY+GY4Wb3hTmiMjWNkidJ
> QtcPdtJZipJii4LJwCcJE1/ev+KWiWHuNcySEvuKXiJPqGjkWHci8hQ11Y5nzsgM
> 9MZcvjLnCs5hXM/xGVRis8oNifoY6ymZSr15/DUUbfSYJ/bV9st5s+CXvxcIuM1P
> S872TkQWGwf4MLJoEoW6qkZ7A0muU1UWP46CWnvjvzEf8/e2lXWmImLMJW8Udypi
> Ci87e/m+ievs6dXgBcRHJDCyFsI1pFmYlGajVqo38frqzvmi2s4iX8t67aTkRoH8
> rPquxseO2pVcubznvXGW6IsYJ84fb7BfetecDcz0B/6lhfK39Cw3nNu5pWBlnCwU
> WskgBybUVMVAOnyA7i/Z
> =27sR
> -----END PGP SIGNATURE-----
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by James Page <ja...@ubuntu.com>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Hi Roman
On 20/03/12 00:00, Roman Shaposhnik wrote:
> Here's an update on the Bigtop 0.3.0 release: * We've triaged all
> the 0.3 issues:
> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+BIGTOP+AND+resolution+%3D+Unresolved+AND+fixVersion+%3D+%220.3.0%22+ORDER+BY+priority+DESC&mode=hide
>
>
* We've gotten quite a bit of feedback from the community. All the
> issues reported have been addressed and fixes now exist in trunk. I
> propose that we pull patches for the following issues into the
> branch-0.3 and cut RC1 ASAP: BIGTOP-446. Typo in hadoop module for
> puppet BIGTOP-459. remove references to cloudera from the packaging
> files BIGTOP-443. deb/oozie/oozie-client.postinst installs an
> alternative for a path that isn't there BIGTOP-382.
> hadoop-conf-pseudo packages contains subversion metada
>
> Please let me know noon tomorrow if the above list is
> wrong/incomplete for RC1
I'd quite like to see https://issues.apache.org/jira/browse/BIGTOP-457
in 0.3.0 - I've proposed a patch but not landed it in trunk as yet.
This should bring the permissions in /var/lib/hadoop/cache for the deb
package inline with those for the rpm package and resolve the issue
Vijay had identified when trying to format the namenode on 10.04.
Cheers
James
- --
James Page
Ubuntu Core Developer
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iQIcBAEBCAAGBQJPaEvnAAoJEL/srsug59jDngUP/2M0oOUhbMnnbW1I+WKapUnZ
s36ZzMefDrZ3d3M0KiLAccS9mZFx8EH+3PjRk1a7LIwTAyYdZtb0/JYKBfURMFtN
GyJ1QMk9HT8XJDo+ZoOiknqUgrD1BB167GmyxdPieTQ+NBvpzhmmZ0iS3pxbNeeC
LmkhbFzuEGbwxVvC1dG64mLPzajkr+M+3XYKyIWO8Zxpigo1J06JRKnMlJ7BIRkE
fGBmTLDi49oh71L2d14coDbTg7GFLec/ImXEimRnU6jVYVGrlnOmZPatEv80GgyQ
nd99pA/pvj3BX9Eq/EgYYHjY/2+yK9qN9A7ugSMqs0UfY+GY4Wb3hTmiMjWNkidJ
QtcPdtJZipJii4LJwCcJE1/ev+KWiWHuNcySEvuKXiJPqGjkWHci8hQ11Y5nzsgM
9MZcvjLnCs5hXM/xGVRis8oNifoY6ymZSr15/DUUbfSYJ/bV9st5s+CXvxcIuM1P
S872TkQWGwf4MLJoEoW6qkZ7A0muU1UWP46CWnvjvzEf8/e2lXWmImLMJW8Udypi
Ci87e/m+ievs6dXgBcRHJDCyFsI1pFmYlGajVqo38frqzvmi2s4iX8t67aTkRoH8
rPquxseO2pVcubznvXGW6IsYJ84fb7BfetecDcz0B/6lhfK39Cw3nNu5pWBlnCwU
WskgBybUVMVAOnyA7i/Z
=27sR
-----END PGP SIGNATURE-----
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
Here's an update on the Bigtop 0.3.0 release:
* We've triaged all the 0.3 issues:
https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+BIGTOP+AND+resolution+%3D+Unresolved+AND+fixVersion+%3D+%220.3.0%22+ORDER+BY+priority+DESC&mode=hide
* We've gotten quite a bit of feedback from the community. All the
issues reported have been addressed and fixes now exist in trunk.
I propose that we pull patches for the following issues into the branch-0.3
and cut RC1 ASAP:
BIGTOP-446. Typo in hadoop module for puppet
BIGTOP-459. remove references to cloudera from the packaging files
BIGTOP-443. deb/oozie/oozie-client.postinst installs an
alternative for a path that isn't there
BIGTOP-382. hadoop-conf-pseudo packages contains subversion metada
Please let me know noon tomorrow if the above list is wrong/incomplete for RC1
Thanks,
Roman (your friendly neighborhood release manager)
On Mon, Mar 19, 2012 at 3:00 PM, Patrick Hunt <ph...@apache.org> wrote:
> Bigtop-459 sounds right. I just want to make sure that you have the
> copyright files and such up to date with the upstreams.
>
> Regards,
>
> Patrick
>
> On Mon, Mar 19, 2012 at 1:14 PM, Roman Shaposhnik <rv...@apache.org> wrote:
>> Hi Patrick!
>>
>> On Sat, Mar 17, 2012 at 8:45 AM, Patrick Hunt <ph...@apache.org> wrote:
>>> The copyright issues I mentioned are serious. Have you addressed them?
>>
>> Here's a JIRA to track this: https://issues.apache.org/jira/browse/HDFS-2368
>>
>> I'm going to post a patch that updates all the packaging files (that includes
>> copyright files) but I'm going to leave test data the way it is. Please let me
>> know if this could be a problem.
>>
>> Thanks,
>> Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Patrick Hunt <ph...@apache.org>.
Bigtop-459 sounds right. I just want to make sure that you have the
copyright files and such up to date with the upstreams.
Regards,
Patrick
On Mon, Mar 19, 2012 at 1:14 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> Hi Patrick!
>
> On Sat, Mar 17, 2012 at 8:45 AM, Patrick Hunt <ph...@apache.org> wrote:
>> The copyright issues I mentioned are serious. Have you addressed them?
>
> Here's a JIRA to track this: https://issues.apache.org/jira/browse/HDFS-2368
>
> I'm going to post a patch that updates all the packaging files (that includes
> copyright files) but I'm going to leave test data the way it is. Please let me
> know if this could be a problem.
>
> Thanks,
> Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
Hi Patrick!
On Sat, Mar 17, 2012 at 8:45 AM, Patrick Hunt <ph...@apache.org> wrote:
> The copyright issues I mentioned are serious. Have you addressed them?
Here's a JIRA to track this: https://issues.apache.org/jira/browse/HDFS-2368
I'm going to post a patch that updates all the packaging files (that includes
copyright files) but I'm going to leave test data the way it is. Please let me
know if this could be a problem.
Thanks,
Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Patrick Hunt <ph...@apache.org>.
The copyright issues I mentioned are serious. Have you addressed them?
On Fri, Mar 16, 2012 at 8:00 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> Thanks to all who provided feedback. Looks like we don't really
> have any serious blockers, but I will be respinning the RC
> shortly based on the concerns so far.
>
> Thanks,
> Roman.
>
> On Sat, Mar 10, 2012 at 7:10 PM, Roman Shaposhnik <rv...@apache.org> wrote:
>> This is the third incubator release for Apache Bigtop, version
>> 0.3.0-incubating.
>>
>> *** Please download, test, and vote by Friday, March 16
>>
>> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>>
>> Source tarball, checksums, signature:
>> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>>
>> The tag to be voted on:
>> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>>
>> Please also make sure to try installing our convenience binary distribution
>> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
>> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
>> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
>> your favorite Linux OS is to pick one of the attached files, and place
>> it (as root)
>> in the following folder:
>> * Ubuntu -- /etc/apt/sources.list.d/
>> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
>> * SLES 11 -- /etc/zypp/repos.d/
>> After that you can follow the installation instructions from over here (DO NOT
>> FORGET TO SKIP STEPS #1 and #2):
>> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>>
>> Bigtop's KEYS file, containing the PGP keys used to sign the release:
>> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>>
>> Thanks!
>>
>> Bigtop 0.3.0 release manager,
>> Roman Shaposhnik
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
Thanks to all who provided feedback. Looks like we don't really
have any serious blockers, but I will be respinning the RC
shortly based on the concerns so far.
Thanks,
Roman.
On Sat, Mar 10, 2012 at 7:10 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
Thanks to all who provided feedback. Looks like we don't really
have any serious blockers, but I will be respinning the RC
shortly based on the concerns so far.
Thanks,
Roman.
On Sat, Mar 10, 2012 at 7:10 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Patrick Hunt <ph...@apache.org>.
In general the release looks good. However when I grep for "-i
cloudera" from the toplevel I still see quite a few references. for
example in flume copyright file (deb pkg). This seems wrong. I'd
suggest that you run grep yourself and try to remove as many of these
references as possible.
Patrick
On Sat, Mar 10, 2012 at 7:10 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Bruno Mahé <bm...@apache.org>.
On 03/10/2012 07:10 PM, Roman Shaposhnik wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
I have started testing this release yesterday by doing a full deployment
/ tests. But I found at least an issue I would consider a blocker for
this RC: see BIGTOP-446.
I provisioned 20 CentOS 6 machines (8 core, 23GB RAM each), used our
puppet recipes to deploy this RC and tried to run some of my code on it
(importing a dump of freebase in my triplestore and query it)
Here are some notes:
1/ typo in puppet recipes. BIGTOP-446
2/ zookeeper wasn't started. Once I manually started the service
(without any issue), everything got unblocked. Probably worth opening a
ticket.
3/ hbase-master couldn't start because it could not connect to zookeeper
because of 2/
4/ Somehow, the jobtracker and hdfs directories got set up only after
the zookeeper issue got resolved (because of 2/)
5/ I noticed quite a few crashes on the tasktracker/regionservers. Their
stack traces are from being helpful. But this is an upstream issue (or
me/puppet doing something stupid).
6/ Because of 5/, it would be nice to have some supervisor processes
7/ It would also be very helpful to have some
munin/collectd/ganglia/nagios integration
8/ It would be nice to be able to configure HBASE heap
9/ I would rather configure hadoop heap as a percentage of available
ram, instead of an absolute value
Overall I really enjoyed it!
The combination of puppet recipes and packages made it really easy to go
from nothing to a 20 machine hadoop cluster.
Thanks,
Bruno
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Marcos Ortiz <ml...@uci.cu>.
On 03/15/2012 06:08 PM, Vijay Srinivasan wrote:
> I see that the /var/lib/hadoop/cache/hadoop/dfs directory is not
> created in the postinstall script.. If this is a legit issue for deb
> packages, should I create a ticket for this ?
I think that the directory should be created with the postinstall
script, so, maybe we can create a ticket for it.
> I dont see this line in bigtop 0.2.0 for hadoop 0.20.. Maybe this is a
> new requirement for hadoop 1.0..
>
> bigtop-0.3.0-incubating/bigtop-packages/src/deb/hadoop/hadoop.postinst:
> # We don't want to do this recursively since we may be
> reinstalling, in which case
> # users have their own cache/<username> directories which
> shouldn't be stolen
> chown root:hadoop /var/lib/hadoop/ /var/lib/hadoop/cache/
> /var/lib/hadoop/cache/hadoop/
> chmod 1777 /var/lib/hadoop/cache/
> update-alternatives --install /etc/hadoop/conf hadoop-conf
> /etc/hadoop/conf.empty 10
>
> Thnx,
> Vijay
>
> On Wed, Mar 14, 2012 at 8:05 PM, Marcos Ortiz <mlortiz@uci.cu
> <ma...@uci.cu>> wrote:
>
>
>
> On 03/14/2012 10:41 PM, Vijay Srinivasan wrote:
>
> Looks like it was a VM issue! Works with a fresh VM.. I am
> able to install
> all the packages with bigtop-0.3.0 and also run the hadoop
> examples on
> ubuntu 10.03LTS.. Only issue I faced was that after
> installation, the
> /var/lib/hadoop/cache/hadoop/dfs directory wasnt created and I
> had to
> create it manually to get the namenode to start..
>
> Well, we need to review the postinstall script to see if this
> directory is included on this version
> Regards
>
>
> Thnx,
> Vijay
>
>
> On Wed, Mar 14, 2012 at 6:28 PM, Vijay Srinivasan
> <vijsrinivasan@gmail.com <ma...@gmail.com>>wrote:
>
> Hi Roman,
>
> I also see the space correctly.. Dumped the output below..
> I am now
> retrying with a fresh VM..
>
> root@vijasrin-laptop:~# ls -la
> /etc/apt/sources.list.d/bigtop-lucid.list
> -rw-r--r-- 1 root root 127 2012-03-14 02:34
> /etc/apt/sources.list.d/
> bigtop-lucid.list
>
> root@vijasrin-laptop:~# cat
> /etc/apt/sources.list.d/bigtop-lucid.list
> deb
> http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/<http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/label=lucid//lastSuccessfulBuild/artifact/output/apt/>
> bigtop
>
> contrib
>
> root@vijasrin-laptop:~#
>
> Btw, what other way do you recommend ? Download the
> output/apt dir from
> jenkins and then add it manually ?
>
> Thnx,
> Vijay
>
> On Wed, Mar 14, 2012 at 6:16 PM, Roman
> Shaposhnik<rvs@apache.org <ma...@apache.org>> wrote:
>
> On Wed, Mar 14, 2012 at 3:57 AM, Doug
> Chang<dougc@stanfordalumni.org
> <ma...@stanfordalumni.org>>
> wrote:
>
> there is supposed to be a space between apt and
> bigtop contrib.
>
> but there is. at least the way I see it.
>
> the content of bigtop.list is not created correctly
>
> it seems to work for me. I would be curious to find
> out what actually is the problem here.
>
> Vijay, can you send the bigtop.list the way it appears in
> your /etc/apt/sources.list.d ?
>
> Thanks,
> Roman.
>
>
>
>
>
>
> --
> Marcos Luis Ortíz Valmaseda
> Sr. Software Engineer (UCI)
> http://marcosluis2186.posterous.com
> http://postgresql.uci.cu/blog/38
>
>
>
> Fin a la injusticia, LIBERTAD AHORA A NUESTROS CINCO COMPATRIOTAS
> QUE SE ENCUENTRAN INJUSTAMENTE EN PRISIONES DE LOS EEUU!
> http://www.antiterroristas.cu
> http://justiciaparaloscinco.wordpress.com
>
>
--
Marcos Luis Ortíz Valmaseda (@marcosluis2186)
Data Engineer at UCI
http://marcosluis2186.posterous.com
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Vijay Srinivasan <vi...@gmail.com>.
I see that the /var/lib/hadoop/cache/hadoop/dfs directory is not created in
the postinstall script.. If this is a legit issue for deb packages, should
I create a ticket for this ?
I dont see this line in bigtop 0.2.0 for hadoop 0.20.. Maybe this is a
new requirement for hadoop 1.0..
bigtop-0.3.0-incubating/bigtop-packages/src/deb/hadoop/hadoop.postinst:
# We don't want to do this recursively since we may be
reinstalling, in which case
# users have their own cache/<username> directories which shouldn't
be stolen
chown root:hadoop /var/lib/hadoop/ /var/lib/hadoop/cache/
/var/lib/hadoop/cache/hadoop/
chmod 1777 /var/lib/hadoop/cache/
update-alternatives --install /etc/hadoop/conf hadoop-conf
/etc/hadoop/conf.empty 10
Thnx,
Vijay
On Wed, Mar 14, 2012 at 8:05 PM, Marcos Ortiz <ml...@uci.cu> wrote:
>
>
> On 03/14/2012 10:41 PM, Vijay Srinivasan wrote:
>
>> Looks like it was a VM issue! Works with a fresh VM.. I am able to install
>> all the packages with bigtop-0.3.0 and also run the hadoop examples on
>> ubuntu 10.03LTS.. Only issue I faced was that after installation, the
>> /var/lib/hadoop/cache/hadoop/**dfs directory wasnt created and I had to
>> create it manually to get the namenode to start..
>>
> Well, we need to review the postinstall script to see if this directory is
> included on this version
> Regards
>
>
>> Thnx,
>> Vijay
>>
>>
>> On Wed, Mar 14, 2012 at 6:28 PM, Vijay Srinivasan
>> <vi...@gmail.com>**wrote:
>>
>> Hi Roman,
>>>
>>> I also see the space correctly.. Dumped the output below.. I am now
>>> retrying with a fresh VM..
>>>
>>> root@vijasrin-laptop:~# ls -la /etc/apt/sources.list.d/**
>>> bigtop-lucid.list
>>> -rw-r--r-- 1 root root 127 2012-03-14 02:34 /etc/apt/sources.list.d/
>>> bigtop-lucid.list
>>>
>>> root@vijasrin-laptop:~# cat /etc/apt/sources.list.d/**bigtop-lucid.list
>>> deb
>>> http://bigtop01.cloudera.org:**8080/job/Bigtop-0.3-RC/./**label=lucid//*
>>> *lastSuccessfulBuild/artifact/**output/apt/<http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/>
>>> <http://bigtop01.**cloudera.org:8080/job/Bigtop-**0.3-RC/label=lucid//**
>>> lastSuccessfulBuild/artifact/**output/apt/<http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/label=lucid//lastSuccessfulBuild/artifact/output/apt/>>
>>> bigtop
>>>
>>> contrib
>>>
>>> root@vijasrin-laptop:~#
>>>
>>> Btw, what other way do you recommend ? Download the output/apt dir from
>>> jenkins and then add it manually ?
>>>
>>> Thnx,
>>> Vijay
>>>
>>> On Wed, Mar 14, 2012 at 6:16 PM, Roman Shaposhnik<rv...@apache.org>
>>> wrote:
>>>
>>> On Wed, Mar 14, 2012 at 3:57 AM, Doug Chang<dougc@stanfordalumni.org**>
>>>> wrote:
>>>>
>>>>> there is supposed to be a space between apt and bigtop contrib.
>>>>>
>>>> but there is. at least the way I see it.
>>>>
>>>> the content of bigtop.list is not created correctly
>>>>>
>>>> it seems to work for me. I would be curious to find
>>>> out what actually is the problem here.
>>>>
>>>> Vijay, can you send the bigtop.list the way it appears in
>>>> your /etc/apt/sources.list.d ?
>>>>
>>>> Thanks,
>>>> Roman.
>>>>
>>>>
>>>
>>
>>
>>
> --
> Marcos Luis Ortíz Valmaseda
> Sr. Software Engineer (UCI)
> http://marcosluis2186.**posterous.com<http://marcosluis2186.posterous.com>
> http://postgresql.uci.cu/blog/**38 <http://postgresql.uci.cu/blog/38>
>
>
>
> Fin a la injusticia, LIBERTAD AHORA A NUESTROS CINCO COMPATRIOTAS QUE SE
> ENCUENTRAN INJUSTAMENTE EN PRISIONES DE LOS EEUU!
> http://www.antiterroristas.cu
> http://justiciaparaloscinco.**wordpress.com<http://justiciaparaloscinco.wordpress.com>
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Marcos Ortiz <ml...@uci.cu>.
On 03/14/2012 10:41 PM, Vijay Srinivasan wrote:
> Looks like it was a VM issue! Works with a fresh VM.. I am able to install
> all the packages with bigtop-0.3.0 and also run the hadoop examples on
> ubuntu 10.03LTS.. Only issue I faced was that after installation, the
> /var/lib/hadoop/cache/hadoop/dfs directory wasnt created and I had to
> create it manually to get the namenode to start..
Well, we need to review the postinstall script to see if this directory
is included on this version
Regards
>
> Thnx,
> Vijay
>
>
> On Wed, Mar 14, 2012 at 6:28 PM, Vijay Srinivasan
> <vi...@gmail.com>wrote:
>
>> Hi Roman,
>>
>> I also see the space correctly.. Dumped the output below.. I am now
>> retrying with a fresh VM..
>>
>> root@vijasrin-laptop:~# ls -la /etc/apt/sources.list.d/bigtop-lucid.list
>> -rw-r--r-- 1 root root 127 2012-03-14 02:34 /etc/apt/sources.list.d/
>> bigtop-lucid.list
>>
>> root@vijasrin-laptop:~# cat /etc/apt/sources.list.d/bigtop-lucid.list
>> deb
>> http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/<http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/label=lucid//lastSuccessfulBuild/artifact/output/apt/> bigtop
>> contrib
>>
>> root@vijasrin-laptop:~#
>>
>> Btw, what other way do you recommend ? Download the output/apt dir from
>> jenkins and then add it manually ?
>>
>> Thnx,
>> Vijay
>>
>> On Wed, Mar 14, 2012 at 6:16 PM, Roman Shaposhnik<rv...@apache.org> wrote:
>>
>>> On Wed, Mar 14, 2012 at 3:57 AM, Doug Chang<do...@stanfordalumni.org>
>>> wrote:
>>>> there is supposed to be a space between apt and bigtop contrib.
>>> but there is. at least the way I see it.
>>>
>>>> the content of bigtop.list is not created correctly
>>> it seems to work for me. I would be curious to find
>>> out what actually is the problem here.
>>>
>>> Vijay, can you send the bigtop.list the way it appears in
>>> your /etc/apt/sources.list.d ?
>>>
>>> Thanks,
>>> Roman.
>>>
>>
>
>
>
--
Marcos Luis Ortíz Valmaseda
Sr. Software Engineer (UCI)
http://marcosluis2186.posterous.com
http://postgresql.uci.cu/blog/38
Fin a la injusticia, LIBERTAD AHORA A NUESTROS CINCO COMPATRIOTAS QUE SE ENCUENTRAN INJUSTAMENTE EN PRISIONES DE LOS EEUU!
http://www.antiterroristas.cu
http://justiciaparaloscinco.wordpress.com
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Vijay Srinivasan <vi...@gmail.com>.
Looks like it was a VM issue! Works with a fresh VM.. I am able to install
all the packages with bigtop-0.3.0 and also run the hadoop examples on
ubuntu 10.03LTS.. Only issue I faced was that after installation, the
/var/lib/hadoop/cache/hadoop/dfs directory wasnt created and I had to
create it manually to get the namenode to start..
Thnx,
Vijay
On Wed, Mar 14, 2012 at 6:28 PM, Vijay Srinivasan
<vi...@gmail.com>wrote:
> Hi Roman,
>
> I also see the space correctly.. Dumped the output below.. I am now
> retrying with a fresh VM..
>
> root@vijasrin-laptop:~# ls -la /etc/apt/sources.list.d/bigtop-lucid.list
> -rw-r--r-- 1 root root 127 2012-03-14 02:34 /etc/apt/sources.list.d/
> bigtop-lucid.list
>
> root@vijasrin-laptop:~# cat /etc/apt/sources.list.d/bigtop-lucid.list
> deb
> http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/<http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/label=lucid//lastSuccessfulBuild/artifact/output/apt/> bigtop
> contrib
>
> root@vijasrin-laptop:~#
>
> Btw, what other way do you recommend ? Download the output/apt dir from
> jenkins and then add it manually ?
>
> Thnx,
> Vijay
>
> On Wed, Mar 14, 2012 at 6:16 PM, Roman Shaposhnik <rv...@apache.org> wrote:
>
>> On Wed, Mar 14, 2012 at 3:57 AM, Doug Chang <do...@stanfordalumni.org>
>> wrote:
>> > there is supposed to be a space between apt and bigtop contrib.
>>
>> but there is. at least the way I see it.
>>
>> > the content of bigtop.list is not created correctly
>>
>> it seems to work for me. I would be curious to find
>> out what actually is the problem here.
>>
>> Vijay, can you send the bigtop.list the way it appears in
>> your /etc/apt/sources.list.d ?
>>
>> Thanks,
>> Roman.
>>
>
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Vijay Srinivasan <vi...@gmail.com>.
Hi Roman,
I also see the space correctly.. Dumped the output below.. I am now
retrying with a fresh VM..
root@vijasrin-laptop:~# ls -la /etc/apt/sources.list.d/bigtop-lucid.list
-rw-r--r-- 1 root root 127 2012-03-14 02:34 /etc/apt/sources.list.d/
bigtop-lucid.list
root@vijasrin-laptop:~# cat /etc/apt/sources.list.d/bigtop-lucid.list
deb
http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/<http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/label=lucid//lastSuccessfulBuild/artifact/output/apt/>
bigtop
contrib
root@vijasrin-laptop:~#
Btw, what other way do you recommend ? Download the output/apt dir from
jenkins and then add it manually ?
Thnx,
Vijay
On Wed, Mar 14, 2012 at 6:16 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> On Wed, Mar 14, 2012 at 3:57 AM, Doug Chang <do...@stanfordalumni.org>
> wrote:
> > there is supposed to be a space between apt and bigtop contrib.
>
> but there is. at least the way I see it.
>
> > the content of bigtop.list is not created correctly
>
> it seems to work for me. I would be curious to find
> out what actually is the problem here.
>
> Vijay, can you send the bigtop.list the way it appears in
> your /etc/apt/sources.list.d ?
>
> Thanks,
> Roman.
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
On Wed, Mar 14, 2012 at 3:57 AM, Doug Chang <do...@stanfordalumni.org> wrote:
> there is supposed to be a space between apt and bigtop contrib.
but there is. at least the way I see it.
> the content of bigtop.list is not created correctly
it seems to work for me. I would be curious to find
out what actually is the problem here.
Vijay, can you send the bigtop.list the way it appears in
your /etc/apt/sources.list.d ?
Thanks,
Roman.
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Doug Chang <do...@stanfordalumni.org>.
there is supposed to be a space between apt and bigtop contrib.
the content of bigtop.list is not created correctly
dc
On Wed, Mar 14, 2012 at 3:17 AM, Vijay Srinivasan
<vi...@gmail.com>wrote:
> I copied over bigtop-lucid.list from roman's attached file to
> /etc/apt/sources.list.d/ and then did
>
> sudo apt-get update sudo apt-get install hadoop\* flume-* mahout\* oozie\*
> whirr-* The update seems to have worked but the install is giving the
> error.. The bigtop-lucid.list has the correct port number.. Am I missing
> something?! Any other way to install ?
>
> root@vijasrin-laptop:~# ls -la /etc/apt/sources.list.d/bigtop-lucid.list
> -rw-r--r-- 1 root root 127 2012-03-14 02:34
> /etc/apt/sources.list.d/bigtop-lucid.list root@vijasrin-laptop:~# cat
> /etc/apt/sources.list.d/bigtop-lucid.list deb
>
> http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop
> contrib root@vijasrin-laptop:~#
>
>
>
>
> On Wed, Mar 14, 2012 at 1:41 AM, Bruno Mahé <bm...@apache.org> wrote:
>
> > On 03/13/2012 10:15 PM, Vijay Srinivasan wrote:
> > > Hi,
> > >
> > > I was trying to install bigtop0.3.0 on ubuntu lucid.. But I see two
> > > problems:
> > > 1. Even after installing the GPG keys, when I try to do the apt-get
> > install
> > > of the hadoop packages, I get the message that the packages cannot be
> > > authenticated:
> > > WARNING: The following packages cannot be authenticated!
> > > bigtop-utils hadoop flume flume-node hadoop-namenode hadoop-datanode
> > > hadoop-secondarynamenode hadoop-jobtracker
> > > hadoop-tasktracker hadoop-conf-pseudo hadoop-doc libhdfs0 hadoop-fuse
> > > hadoop-native hadoop-pipes hadoop-sbin
> > > hadoop-source mahout oozie-client oozie whirr
> > > Install these packages without verification [y/N]?
> > >
> > > 2. Is bigtop01.cloudera.org down ? Getting these errors while
> > downloading:
> > > Err
> > >
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > > hadoop 1.0.1-1
> > > The HTTP server sent an invalid Content-Range header
> > > Err
> > >
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > > flume 1.0.0-1
> > > Bad header line
> > > Err
> > >
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > > flume-node 1.0.0-1
> > >
> > >
> > > Thnx,
> > > Vijay
> > >
> > >
> >
> >
> > I haven't looked at the debs yet, so I cannot comment on 1.
> > But regarding 2., it looks like you have a typo since jenkins run on the
> > port 8080.
> >
> > Thanks,
> > Bruno
> >
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Vijay Srinivasan <vi...@gmail.com>.
I copied over bigtop-lucid.list from roman's attached file to
/etc/apt/sources.list.d/ and then did
sudo apt-get update sudo apt-get install hadoop\* flume-* mahout\* oozie\*
whirr-* The update seems to have worked but the install is giving the
error.. The bigtop-lucid.list has the correct port number.. Am I missing
something?! Any other way to install ?
root@vijasrin-laptop:~# ls -la /etc/apt/sources.list.d/bigtop-lucid.list
-rw-r--r-- 1 root root 127 2012-03-14 02:34
/etc/apt/sources.list.d/bigtop-lucid.list root@vijasrin-laptop:~# cat
/etc/apt/sources.list.d/bigtop-lucid.list deb
http://bigtop01.cloudera.org:8080/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop
contrib root@vijasrin-laptop:~#
On Wed, Mar 14, 2012 at 1:41 AM, Bruno Mahé <bm...@apache.org> wrote:
> On 03/13/2012 10:15 PM, Vijay Srinivasan wrote:
> > Hi,
> >
> > I was trying to install bigtop0.3.0 on ubuntu lucid.. But I see two
> > problems:
> > 1. Even after installing the GPG keys, when I try to do the apt-get
> install
> > of the hadoop packages, I get the message that the packages cannot be
> > authenticated:
> > WARNING: The following packages cannot be authenticated!
> > bigtop-utils hadoop flume flume-node hadoop-namenode hadoop-datanode
> > hadoop-secondarynamenode hadoop-jobtracker
> > hadoop-tasktracker hadoop-conf-pseudo hadoop-doc libhdfs0 hadoop-fuse
> > hadoop-native hadoop-pipes hadoop-sbin
> > hadoop-source mahout oozie-client oozie whirr
> > Install these packages without verification [y/N]?
> >
> > 2. Is bigtop01.cloudera.org down ? Getting these errors while
> downloading:
> > Err
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > hadoop 1.0.1-1
> > The HTTP server sent an invalid Content-Range header
> > Err
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > flume 1.0.0-1
> > Bad header line
> > Err
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > flume-node 1.0.0-1
> >
> >
> > Thnx,
> > Vijay
> >
> >
>
>
> I haven't looked at the debs yet, so I cannot comment on 1.
> But regarding 2., it looks like you have a typo since jenkins run on the
> port 8080.
>
> Thanks,
> Bruno
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Doug Chang <do...@stanfordalumni.org>.
debs work, should be able to do an apt-get install and Y on verification.
dc
On Wed, Mar 14, 2012 at 1:41 AM, Bruno Mahé <bm...@apache.org> wrote:
> On 03/13/2012 10:15 PM, Vijay Srinivasan wrote:
> > Hi,
> >
> > I was trying to install bigtop0.3.0 on ubuntu lucid.. But I see two
> > problems:
> > 1. Even after installing the GPG keys, when I try to do the apt-get
> install
> > of the hadoop packages, I get the message that the packages cannot be
> > authenticated:
> > WARNING: The following packages cannot be authenticated!
> > bigtop-utils hadoop flume flume-node hadoop-namenode hadoop-datanode
> > hadoop-secondarynamenode hadoop-jobtracker
> > hadoop-tasktracker hadoop-conf-pseudo hadoop-doc libhdfs0 hadoop-fuse
> > hadoop-native hadoop-pipes hadoop-sbin
> > hadoop-source mahout oozie-client oozie whirr
> > Install these packages without verification [y/N]?
> >
> > 2. Is bigtop01.cloudera.org down ? Getting these errors while
> downloading:
> > Err
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > hadoop 1.0.1-1
> > The HTTP server sent an invalid Content-Range header
> > Err
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > flume 1.0.0-1
> > Bad header line
> > Err
> >
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> > flume-node 1.0.0-1
> >
> >
> > Thnx,
> > Vijay
> >
> >
>
>
> I haven't looked at the debs yet, so I cannot comment on 1.
> But regarding 2., it looks like you have a typo since jenkins run on the
> port 8080.
>
> Thanks,
> Bruno
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Bruno Mahé <bm...@apache.org>.
On 03/13/2012 10:15 PM, Vijay Srinivasan wrote:
> Hi,
>
> I was trying to install bigtop0.3.0 on ubuntu lucid.. But I see two
> problems:
> 1. Even after installing the GPG keys, when I try to do the apt-get install
> of the hadoop packages, I get the message that the packages cannot be
> authenticated:
> WARNING: The following packages cannot be authenticated!
> bigtop-utils hadoop flume flume-node hadoop-namenode hadoop-datanode
> hadoop-secondarynamenode hadoop-jobtracker
> hadoop-tasktracker hadoop-conf-pseudo hadoop-doc libhdfs0 hadoop-fuse
> hadoop-native hadoop-pipes hadoop-sbin
> hadoop-source mahout oozie-client oozie whirr
> Install these packages without verification [y/N]?
>
> 2. Is bigtop01.cloudera.org down ? Getting these errors while downloading:
> Err
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> hadoop 1.0.1-1
> The HTTP server sent an invalid Content-Range header
> Err
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> flume 1.0.0-1
> Bad header line
> Err
> http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
> flume-node 1.0.0-1
>
>
> Thnx,
> Vijay
>
>
I haven't looked at the debs yet, so I cannot comment on 1.
But regarding 2., it looks like you have a typo since jenkins run on the
port 8080.
Thanks,
Bruno
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Vijay Srinivasan <vi...@gmail.com>.
Hi,
I was trying to install bigtop0.3.0 on ubuntu lucid.. But I see two
problems:
1. Even after installing the GPG keys, when I try to do the apt-get install
of the hadoop packages, I get the message that the packages cannot be
authenticated:
WARNING: The following packages cannot be authenticated!
bigtop-utils hadoop flume flume-node hadoop-namenode hadoop-datanode
hadoop-secondarynamenode hadoop-jobtracker
hadoop-tasktracker hadoop-conf-pseudo hadoop-doc libhdfs0 hadoop-fuse
hadoop-native hadoop-pipes hadoop-sbin
hadoop-source mahout oozie-client oozie whirr
Install these packages without verification [y/N]?
2. Is bigtop01.cloudera.org down ? Getting these errors while downloading:
Err
http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
hadoop 1.0.1-1
The HTTP server sent an invalid Content-Range header
Err
http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
flume 1.0.0-1
Bad header line
Err
http://bigtop01.cloudera.org/job/Bigtop-0.3-RC/./label=lucid//lastSuccessfulBuild/artifact/output/apt/bigtop/contrib
flume-node 1.0.0-1
Thnx,
Vijay
On Sat, Mar 10, 2012 at 7:10 PM, Roman Shaposhnik <rv...@apache.org> wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
>
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for
> the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO
> NOT
> FORGET TO SKIP STEPS #1 and #2):
>
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
>
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by Roman Shaposhnik <rv...@apache.org>.
On Mon, Mar 12, 2012 at 11:00 AM, sebb <se...@gmail.com> wrote:
> On 11 March 2012 03:10, Roman Shaposhnik <rv...@apache.org> wrote:
>> This is the third incubator release for Apache Bigtop, version
>> 0.3.0-incubating.
>>
>> *** Please download, test, and vote by Friday, March 16
>>
>> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>>
>> Source tarball, checksums, signature:
>> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>>
>> The tag to be voted on:
>> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
>
> CHANGES.txt has no details for 0.3.0
>
> NOTCE says:
> Copyright 2011
Thanks! This is definitely going to be fixed in RC1. Now, if mentors could be
as kind as to take a look -- that'll be very much appreciated and will help
me cut RC1.
Thanks,
Roman.
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [VOTE] Release for Bigtop version 0.3.0-incubating
Posted by sebb <se...@gmail.com>.
On 11 March 2012 03:10, Roman Shaposhnik <rv...@apache.org> wrote:
> This is the third incubator release for Apache Bigtop, version
> 0.3.0-incubating.
>
> *** Please download, test, and vote by Friday, March 16
>
> Note that we are voting on the source (tag): release-0.3.0-incubating-RC0
>
> Source tarball, checksums, signature:
> http://people.apache.org/~rvs/bigtop-0.3.0-incubating-RC0/
>
> The tag to be voted on:
> https://svn.apache.org/repos/asf/incubator/bigtop/tags/release-0.3.0-incubating-RC0/
CHANGES.txt has no details for 0.3.0
NOTCE says:
Copyright 2011
> Please also make sure to try installing our convenience binary distribution
> artifacts. We are publishing the Bigtop 0.3.0 incubating distributions for the
> following Linux platforms: Ubuntu 10.04, CentOS 5, CentOS 6, Fedora 15,
> Fedora 16, SLES 11. The easies way to install Bigtop distribution on
> your favorite Linux OS is to pick one of the attached files, and place
> it (as root)
> in the following folder:
> * Ubuntu -- /etc/apt/sources.list.d/
> * CentOS5, CentOS6, Fedora 15, Fedora 16 -- /etc/yum.repos.d/
> * SLES 11 -- /etc/zypp/repos.d/
> After that you can follow the installation instructions from over here (DO NOT
> FORGET TO SKIP STEPS #1 and #2):
> https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop
>
> Bigtop's KEYS file, containing the PGP keys used to sign the release:
> http://svn.apache.org/repos/asf/incubator/bigtop/dist/KEYS
>
> Thanks!
>
> Bigtop 0.3.0 release manager,
> Roman Shaposhnik
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
> For additional commands, e-mail: general-help@incubator.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org