You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com> on 2013/11/14 16:14:09 UTC
libhdfs v. 2.2 64-bit
So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer contains 64bit version of libhdfs as reported here: (https://issues.apache.org/jira/browse/HADOOP-9911).
Does anybody know if there are any plans to include the 64bit libs in the distribution? Any ideas where to search for future packaging plans? Thanks.
BTW I know we can build the lib myself, but users of apps that link libhdfs most likely won’t want to build the libs…
Thanks, Rodrigo.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
FW: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
Happy new year bigtop developers.
I'm looking for release information for bigtop 0.8.0 such as dates Hadoop versions and distros. I looked around but couldn't find it.
Also, is there an early release version I can use to test? Thanks!
Thanks, Rodrigo.
-----Original Message-----
From: Pastrana, Rodrigo (RIS-BCT) [mailto:Rodrigo.Pastrana@lexisnexis.com]
Sent: Monday, November 18, 2013 2:03 PM
To: user@hadoop.apache.org
Subject: RE: libhdfs v. 2.2 64-bit
We can definitely build them, but I'm not sure if our legal dep would allow us to distribute 3rd party libs (even though we're open source as well)...
If bigtop packages support the latest distros, and provide 2.x GA then the above discussion goes away =) I'll take a look at bigtop again, thanks for your help.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Monday, November 18, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys can't just rebuild the native bits for exact set of Linux distros you care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked
> at them, they were lagging a little behind in terms of distros
> supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know (on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only for the personal and confidential use of the recipient(s) named above. This message may be an attorney-client communication and/or work product and as such is privileged and confidential. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately by e-mail, and delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
We can definitely build them, but I'm not sure if our legal dep would allow us to distribute 3rd party libs (even though we're open source as well)...
If bigtop packages support the latest distros, and provide 2.x GA then the above discussion goes away =)
I'll take a look at bigtop again, thanks for your help.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Monday, November 18, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys can't just rebuild the native bits for exact set of Linux distros you care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked
> at them, they were lagging a little behind in terms of distros
> supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know (on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
We can definitely build them, but I'm not sure if our legal dep would allow us to distribute 3rd party libs (even though we're open source as well)...
If bigtop packages support the latest distros, and provide 2.x GA then the above discussion goes away =)
I'll take a look at bigtop again, thanks for your help.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Monday, November 18, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys can't just rebuild the native bits for exact set of Linux distros you care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked
> at them, they were lagging a little behind in terms of distros
> supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know (on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
We can definitely build them, but I'm not sure if our legal dep would allow us to distribute 3rd party libs (even though we're open source as well)...
If bigtop packages support the latest distros, and provide 2.x GA then the above discussion goes away =)
I'll take a look at bigtop again, thanks for your help.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Monday, November 18, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys can't just rebuild the native bits for exact set of Linux distros you care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked
> at them, they were lagging a little behind in terms of distros
> supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know (on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
We can definitely build them, but I'm not sure if our legal dep would allow us to distribute 3rd party libs (even though we're open source as well)...
If bigtop packages support the latest distros, and provide 2.x GA then the above discussion goes away =)
I'll take a look at bigtop again, thanks for your help.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Monday, November 18, 2013 12:51 PM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys can't just rebuild the native bits for exact set of Linux distros you care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked
> at them, they were lagging a little behind in terms of distros
> supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know (on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys
can't just rebuild the native bits for exact set of Linux distros you
care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging
> a little behind in terms of distros supported. Do you know where to get info on their plans for
> distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know
(on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and
Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys
can't just rebuild the native bits for exact set of Linux distros you
care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging
> a little behind in terms of distros supported. Do you know where to get info on their plans for
> distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know
(on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and
Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys
can't just rebuild the native bits for exact set of Linux distros you
care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging
> a little behind in terms of distros supported. Do you know where to get info on their plans for
> distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know
(on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and
Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Mon, Nov 18, 2013 at 9:06 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> Thanks Roman.
> Our app won't be able to impose any particular vendor's distribution upon our users.
> We grew dependent on base apache distribution packages w/ the 64bit builds...
> so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected?
> In other words, are there no plans to bring back the 64bit libs?
I see. I guess the question I have for you then is -- any reason you guys
can't just rebuild the native bits for exact set of Linux distros you
care about?
Do you find it difficult, or does it not fit your deployment pipeline?
> Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging
> a little behind in terms of distros supported. Do you know where to get info on their plans for
> distro support and/or when they'll add support for Hadoop 2.x? thanks.
The Bigtop 0.7.0 release has quite a wide support of Linux distros:
http://www.apache.org/dist/bigtop/bigtop-0.7.0/repos/
If you have something in mind that's missing -- please do let us know
(on dev@bigtop.apache.org).
As for the Hadoop -- Bigtop 0.7.0 went out supporting Hadoop 2.0.6 and
Bigtop 0.8.0 is going to have the latest version of Hadoop 2 GA.
Thanks,
Roman.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
Thanks Roman.
Our app won't be able to impose any particular vendor's distribution upon our users. We grew dependent on base apache distribution packages w/ the 64bit builds... so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected? In other words, are there no plans to bring back the 64bit libs?
Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging a little behind in terms of distros supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Thursday, November 14, 2013 11:46 AM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer
> contains 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in
> the distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your favorite Linux system, or pick the distro of one of the vendors. That will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release process is that you actually would have to build them on a the lowest common denominator of Linux OSes (CentOS 5 perhaps) to have a passing chance of being compatible. And even then I've seen things like libssl break compatibility (which is not surprising since at this point there are deployment of Hadoop on Linux distros that are more than 7 years apart).
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
Thanks Roman.
Our app won't be able to impose any particular vendor's distribution upon our users. We grew dependent on base apache distribution packages w/ the 64bit builds... so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected? In other words, are there no plans to bring back the 64bit libs?
Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging a little behind in terms of distros supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Thursday, November 14, 2013 11:46 AM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer
> contains 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in
> the distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your favorite Linux system, or pick the distro of one of the vendors. That will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release process is that you actually would have to build them on a the lowest common denominator of Linux OSes (CentOS 5 perhaps) to have a passing chance of being compatible. And even then I've seen things like libssl break compatibility (which is not surprising since at this point there are deployment of Hadoop on Linux distros that are more than 7 years apart).
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
Thanks Roman.
Our app won't be able to impose any particular vendor's distribution upon our users. We grew dependent on base apache distribution packages w/ the 64bit builds... so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected? In other words, are there no plans to bring back the 64bit libs?
Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging a little behind in terms of distros supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Thursday, November 14, 2013 11:46 AM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer
> contains 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in
> the distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your favorite Linux system, or pick the distro of one of the vendors. That will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release process is that you actually would have to build them on a the lowest common denominator of Linux OSes (CentOS 5 perhaps) to have a passing chance of being compatible. And even then I've seen things like libssl break compatibility (which is not surprising since at this point there are deployment of Hadoop on Linux distros that are more than 7 years apart).
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
RE: libhdfs v. 2.2 64-bit
Posted by "Pastrana, Rodrigo (RIS-BCT)" <Ro...@lexisnexis.com>.
Thanks Roman.
Our app won't be able to impose any particular vendor's distribution upon our users. We grew dependent on base apache distribution packages w/ the 64bit builds... so is https://issues.apache.org/jira/browse/HADOOP-9911 going to be rejected? In other words, are there no plans to bring back the 64bit libs?
Also, since you mentioned the Bigtop distros, the last time I looked at them, they were lagging a little behind in terms of distros supported. Do you know where to get info on their plans for distro support and/or when they'll add support for Hadoop 2.x? thanks.
Thanks, Rodrigo.
-----Original Message-----
From: shaposhnik@gmail.com [mailto:shaposhnik@gmail.com] On Behalf Of Roman Shaposhnik
Sent: Thursday, November 14, 2013 11:46 AM
To: user@hadoop.apache.org
Subject: Re: libhdfs v. 2.2 64-bit
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT) <Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer
> contains 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in
> the distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your favorite Linux system, or pick the distro of one of the vendors. That will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release process is that you actually would have to build them on a the lowest common denominator of Linux OSes (CentOS 5 perhaps) to have a passing chance of being compatible. And even then I've seen things like libssl break compatibility (which is not surprising since at this point there are deployment of Hadoop on Linux distros that are more than 7 years apart).
Thanks,
Roman.
-----------------------------------------
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <rv...@apache.org>.
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer contains
> 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in the
> distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your
favorite Linux system, or pick the distro of one of the vendors. That
will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release
process is that you actually would have to build them on a the lowest
common denominator of Linux OSes (CentOS 5 perhaps) to have
a passing chance of being compatible. And even then I've seen
things like libssl break compatibility (which is not surprising since
at this point there are deployment of Hadoop on Linux distros
that are more than 7 years apart).
Thanks,
Roman.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <rv...@apache.org>.
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer contains
> 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in the
> distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your
favorite Linux system, or pick the distro of one of the vendors. That
will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release
process is that you actually would have to build them on a the lowest
common denominator of Linux OSes (CentOS 5 perhaps) to have
a passing chance of being compatible. And even then I've seen
things like libssl break compatibility (which is not surprising since
at this point there are deployment of Hadoop on Linux distros
that are more than 7 years apart).
Thanks,
Roman.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <rv...@apache.org>.
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer contains
> 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in the
> distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your
favorite Linux system, or pick the distro of one of the vendors. That
will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release
process is that you actually would have to build them on a the lowest
common denominator of Linux OSes (CentOS 5 perhaps) to have
a passing chance of being compatible. And even then I've seen
things like libssl break compatibility (which is not surprising since
at this point there are deployment of Hadoop on Linux distros
that are more than 7 years apart).
Thanks,
Roman.
Re: libhdfs v. 2.2 64-bit
Posted by Roman Shaposhnik <rv...@apache.org>.
On Thu, Nov 14, 2013 at 7:14 AM, Pastrana, Rodrigo (RIS-BCT)
<Ro...@lexisnexis.com> wrote:
> So apparently the v2.2-beta apache Hadoop 2.2 tar file no longer contains
> 64bit version of libhdfs as reported here:
> (https://issues.apache.org/jira/browse/HADOOP-9911).
>
> Does anybody know if there are any plans to include the 64bit libs in the
> distribution? Any ideas where to search for future packaging plans? Thanks.
For packaging needs you can either pick Bigtop distribution for your
favorite Linux system, or pick the distro of one of the vendors. That
will have all the native libraries built *exactly* for the OS you have.
The reason native bits are hard to manage as part of Hadoop release
process is that you actually would have to build them on a the lowest
common denominator of Linux OSes (CentOS 5 perhaps) to have
a passing chance of being compatible. And even then I've seen
things like libssl break compatibility (which is not surprising since
at this point there are deployment of Hadoop on Linux distros
that are more than 7 years apart).
Thanks,
Roman.