You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2020/02/29 10:11:11 UTC
[GitHub] [bigtop] elukey opened a new pull request #611: BIGTOP-3308: add
support for openssl 1.1.0 on Debian
elukey opened a new pull request #611: BIGTOP-3308: add support for openssl 1.1.0 on Debian
URL: https://github.com/apache/bigtop/pull/611
In BIGTOP-2932 a patch was backported from Hadoop upstream to better
support openssl 1.1.x. Some time later a new commit was filed to address
some corner cases, but it was never backported to BigTop.
On Debian 9 openssl 1.1.0 is the default, and BigTop builds against it.
When executing the command "hadoop checknative -a" though an error shows up:
openssl: false EVP_CIPHER_CTX_cleanup
The issue is that EVP_CIPHER_CTX_cleanup was removed from openssl 1.1.0, but
OpensslCipher.c kept using it until a proper if guard was added by the
patch provided by this pull request.
In my case this issue caused Spark 2.4's RPC encryption, based on Openssl native
lib, to fail when establishing new connections between workers and AM on Yarn.
I rebuilt the hadoop deb package with the patch and tested in the Debian 9 Docker
image, the checknative util now returns correctly a positive "true" for openssl.
I also tested it with Spark 2.4 on a test Hadoop cluster and it seems working fine.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [bigtop] oflebbe merged pull request #611: BIGTOP-3308: add support
for openssl 1.1.0 on Debian
Posted by GitBox <gi...@apache.org>.
oflebbe merged pull request #611: BIGTOP-3308: add support for openssl 1.1.0 on Debian
URL: https://github.com/apache/bigtop/pull/611
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services