You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Gonzalo Gomez <go...@bitnami.com> on 2019/10/04 08:50:56 UTC

Hadoop and OpenSSL 1.1.1

Hi all,


As OpenSSL 1.0.2 EOL is getting closer (end of this year [1]) I tried to
run Hadoop with OpenSSL 1.1.1d, but running the checknative command gives
false for the openssl library.


openssl: false EVP_CIPHER_CTX_cleanup


If I downgrade OpenSSL to 1.0.2s, it shows true and the path to
libcrypto.so library on my system. I searched for the
EVP_CIPHER_CTX_cleanup function and according to [2] it was removed on
OpenSSL 1.1.0. Can you tell me if Hadoop supports OpenSSL 1.1.1 or if it is
planned to be supported at any time in the future?


Regards,

Gonzalo


[1] https://www.openssl.org/policies/releasestrat.html

[2] https://stackoverflow.com/a/39762336

-- 
Run your favorite apps in the cloud with Bitnami
Confidential - All Rights Reserved.
BitRock © 2019

Re: Hadoop and OpenSSL 1.1.1

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Filed HADOOP-16647 <https://issues.apache.org/jira/browse/HADOOP-16647> I
am not planning to work on this any time soon so if any one is interested
feel free to pick it up/supply additional information.

On Wed, Oct 9, 2019 at 9:19 AM Wei-Chiu Chuang <we...@apache.org> wrote:

> Ok I stand corrected.
>
> That was for OpenSSL 1.1.0 and it might not even work for 1.1.1. The
> OpenSSL release version doesn't imply backward compatibility.
> Would you please try it out and let me know if HADOOP-14597 works or not?
> If not we need to file a jira to track this because OpenSSL 1.1.0 has
> already EOL'd and we need to look into support 1.1.1 (another 4 years until
> EOL)
> https://www.openssl.org/policies/releasestrat.html
>
> On Wed, Oct 9, 2019 at 8:55 AM Wei-Chiu Chuang <we...@cloudera.com>
> wrote:
>
>> See https://issues.apache.org/jira/browse/HADOOP-14597
>> OpenSSL 1.1.0 is supported with Hadoop 3.
>> We should backport this in Hadoop 2.
>>
>> I don't recall if we ever documented openssl version supported. Would be
>> nice to add that too.
>>
>> On Wed, Oct 9, 2019 at 12:09 AM Gonzalo Gomez <go...@bitnami.com>
>> wrote:
>>
>>> Hi, any comment regarding Hadoop and OpenSSL 1.1.1?
>>>
>>> On Fri, Oct 4, 2019 at 10:50 AM Gonzalo Gomez <go...@bitnami.com>
>>> wrote:
>>>
>>>> Hi all,
>>>>
>>>>
>>>> As OpenSSL 1.0.2 EOL is getting closer (end of this year [1]) I tried
>>>> to run Hadoop with OpenSSL 1.1.1d, but running the checknative command
>>>> gives false for the openssl library.
>>>>
>>>>
>>>> openssl: false EVP_CIPHER_CTX_cleanup
>>>>
>>>>
>>>> If I downgrade OpenSSL to 1.0.2s, it shows true and the path to
>>>> libcrypto.so library on my system. I searched for the
>>>> EVP_CIPHER_CTX_cleanup function and according to [2] it was removed on
>>>> OpenSSL 1.1.0. Can you tell me if Hadoop supports OpenSSL 1.1.1 or if it is
>>>> planned to be supported at any time in the future?
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Gonzalo
>>>>
>>>>
>>>> [1] https://www.openssl.org/policies/releasestrat.html
>>>>
>>>> [2] https://stackoverflow.com/a/39762336
>>>>
>>>> --
>>>> Run your favorite apps in the cloud with Bitnami
>>>> Confidential - All Rights Reserved.
>>>> BitRock © 2019
>>>>
>>>
>>>
>>> --
>>> Run your favorite apps in the cloud with Bitnami
>>> Confidential - All Rights Reserved.
>>> BitRock © 2019
>>>
>>

Re: Hadoop and OpenSSL 1.1.1

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Filed HADOOP-16647 <https://issues.apache.org/jira/browse/HADOOP-16647> I
am not planning to work on this any time soon so if any one is interested
feel free to pick it up/supply additional information.

On Wed, Oct 9, 2019 at 9:19 AM Wei-Chiu Chuang <we...@apache.org> wrote:

> Ok I stand corrected.
>
> That was for OpenSSL 1.1.0 and it might not even work for 1.1.1. The
> OpenSSL release version doesn't imply backward compatibility.
> Would you please try it out and let me know if HADOOP-14597 works or not?
> If not we need to file a jira to track this because OpenSSL 1.1.0 has
> already EOL'd and we need to look into support 1.1.1 (another 4 years until
> EOL)
> https://www.openssl.org/policies/releasestrat.html
>
> On Wed, Oct 9, 2019 at 8:55 AM Wei-Chiu Chuang <we...@cloudera.com>
> wrote:
>
>> See https://issues.apache.org/jira/browse/HADOOP-14597
>> OpenSSL 1.1.0 is supported with Hadoop 3.
>> We should backport this in Hadoop 2.
>>
>> I don't recall if we ever documented openssl version supported. Would be
>> nice to add that too.
>>
>> On Wed, Oct 9, 2019 at 12:09 AM Gonzalo Gomez <go...@bitnami.com>
>> wrote:
>>
>>> Hi, any comment regarding Hadoop and OpenSSL 1.1.1?
>>>
>>> On Fri, Oct 4, 2019 at 10:50 AM Gonzalo Gomez <go...@bitnami.com>
>>> wrote:
>>>
>>>> Hi all,
>>>>
>>>>
>>>> As OpenSSL 1.0.2 EOL is getting closer (end of this year [1]) I tried
>>>> to run Hadoop with OpenSSL 1.1.1d, but running the checknative command
>>>> gives false for the openssl library.
>>>>
>>>>
>>>> openssl: false EVP_CIPHER_CTX_cleanup
>>>>
>>>>
>>>> If I downgrade OpenSSL to 1.0.2s, it shows true and the path to
>>>> libcrypto.so library on my system. I searched for the
>>>> EVP_CIPHER_CTX_cleanup function and according to [2] it was removed on
>>>> OpenSSL 1.1.0. Can you tell me if Hadoop supports OpenSSL 1.1.1 or if it is
>>>> planned to be supported at any time in the future?
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Gonzalo
>>>>
>>>>
>>>> [1] https://www.openssl.org/policies/releasestrat.html
>>>>
>>>> [2] https://stackoverflow.com/a/39762336
>>>>
>>>> --
>>>> Run your favorite apps in the cloud with Bitnami
>>>> Confidential - All Rights Reserved.
>>>> BitRock © 2019
>>>>
>>>
>>>
>>> --
>>> Run your favorite apps in the cloud with Bitnami
>>> Confidential - All Rights Reserved.
>>> BitRock © 2019
>>>
>>

Re: Hadoop and OpenSSL 1.1.1

Posted by Wei-Chiu Chuang <we...@apache.org>.
Ok I stand corrected.

That was for OpenSSL 1.1.0 and it might not even work for 1.1.1. The
OpenSSL release version doesn't imply backward compatibility.
Would you please try it out and let me know if HADOOP-14597 works or not?
If not we need to file a jira to track this because OpenSSL 1.1.0 has
already EOL'd and we need to look into support 1.1.1 (another 4 years until
EOL)
https://www.openssl.org/policies/releasestrat.html

On Wed, Oct 9, 2019 at 8:55 AM Wei-Chiu Chuang <we...@cloudera.com> wrote:

> See https://issues.apache.org/jira/browse/HADOOP-14597
> OpenSSL 1.1.0 is supported with Hadoop 3.
> We should backport this in Hadoop 2.
>
> I don't recall if we ever documented openssl version supported. Would be
> nice to add that too.
>
> On Wed, Oct 9, 2019 at 12:09 AM Gonzalo Gomez <go...@bitnami.com> wrote:
>
>> Hi, any comment regarding Hadoop and OpenSSL 1.1.1?
>>
>> On Fri, Oct 4, 2019 at 10:50 AM Gonzalo Gomez <go...@bitnami.com>
>> wrote:
>>
>>> Hi all,
>>>
>>>
>>> As OpenSSL 1.0.2 EOL is getting closer (end of this year [1]) I tried to
>>> run Hadoop with OpenSSL 1.1.1d, but running the checknative command gives
>>> false for the openssl library.
>>>
>>>
>>> openssl: false EVP_CIPHER_CTX_cleanup
>>>
>>>
>>> If I downgrade OpenSSL to 1.0.2s, it shows true and the path to
>>> libcrypto.so library on my system. I searched for the
>>> EVP_CIPHER_CTX_cleanup function and according to [2] it was removed on
>>> OpenSSL 1.1.0. Can you tell me if Hadoop supports OpenSSL 1.1.1 or if it is
>>> planned to be supported at any time in the future?
>>>
>>>
>>> Regards,
>>>
>>> Gonzalo
>>>
>>>
>>> [1] https://www.openssl.org/policies/releasestrat.html
>>>
>>> [2] https://stackoverflow.com/a/39762336
>>>
>>> --
>>> Run your favorite apps in the cloud with Bitnami
>>> Confidential - All Rights Reserved.
>>> BitRock © 2019
>>>
>>
>>
>> --
>> Run your favorite apps in the cloud with Bitnami
>> Confidential - All Rights Reserved.
>> BitRock © 2019
>>
>

Re: Hadoop and OpenSSL 1.1.1

Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
See https://issues.apache.org/jira/browse/HADOOP-14597
OpenSSL 1.1.0 is supported with Hadoop 3.
We should backport this in Hadoop 2.

I don't recall if we ever documented openssl version supported. Would be
nice to add that too.

On Wed, Oct 9, 2019 at 12:09 AM Gonzalo Gomez <go...@bitnami.com> wrote:

> Hi, any comment regarding Hadoop and OpenSSL 1.1.1?
>
> On Fri, Oct 4, 2019 at 10:50 AM Gonzalo Gomez <go...@bitnami.com> wrote:
>
>> Hi all,
>>
>>
>> As OpenSSL 1.0.2 EOL is getting closer (end of this year [1]) I tried to
>> run Hadoop with OpenSSL 1.1.1d, but running the checknative command gives
>> false for the openssl library.
>>
>>
>> openssl: false EVP_CIPHER_CTX_cleanup
>>
>>
>> If I downgrade OpenSSL to 1.0.2s, it shows true and the path to
>> libcrypto.so library on my system. I searched for the
>> EVP_CIPHER_CTX_cleanup function and according to [2] it was removed on
>> OpenSSL 1.1.0. Can you tell me if Hadoop supports OpenSSL 1.1.1 or if it is
>> planned to be supported at any time in the future?
>>
>>
>> Regards,
>>
>> Gonzalo
>>
>>
>> [1] https://www.openssl.org/policies/releasestrat.html
>>
>> [2] https://stackoverflow.com/a/39762336
>>
>> --
>> Run your favorite apps in the cloud with Bitnami
>> Confidential - All Rights Reserved.
>> BitRock © 2019
>>
>
>
> --
> Run your favorite apps in the cloud with Bitnami
> Confidential - All Rights Reserved.
> BitRock © 2019
>

Re: Hadoop and OpenSSL 1.1.1

Posted by Gonzalo Gomez <go...@bitnami.com>.
Hi, any comment regarding Hadoop and OpenSSL 1.1.1?

On Fri, Oct 4, 2019 at 10:50 AM Gonzalo Gomez <go...@bitnami.com> wrote:

> Hi all,
>
>
> As OpenSSL 1.0.2 EOL is getting closer (end of this year [1]) I tried to
> run Hadoop with OpenSSL 1.1.1d, but running the checknative command gives
> false for the openssl library.
>
>
> openssl: false EVP_CIPHER_CTX_cleanup
>
>
> If I downgrade OpenSSL to 1.0.2s, it shows true and the path to
> libcrypto.so library on my system. I searched for the
> EVP_CIPHER_CTX_cleanup function and according to [2] it was removed on
> OpenSSL 1.1.0. Can you tell me if Hadoop supports OpenSSL 1.1.1 or if it is
> planned to be supported at any time in the future?
>
>
> Regards,
>
> Gonzalo
>
>
> [1] https://www.openssl.org/policies/releasestrat.html
>
> [2] https://stackoverflow.com/a/39762336
>
> --
> Run your favorite apps in the cloud with Bitnami
> Confidential - All Rights Reserved.
> BitRock © 2019
>


-- 
Run your favorite apps in the cloud with Bitnami
Confidential - All Rights Reserved.
BitRock © 2019