You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Lian Jiang <ji...@gmail.com> on 2018/03/05 21:34:59 UTC
The ports needed for ambari and hadoop installation
I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in a
secure environment which limits the ingress/egress ports and the
destinations/sources of internet traffic. For example, the hosts in this
environment only open 22, 443 ports and they can only access website A, B.
To setup a hadoop cluster in such an environment, I need to know below so
that ambari can work:
1. which ports need to be open.
2. which destinations/sources of internet traffic need to be permitted.
Other than searching document online and try-fail-try, is there a way to
get such information reliably so that I can more confidently ask people to
relax the environment? Appreciate any clue.
Re: The ports needed for ambari and hadoop installation
Posted by Fernández,
Juan Carlos <jc...@keedio.com>.
Hi Lian,
you may be interested in https://knox.apache.org/. Hi haven't looked the
project for a lot of time, but it may be helpfull for you.
Regards
2018-03-05 22:34 GMT+01:00 Lian Jiang <ji...@gmail.com>:
> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in
> a secure environment which limits the ingress/egress ports and the
> destinations/sources of internet traffic. For example, the hosts in this
> environment only open 22, 443 ports and they can only access website A, B.
>
> To setup a hadoop cluster in such an environment, I need to know below so
> that ambari can work:
>
> 1. which ports need to be open.
> 2. which destinations/sources of internet traffic need to be permitted.
>
> Other than searching document online and try-fail-try, is there a way to
> get such information reliably so that I can more confidently ask people to
> relax the environment? Appreciate any clue.
>
--
* KEEDIO*
* Juan Carlos Fernández Rodríguez*
*+34 630 288 149*
*www.keedio.com <http://www.keedio.com>*
C/ Virgilio 25, Pozuelo de Alarcón
Re: The ports needed for ambari and hadoop installation
Posted by Lian Jiang <ji...@gmail.com>.
Thanks Aaron. This helps. But are the port list complete? I saw they do not
cover ambari blueprint components like LOGSEARCH_SERVER, INFRA_SOLR,
METRICS_COLLECTOR, SPARK2_JOBHISTORYSERVER. Is there another pointer for
the missing components? Without a complete list, it will be hard to
precisely configure the ports so that ambari can install hadoop and hadoop
can work correctly. Thanks very much!
On Mon, Mar 19, 2018 at 10:14 PM, Aaron Bossert <aa...@punchcyber.com>
wrote:
> Lian,
>
> Technically, you don’t need any internet access to run an HDP cluster.
> You will, however need to have the appropriate repos hosted on your
> internal network in order to get set up and do periodic updates.
>
> The ports required for every HDP component are in the Hortonworks
> documentation: https://docs.hortonworks.com/HDPDocuments/
> HDP2/HDP-2.6.4/bk_reference/content/reference_chap2.html
>
> Sent from my iPhone
>
> On Mar 20, 2018, at 00:52, Lian Jiang <ji...@gmail.com> wrote:
>
> I want to re-raise this question since I have not got satisfying answers.
> Is there any document for the required ports and internet access? Thanks a
> lot.
>
> On Mon, Mar 5, 2018 at 1:34 PM, Lian Jiang <ji...@gmail.com> wrote:
>
>> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in
>> a secure environment which limits the ingress/egress ports and the
>> destinations/sources of internet traffic. For example, the hosts in this
>> environment only open 22, 443 ports and they can only access website A, B.
>>
>> To setup a hadoop cluster in such an environment, I need to know below so
>> that ambari can work:
>>
>> 1. which ports need to be open.
>> 2. which destinations/sources of internet traffic need to be permitted.
>>
>> Other than searching document online and try-fail-try, is there a way to
>> get such information reliably so that I can more confidently ask people to
>> relax the environment? Appreciate any clue.
>>
>
>
Re: The ports needed for ambari and hadoop installation
Posted by Aaron Bossert <aa...@punchcyber.com>.
Lian,
Technically, you don’t need any internet access to run an HDP cluster. You will, however need to have the appropriate repos hosted on your internal network in order to get set up and do periodic updates.
The ports required for every HDP component are in the Hortonworks documentation: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_reference/content/reference_chap2.html
Sent from my iPhone
> On Mar 20, 2018, at 00:52, Lian Jiang <ji...@gmail.com> wrote:
>
> I want to re-raise this question since I have not got satisfying answers. Is there any document for the required ports and internet access? Thanks a lot.
>
>> On Mon, Mar 5, 2018 at 1:34 PM, Lian Jiang <ji...@gmail.com> wrote:
>> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in a secure environment which limits the ingress/egress ports and the destinations/sources of internet traffic. For example, the hosts in this environment only open 22, 443 ports and they can only access website A, B.
>>
>> To setup a hadoop cluster in such an environment, I need to know below so that ambari can work:
>>
>> 1. which ports need to be open.
>> 2. which destinations/sources of internet traffic need to be permitted.
>>
>> Other than searching document online and try-fail-try, is there a way to get such information reliably so that I can more confidently ask people to relax the environment? Appreciate any clue.
>
Re: The ports needed for ambari and hadoop installation
Posted by Lian Jiang <ji...@gmail.com>.
I want to re-raise this question since I have not got satisfying answers.
Is there any document for the required ports and internet access? Thanks a
lot.
On Mon, Mar 5, 2018 at 1:34 PM, Lian Jiang <ji...@gmail.com> wrote:
> I need to setup a hadoop cluster (using HDP 2.6, ambari and blueprint) in
> a secure environment which limits the ingress/egress ports and the
> destinations/sources of internet traffic. For example, the hosts in this
> environment only open 22, 443 ports and they can only access website A, B.
>
> To setup a hadoop cluster in such an environment, I need to know below so
> that ambari can work:
>
> 1. which ports need to be open.
> 2. which destinations/sources of internet traffic need to be permitted.
>
> Other than searching document online and try-fail-try, is there a way to
> get such information reliably so that I can more confidently ask people to
> relax the environment? Appreciate any clue.
>