You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gearpump.apache.org by "Timea Magyar (JIRA)" <ji...@apache.org> on 2017/10/11 10:13:02 UTC

[jira] [Updated] (GEARPUMP-356) Launch of Gearpump on Hadoop/Yarn not possible if cluster protected by firewall

     [ https://issues.apache.org/jira/browse/GEARPUMP-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Timea Magyar updated GEARPUMP-356:
----------------------------------
    Summary: Launch of Gearpump on Hadoop/Yarn not possible if cluster protected by firewall  (was: Launch of Gearpump on Hadoop/Yarn not possible of cluster protected by firewall)

> Launch of Gearpump on Hadoop/Yarn not possible if cluster protected by firewall
> -------------------------------------------------------------------------------
>
>                 Key: GEARPUMP-356
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-356
>             Project: Apache Gearpump
>          Issue Type: Bug
>          Components: hadoop, security, yarn
>    Affects Versions: 0.8.4
>            Reporter: Timea Magyar
>             Fix For: 0.8.4
>
>
> Launching Gearpump on a Hadoop/Yarn cluster protected by a firewall from an edge node outside of the cluster communication will fail.
> When launching Gearpump / submitting a Gearpump application the client side residing on the above mentioned edge node has to establish communication with 4 components:
> 1. the YarnAppMaster in order to be able to retrieve/resolve an active configuration file (via tcp)
> 2. the Gearpump master(s) (via tcp)
> 3. the JarStoreServer (via http) to transmit the application jar file to be submitted
> 4. the Gearpump AppMaster of the respective gearpump application to be submitted to send in tasks/requests
> In all four cases the ports used by the above mentioned components have to be open, otherwise communication will fail. 
> Currently the config parameter "akka.remote.netty.tcp.port" is set to 0, meaning that all ports assigned for an actorsystem defined in Gearpump are random and can be anything between  1024-65535
> There is no configuration based way to set the a fixed port in the above four cases.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)