You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2019/01/02 23:45:00 UTC

[jira] [Commented] (YARN-9003) Support multi-homed network for docker container

    [ https://issues.apache.org/jira/browse/YARN-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732523#comment-16732523 ] 

Eric Yang commented on YARN-9003:
---------------------------------

Docker inspect shows network settings that looks like this:
{code}
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "ddcbd61e029890244881abccfa7f8c48950c06a5d3ebb3f44077c19052fb0a6a",
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "Ports": {
                "8080/tcp": [
                    {
                        "HostIp": "0.0.0.0",
                        "HostPort": "32919"
                    }
                ]
            },
            "SandboxKey": "/var/run/docker/netns/ddcbd61e0298",
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": "",
            "Networks": {
                "hadoop": {
                    "IPAMConfig": null,
                    "Links": null,
                    "Aliases": [
                        "89bd4a438ee4"
                    ],
                    "NetworkID": "ed7e1ebae26c91cb9ce4e475b1d9e662ce867c7bacf15090b4c124276d82aa17",
                    "EndpointID": "663f1777832f53be0c4206d426b84cd8f2bfebbdf829da5096d4b12cce609335",
                    "Gateway": "",
                    "IPAddress": "10.0.0.2",
                    "IPPrefixLen": 24,
                    "IPv6Gateway": "",
                    "GlobalIPv6Address": "",
                    "GlobalIPv6PrefixLen": 0,
                    "MacAddress": "02:42:0a:00:00:02",
                    "DriverOpts": null
                }
            }
        }
{code}

Running ifconfig inside container looks like this:
{code}
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450
        inet 10.0.0.2  netmask 255.255.255.0  broadcast 0.0.0.0
        ether 02:42:0a:00:00:02  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 172.18.0.2  netmask 255.255.0.0  broadcast 0.0.0.0
        ether 02:42:ac:12:00:02  txqueuelen 0  (Ethernet)
        RX packets 6218  bytes 8770818 (8.3 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1647  bytes 112657 (110.0 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        loop  txqueuelen 0  (Local Loopback)
        RX packets 86  bytes 6883 (6.7 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 86  bytes 6883 (6.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
{code}

eth0 is docker overlay network (hadoop), and eth1 is bridge network.

> Support multi-homed network for docker container
> ------------------------------------------------
>
>                 Key: YARN-9003
>                 URL: https://issues.apache.org/jira/browse/YARN-9003
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>            Priority: Major
>              Labels: docker
>         Attachments: YARN-9003.001.patch, YARN-9003.002.patch, YARN-9003.003.patch
>
>
> Docker network can be defined as configuration properties - docker.network to setup docker container to connect to a specific network in YARN service.  Docker can run multi-homed network by specifying --net=bridge --net=private-net.  This is useful to expose small number of  front end container and ports, while the rest of the infrastructure runs in private network.  This task is to add support for specifying multiple docker networks to YARN service and docker support.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org