You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by ey...@apache.org on 2019/02/23 00:15:12 UTC
[hadoop] branch trunk updated: YARN-9244. Document docker registry
deployment with direct S3 driver. Contributed by Suma Shivaprasad
This is an automated email from the ASF dual-hosted git repository.
eyang pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 05bce33 YARN-9244. Document docker registry deployment with direct S3 driver. Contributed by Suma Shivaprasad
05bce33 is described below
commit 05bce33d6e8b46c416a37b8d12fd84eb53474d6d
Author: Eric Yang <ey...@apache.org>
AuthorDate: Fri Feb 22 19:13:52 2019 -0500
YARN-9244. Document docker registry deployment with direct S3 driver.
Contributed by Suma Shivaprasad
---
.../src/site/markdown/DockerContainers.md | 67 ++++++++++++++++++++++
1 file changed, 67 insertions(+)
diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/DockerContainers.md b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/DockerContainers.md
index 135a0fc..4d55877 100644
--- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/DockerContainers.md
+++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/DockerContainers.md
@@ -801,6 +801,73 @@ When docker-registry application reaches STABLE state in YARN, user can push or
### Docker Registry on S3
Docker Registry provides its own S3 driver and YAML configuration. YARN service configuration can generate YAML template, and enable direct Docker Registry to S3 storage. This option is the top choice for deploying Docker Trusted Registry on AWS.
+Configuring Docker registry storage driver to S3 requires mounting /etc/docker/registry/config.yml file (through YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS), which needs to configure an S3 bucket with its corresponding accesskey and secretKey.
+
+Sample config.yml
+```
+version: 0.1
+log:
+ fields:
+ service: registry
+http:
+ addr: :5000
+storage:
+ cache:
+ blobdescriptor: inmemory
+ s3:
+ accesskey: #AWS_KEY#
+ secretkey: #AWS_SECRET#
+ region: #AWS_REGION#
+ bucket: #AWS_BUCKET#
+ encrypt: #ENCRYPT#
+ secure: #SECURE#
+ chunksize: 5242880
+ multipartcopychunksize: 33554432
+ multipartcopymaxconcurrency: 100
+ multipartcopythresholdsize: 33554432
+ rootdirectory: #STORAGE_PATH#
+```
+
+Docker Registry can be started using YARN service:
+registry.json
+
+```
+{
+ "name": "docker-registry",
+ "version": "1.0",
+ "kerberos_principal" : {
+ "principal_name" : "registry/_HOST@EXAMPLE.COM",
+ "keytab" : "file:///etc/security/keytabs/registry.service.keytab"
+ },
+ "components" :
+ [
+ {
+ "name": "registry",
+ "number_of_containers": 1,
+ "artifact": {
+ "id": "registry:latest",
+ "type": "DOCKER"
+ },
+ "resource": {
+ "cpus": 1,
+ "memory": "256"
+ },
+ "run_privileged_container": true,
+ "configuration": {
+ "env": {
+ "YARN_CONTAINER_RUNTIME_DOCKER_RUN_OVERRIDE_DISABLE":"true",
+ "YARN_CONTAINER_RUNTIME_DOCKER_MOUNTS":"<path to config.yml>:/etc/docker/registry/config.yml",
+ },
+ "properties": {
+ "docker.network": "host"
+ }
+ }
+ }
+ ]
+}
+```
+
+For further details and parameters that could be configured in the S3 storage driver, please refer https://docs.docker.com/registry/storage-drivers/s3/.
### Docker Registry with CSI Driver
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org