You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@singa.apache.org by wa...@apache.org on 2019/04/26 04:10:58 UTC
[incubator-singa] branch master updated: SINGA-433 Update the
website with benchmark figure
This is an automated email from the ASF dual-hosted git repository.
wangwei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-singa.git
The following commit(s) were added to refs/heads/master by this push:
new 9f64fd0 SINGA-433 Update the website with benchmark figure
9f64fd0 is described below
commit 9f64fd085d59ac636de87180a4dafd30085551bd
Author: Wang Wei <wa...@gmail.com>
AuthorDate: Fri Apr 26 12:09:58 2019 +0800
SINGA-433 Update the website with benchmark figure
and fix the format of some pages.
---
doc/_static/images/benchmark.png | Bin 0 -> 125210 bytes
doc/en/docs/benchmark.md | 33 +++++++++++++++++++++++++++++++++
examples/imagenet/densenet/README.md | 7 +------
examples/imagenet/googlenet/README.md | 11 ++---------
examples/imagenet/inception/README.md | 10 +---------
examples/imagenet/resnet/README.md | 10 ++--------
examples/imagenet/vgg/README.md | 6 ------
7 files changed, 39 insertions(+), 38 deletions(-)
diff --git a/doc/_static/images/benchmark.png b/doc/_static/images/benchmark.png
new file mode 100644
index 0000000..8182931
Binary files /dev/null and b/doc/_static/images/benchmark.png differ
diff --git a/doc/en/docs/benchmark.md b/doc/en/docs/benchmark.md
new file mode 100644
index 0000000..0cb793f
--- /dev/null
+++ b/doc/en/docs/benchmark.md
@@ -0,0 +1,33 @@
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+-->
+
+
+# Benchmark for Distributed training
+
+
+Workload: we use a deep convolutional neural network, [ResNet-50](https://github.com/apache/incubator-singa/blob/master/examples/autograd/resnet.py) as the application. ResNet-50 is has 50 convolution layers for image classification. It requires 3.8 GFLOPs to pass a single image (of size 224x224) through the network. The input image size is 224x224.
+
+
+Hardware: we use p2.8xlarge instances from AWS, each of which has 8 Nvidia Tesla K80 GPUs, 96 GB GPU memory in total, 32 vCPU, 488 GB main memory, 10 Gbps network bandwidth.
+
+Metric: we measure the time per iteration for different number of workers to evaluate the scalability of SINGA. The batch size is fixed to be 32 per GPU. Synchronous training scheme is applied. As a result, the effective batch size is $32N$, where N is the number of GPUs. We compare with a popular open source system which uses the parameter server topology. The first GPU is selected as the server.
+
+<img src="../_static/images/benchmark.png" align="center" width="500px"/>
+<br/>
+<span><strong>Scalability test. Bars are for the throughput; lines are for the communication cost.</strong></span>
\ No newline at end of file
diff --git a/examples/imagenet/densenet/README.md b/examples/imagenet/densenet/README.md
index 1ddef0c..5238ce9 100644
--- a/examples/imagenet/densenet/README.md
+++ b/examples/imagenet/densenet/README.md
@@ -16,12 +16,7 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: DenseNet models on ImageNet
-SINGA version: 1.1.1
-SINGA commit:
-license: https://github.com/pytorch/vision/blob/master/torchvision/models/densenet.py
----
+
# Image Classification using DenseNet
diff --git a/examples/imagenet/googlenet/README.md b/examples/imagenet/googlenet/README.md
index 4a1335b..a1ea8bd 100644
--- a/examples/imagenet/googlenet/README.md
+++ b/examples/imagenet/googlenet/README.md
@@ -16,19 +16,12 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: GoogleNet on ImageNet
-SINGA version: 1.0.1
-SINGA commit: 8c990f7da2de220e8a012c6a8ecc897dc7532744
-parameter_url: https://s3-ap-southeast-1.amazonaws.com/dlfile/bvlc_googlenet.tar.gz
-parameter_sha1: 0a88e8948b1abca3badfd8d090d6be03f8d7655d
-license: unrestricted https://github.com/BVLC/caffe/tree/master/models/bvlc_googlenet
----
+
# Image Classification using GoogleNet
-In this example, we convert GoogleNet trained on Caffe to SINGA for image classification.
+In this example, we convert GoogleNet trained on Caffe to SINGA for image classification. Tested on [SINGA commit](8c990f7da2de220e8a012c6a8ecc897dc7532744) with [the parameters](https://s3-ap-southeast-1.amazonaws.com/dlfile/bvlc_googlenet.tar.gz).
## Instructions
diff --git a/examples/imagenet/inception/README.md b/examples/imagenet/inception/README.md
index 0f5c317..54aaaa1 100644
--- a/examples/imagenet/inception/README.md
+++ b/examples/imagenet/inception/README.md
@@ -16,18 +16,10 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: Inception V4 on ImageNet
-SINGA version: 1.1.1
-SINGA commit:
-parameter_url: https://s3-ap-southeast-1.amazonaws.com/dlfile/inception_v4.tar.gz
-parameter_sha1: 5fdd6f5d8af8fd10e7321d9b38bb87ef14e80d56
-license: https://github.com/tensorflow/models/tree/master/slim
----
# Image Classification using Inception V4
-In this example, we convert Inception V4 trained on Tensorflow to SINGA for image classification.
+In this example, we convert Inception V4 trained on Tensorflow to SINGA for image classification. Tested on SINGA version 1.1.1 with [parameters pretrained by tensorflow](https://s3-ap-southeast-1.amazonaws.com/dlfile/inception_v4.tar.gz).
## Instructions
diff --git a/examples/imagenet/resnet/README.md b/examples/imagenet/resnet/README.md
index 75fb215..eb317b8 100644
--- a/examples/imagenet/resnet/README.md
+++ b/examples/imagenet/resnet/README.md
@@ -16,18 +16,12 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: Resnets on ImageNet
-SINGA version: 1.1
-SINGA commit: 45ec92d8ffc1fa1385a9307fdf07e21da939ee2f
-parameter_url: https://s3-ap-southeast-1.amazonaws.com/dlfile/resnet/resnet-18.tar.gz
-license: Apache V2, https://github.com/facebook/fb.resnet.torch/blob/master/LICENSE
----
+
# Image Classification using Residual Networks
-In this example, we convert Residual Networks trained on [Torch](https://github.com/facebook/fb.resnet.torch) to SINGA for image classification.
+In this example, we convert Residual Networks trained on [Torch](https://github.com/facebook/fb.resnet.torch) to SINGA for image classification. Tested on [SINGA commit] with the [parameters pretrained by Torch](https://s3-ap-southeast-1.amazonaws.com/dlfile/resnet/resnet-18.tar.gz)
## Instructions
diff --git a/examples/imagenet/vgg/README.md b/examples/imagenet/vgg/README.md
index 12aeacc..dbf7ccd 100644
--- a/examples/imagenet/vgg/README.md
+++ b/examples/imagenet/vgg/README.md
@@ -16,12 +16,6 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: VGG models on ImageNet
-SINGA version: 1.1.1
-SINGA commit:
-license: https://github.com/pytorch/vision/blob/master/torchvision/models/vgg.py
----
# Image Classification using VGG