You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@singa.apache.org by ji...@apache.org on 2015/09/02 12:31:23 UTC
svn commit: r1700761 -
/incubator/singa/site/trunk/content/markdown/docs/data.md
Author: jinyang
Date: Wed Sep 2 10:31:23 2015
New Revision: 1700761
URL: http://svn.apache.org/r1700761
Log:
move to apache site: edit the link
Modified:
incubator/singa/site/trunk/content/markdown/docs/data.md
Modified: incubator/singa/site/trunk/content/markdown/docs/data.md
URL: http://svn.apache.org/viewvc/incubator/singa/site/trunk/content/markdown/docs/data.md?rev=1700761&r1=1700760&r2=1700761&view=diff
==============================================================================
--- incubator/singa/site/trunk/content/markdown/docs/data.md (original)
+++ incubator/singa/site/trunk/content/markdown/docs/data.md Wed Sep 2 10:31:23 2015
@@ -73,7 +73,6 @@ fields, which are different from the abo
}
{% endcomment %}
-
### DataShard creation
Users write code to convert their data into `Record`s and insert them into shards
@@ -114,6 +113,7 @@ following the subsequent steps.
g++ create_shard.cc user.pb.cc -std=c++11 -lsinga \
-ISINGA_ROOT/include -LSINGA_ROOT/.libs/ -Wl,-unresolved-symbols=ignore-in-shared-libs \
+
-Wl,-rpath=SINGA_ROOT/.libs/ -o create_shard.bin
@@ -122,6 +122,7 @@ following the subsequent steps.
./create_shard.bin <args>
+
### Example - CIFAR dataset
This example uses the [CIFAR-10 image dataset](http://www.cs.toronto.edu/~kriz/cifar.html) collected by Alex Krizhevsky.
@@ -181,7 +182,7 @@ to convert images in the binary files in
In addition, it computes average values (not shown here) of image pixels as another `Record`
which is directly serialized into *SINGA_ROOT/USER_DATA/image_mean.bin*.
The mean values will be used for preprocessing image features.
- {% comment %}
+
for (int itemid = 0; itemid < kCIFARBatchSize; ++itemid) {
const string& pixels = image->pixel();
for(int i=0; i<kCIFARImageNBytes; i++)
@@ -190,7 +191,6 @@ to convert images in the binary files in
}
for(int i=0; i<kCIFARImageNBytes; i++)
mean.set_data(i, mean.data(i)/count);
- {% endcomment %}
4. Compile and run the program. SINGA provides an example Makefile that contains instructions
for compiling the source code and linking it with *libsinga.so*. Users just execute the following command.
@@ -219,6 +219,7 @@ Data shards will be generated into *mnis
$ make create
+
## LMDB
To be filled soon.