You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@giraph.apache.org by jg...@apache.org on 2011/10/08 02:26:03 UTC
svn commit: r1180282 - in /incubator/giraph/trunk: CHANGELOG README
src/site/xdoc/index.xml
Author: jghoman
Date: Sat Oct 8 00:26:01 2011
New Revision: 1180282
URL: http://svn.apache.org/viewvc?rev=1180282&view=rev
Log:
GIRAPH-44: Add documentation about counter limits in Hadoop 0.203+. Contributed by Mitul Tiwari.
Modified:
incubator/giraph/trunk/CHANGELOG
incubator/giraph/trunk/README
incubator/giraph/trunk/src/site/xdoc/index.xml
Modified: incubator/giraph/trunk/CHANGELOG
URL: http://svn.apache.org/viewvc/incubator/giraph/trunk/CHANGELOG?rev=1180282&r1=1180281&r2=1180282&view=diff
==============================================================================
--- incubator/giraph/trunk/CHANGELOG (original)
+++ incubator/giraph/trunk/CHANGELOG Sat Oct 8 00:26:01 2011
@@ -2,6 +2,9 @@ Giraph Change Log
Release 0.70.0 - unreleased
+ GIRAPH-44. Add documentation about counter limits in Hadoop 0.203+.
+ (mtiwari via jghoman)
+
GIRAPH-12: Investigate communication improvements. (hyunsik)
GIRAPH-46: Race condition on superstep 1 with RPC servers not
Modified: incubator/giraph/trunk/README
URL: http://svn.apache.org/viewvc/incubator/giraph/trunk/README?rev=1180282&r1=1180281&r2=1180282&view=diff
==============================================================================
--- incubator/giraph/trunk/README (original)
+++ incubator/giraph/trunk/README Sat Oct 8 00:26:01 2011
@@ -75,3 +75,12 @@ additional arguments '-Dhadoop=facebook'
'hadoop_facebook' as well as a location for the hadoop core jar file. An
example compilation command is 'mvn -Dhadoop=facebook
-Dhadoop.jar.path=/tmp/hadoop-0.20.1-core.jar compile'.
+
+
+Notes:
+Counter limit: In Hadoop 0.20.203.0 onwards, there is a limit on the number of
+counters one can use, which is set to 120 by default. This limit restricts the
+number of iterations/supersteps possible in Giraph. This limit can be increased
+by setting a parameter "mapreduce.job.counters.limit" in job tracker's config
+file mapred-site.xml.
+
Modified: incubator/giraph/trunk/src/site/xdoc/index.xml
URL: http://svn.apache.org/viewvc/incubator/giraph/trunk/src/site/xdoc/index.xml?rev=1180282&r1=1180281&r2=1180282&view=diff
==============================================================================
--- incubator/giraph/trunk/src/site/xdoc/index.xml (original)
+++ incubator/giraph/trunk/src/site/xdoc/index.xml Sat Oct 8 00:26:01 2011
@@ -66,5 +66,8 @@ under the License.
'hadoop_non_secure'. An example compilation command is
'mvn -Dhadoop=non_secure compile'.</p>
</section>
+ <section name="Notes">
+ Counter limit: In Hadoop 0.20.203.0 onwards, there is a limit on the number of counters one can use, which is set to 120 by default. This limit restricts the number of iterations/supersteps possible in Giraph. This limit can be increased by setting a parameter "mapreduce.job.counters.limit" in job tracker's config file mapred-site.xml.
+ </section>
</body>
</document>