You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pig.apache.org by th...@apache.org on 2011/05/16 18:08:35 UTC

svn commit: r1103780 - in /pig/trunk: CHANGES.txt src/docs/src/documentation/content/xdocs/perf.xml src/org/apache/pig/Main.java

Author: thejas
Date: Mon May 16 16:08:35 2011
New Revision: 1103780

URL: http://svn.apache.org/viewvc?rev=1103780&view=rev
Log:
PIG-2076: update documentation, help command with correct default value of pig.cachedbag.memusage 

Modified:
    pig/trunk/CHANGES.txt
    pig/trunk/src/docs/src/documentation/content/xdocs/perf.xml
    pig/trunk/src/org/apache/pig/Main.java

Modified: pig/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/pig/trunk/CHANGES.txt?rev=1103780&r1=1103779&r2=1103780&view=diff
==============================================================================
--- pig/trunk/CHANGES.txt (original)
+++ pig/trunk/CHANGES.txt Mon May 16 16:08:35 2011
@@ -224,6 +224,9 @@ PIG-1696: Performance: Use System.arrayc
 
 BUG FIXES
 
+PIG-2076: update documentation, help command with correct default value 
+ of pig.cachedbag.memusage (thejas)
+
 PIG-2072: NPE when udf has project-star argument and input schema is null (thejas)
 
 PIG-2075: Bring back TestNewPlanPushUpFilter (daijy)

Modified: pig/trunk/src/docs/src/documentation/content/xdocs/perf.xml
URL: http://svn.apache.org/viewvc/pig/trunk/src/docs/src/documentation/content/xdocs/perf.xml?rev=1103780&r1=1103779&r2=1103780&view=diff
==============================================================================
--- pig/trunk/src/docs/src/documentation/content/xdocs/perf.xml (original)
+++ pig/trunk/src/docs/src/documentation/content/xdocs/perf.xml Mon May 16 16:08:35 2011
@@ -149,7 +149,7 @@ D = foreach B generate group, MIN (A.gpa
 
 <p>Pig allocates a fix amount of memory to store bags and spills to disk as soon as the memory limit is reached. This is very similar to how Hadoop decides when to spill data accumulated by the combiner. </p>
 
-<p>The amount of memory allocated to bags is determined by pig.cachedbag.memusage; the default is set to 10% of available memory. Note that this memory is shared across all large bags used by the application.</p>
+<p>The amount of memory allocated to bags is determined by pig.cachedbag.memusage; the default is set to 20% (0.2) of available memory. Note that this memory is shared across all large bags used by the application.</p>
 
 </section> 
 

Modified: pig/trunk/src/org/apache/pig/Main.java
URL: http://svn.apache.org/viewvc/pig/trunk/src/org/apache/pig/Main.java?rev=1103780&r1=1103779&r2=1103780&view=diff
==============================================================================
--- pig/trunk/src/org/apache/pig/Main.java (original)
+++ pig/trunk/src/org/apache/pig/Main.java Mon May 16 16:08:35 2011
@@ -785,7 +785,7 @@ public static void printProperties(){
         System.out.println("        aggregate.warning=true|false; default is true. If true, prints count of warnings");
         System.out.println("            of each type rather than logging each warning.");
         System.out.println("    Performance tuning:");
-        System.out.println("        pig.cachedbag.memusage=<mem fraction>; default is 0.1 (10% of all memory).");
+        System.out.println("        pig.cachedbag.memusage=<mem fraction>; default is 0.2 (20% of all memory).");
 	System.out.println("            Note that this memory is shared across all large bags used by the application.");     	
         System.out.println("        pig.skewedjoin.reduce.memusagea=<mem fraction>; default is 0.3 (30% of all memory).");
         System.out.println("            Specifies the fraction of heap available for the reducer to perform the join.");