You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by Josh Wills <jw...@cloudera.com> on 2012/11/26 22:37:15 UTC

Review Request: In-memory support for secondary sorts

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/8228/
-----------------------------------------------------------

Review request for crunch.


Description
-------

Hack that uses different strategies for aggregating key-value pairs in the in-memory implementation based on the GroupingOptions.


This addresses bug CRUNCH-120.
    https://issues.apache.org/jira/browse/CRUNCH-120


Diffs
-----

  crunch/src/main/java/org/apache/crunch/GroupingOptions.java e58b666 
  crunch/src/main/java/org/apache/crunch/impl/mem/collect/MemGroupedTable.java 1f39632 
  crunch/src/main/java/org/apache/crunch/impl/mem/collect/Shuffler.java PRE-CREATION 
  crunch/src/test/java/org/apache/crunch/lib/SecondarySortTest.java PRE-CREATION 

Diff: https://reviews.apache.org/r/8228/diff/


Testing
-------

Unit testing, as appropriate for the in-memory impl.


Thanks,

Josh Wills