You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by "Yi Pan (Data Infrastructure)" <yi...@linkedin.com> on 2015/02/09 19:22:27 UTC
Review Request 30800: WIP: improving the manual operator interface

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30800/
-----------------------------------------------------------

Review request for samza, Chris Riccomini, Navina Ramesh, and Naveen Somasundaram.


Bugs: SAMZA-482
    https://issues.apache.org/jira/browse/SAMZA-482


Repository: samza


Description
-------

WIP: improving the manual operator interface
- Separated in-memory operator output collector vs the system stream message collector
- Added implementation of a in-memory output buffer collector
- Created manual operator classes to make random use case more intuitive


Diffs
-----

  samza-sql/src/main/java/org/apache/samza/sql/api/data/Relation.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/api/operators/ManualOperator.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/api/operators/Operator.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/api/operators/RelationOperator.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/api/operators/TupleOperator.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/data/OrderedRelationBuf.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperator.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorFactoryImpl.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorSpec.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/partition/PartitionOp.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/partition/PartitionSpec.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/relation/Join.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/relation/JoinSpec.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/relation/ManualJoin.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/stream/InsertStream.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/stream/InsertStreamSpec.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/window/BoundedTimeWindow.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/window/ManualFixedTimeWindow.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/window/WindowSpec.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/task/sql/BufferedOutputCollector.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/task/sql/OperatorMessageCollector.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/task/sql/SqlMessageCollector.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/task/sql/StoreMessageCollector.java PRE-CREATION 
  samza-sql/src/test/java/org/apache/samza/task/sql/RandomOperatorTask.java PRE-CREATION 
  samza-sql/src/test/java/org/apache/samza/task/sql/StreamSqlTask.java PRE-CREATION 

Diff: https://reviews.apache.org/r/30800/diff/


Testing
-------

./gradlew clean build passed


Thanks,

Yi Pan (Data Infrastructure)