You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Navina Ramesh <nr...@linkedin.com> on 2015/07/14 23:09:02 UTC
Re: Review Request 35241: refactoring the code for coordinator stream
writer
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/35241/#review90271
-----------------------------------------------------------
Lgtm!
samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamWriter.java (line 49)
<https://reviews.apache.org/r/35241/#comment145198>
Can you get rid of the factory instance and just do new CoordinatoryStreamSystemFactory().getCoordinatorStreamSystemProducer(... ?
samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamWriter.java (line 73)
<https://reviews.apache.org/r/35241/#comment145196>
typo -> "set-confing"
samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamWriter.java (line 81)
<https://reviews.apache.org/r/35241/#comment145197>
We should validate the config keys & values (if possible) in the future. Can you please add this as TODO here?
samza-core/src/main/scala/org/apache/samza/coordinator/stream/CoordinatorStreamWriterCommandLine.scala (line 56)
<https://reviews.apache.org/r/35241/#comment145199>
Simpler to follow a pattern like:
{code}
if(option.has(messageKey))
return option.valueOf(meesageKey)
else
return null
{code}
This way you can also avoid using "var".
samza-core/src/test/java/org/apache/samza/coordinator/stream/MockCoordinatorStreamSystemFactory.java (line 26)
<https://reviews.apache.org/r/35241/#comment143275>
Can you revert this import? We prefer to import only specific class that are being used as opposed to the entire package.
samza-core/src/test/java/org/apache/samza/coordinator/stream/MockCoordinatorStreamSystemFactory.java (line 107)
<https://reviews.apache.org/r/35241/#comment145210>
start & stop inverse of each other. Do you really need both the flags? :)
samza-core/src/test/java/org/apache/samza/coordinator/stream/TestCoordinatorStreamWriter.java (line 66)
<https://reviews.apache.org/r/35241/#comment145212>
Is it possible to simplify Lines 59-65? Looks like you are doing a null check in Line 61 and then, creating another handle for the field in Line 64.
- Navina Ramesh
On June 29, 2015, 11:08 p.m., Shadi A. Noghabi wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/35241/
> -----------------------------------------------------------
>
> (Updated June 29, 2015, 11:08 p.m.)
>
>
> Review request for samza, Yi Pan (Data Infrastructure), Navina Ramesh, and Naveen Somasundaram.
>
>
> Repository: samza
>
>
> Description
> -------
>
> In order to be able to change configurations while a job is running, a tool for writing a message to the coordinator stream is needed. This code targets creating such a tool that can write messages to the coordinator stream after the bootstrap of the job. This code is related to the SAMZA-704 JIRA.
>
>
> To run the code use the following command:
>
> {path to samza deployment}/samza/bin/run-coordinator-stream-writer.sh --config-factory={config-factory} --config-path={path to config file of a job} --type={type of the message} --key={[optional] key of the message} --value={[optional] value of the message}
>
>
> Diffs
> -----
>
> checkstyle/import-control.xml 3374f0c432e61ac4cda275377604cfd481f0cddf
> samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamMessage.java 6c1e488d00d8593d59c89b57e673e0b6b90fd7d2
> samza-core/src/main/java/org/apache/samza/coordinator/stream/CoordinatorStreamWriter.java PRE-CREATION
> samza-core/src/main/scala/org/apache/samza/coordinator/stream/CoordinatorStreamWriterCommandLine.scala PRE-CREATION
> samza-core/src/test/java/org/apache/samza/coordinator/stream/MockCoordinatorStreamSystemFactory.java 647cadb3a4e51bec8204197d77ad35a6b29afcec
> samza-core/src/test/java/org/apache/samza/coordinator/stream/TestCoordinatorStreamSystemProducer.java 68e32554c18f443565284b807f43f4a5b05afbce
> samza-core/src/test/java/org/apache/samza/coordinator/stream/TestCoordinatorStreamWriter.java PRE-CREATION
> samza-shell/src/main/bash/run-coordinator-stream-writer.sh PRE-CREATION
>
> Diff: https://reviews.apache.org/r/35241/diff/
>
>
> Testing
> -------
>
> To run the code use the following command:
>
> {path to samza deployment}/samza/bin/run-coordinator-stream-writer.sh --config-factory={config-factory} --config-path={path to config file of a job} --type={type of the message} --key={[optional] key of the message} --value={[optional] value of the message}
>
>
> Thanks,
>
> Shadi A. Noghabi
>
>