You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by pavan kumar kolamuri <pa...@gmail.com> on 2016/03/08 08:36:07 UTC
Re: Review Request 43829: Effective time in Entity updates.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43829/#review122283
-----------------------------------------------------------
client/src/main/java/org/apache/falcon/cli/FalconEntityCLI.java (line 126)
<https://reviews.apache.org/r/43829/#comment184237>
Description is not clear. Can you please change it
client/src/main/java/org/apache/falcon/client/FalconClient.java (line 405)
<https://reviews.apache.org/r/43829/#comment184238>
StringUtilsisBlank here also please
common/src/main/java/org/apache/falcon/entity/ProcessHelper.java (line 99)
<https://reviews.apache.org/r/43829/#comment184469>
Null check required right ?
common/src/main/java/org/apache/falcon/update/UpdateHelper.java (line 140)
<https://reviews.apache.org/r/43829/#comment184493>
What exactly key and value contains in checksumfile?
common/src/main/java/org/apache/falcon/update/UpdateHelper.java (line 144)
<https://reviews.apache.org/r/43829/#comment184497>
If user doesn't specify lib path in process, i think oozie will take lib path from workflowpath/lib. Can you please check once
common/src/main/java/org/apache/falcon/update/UpdateHelper.java (line 188)
<https://reviews.apache.org/r/43829/#comment184478>
why new configuration ?
common/src/main/java/org/apache/falcon/update/UpdateHelper.java (line 195)
<https://reviews.apache.org/r/43829/#comment184479>
Can you move getCheckSum to method
common/src/main/java/org/apache/falcon/update/UpdateHelper.java (line 215)
<https://reviews.apache.org/r/43829/#comment184495>
when dest can be null ? Shouldn't we throw exception at first when destination is null
oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java (line 1256)
<https://reviews.apache.org/r/43829/#comment184496>
Change method name as we are checking both workflow path and lib path.
prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java (line 320)
<https://reviews.apache.org/r/43829/#comment184470>
Why are you setting cluster start time as effective time ?
prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java (line 329)
<https://reviews.apache.org/r/43829/#comment184471>
isBlank
prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java (line 344)
<https://reviews.apache.org/r/43829/#comment184473>
This MyeffectiveTime is not used anywhere
prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java (line 1199)
<https://reviews.apache.org/r/43829/#comment184475>
Same method available in DateUtil use it.
- pavan kumar kolamuri
On Feb. 23, 2016, 12:43 p.m., sandeep samudrala wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43829/
> -----------------------------------------------------------
>
> (Updated Feb. 23, 2016, 12:43 p.m.)
>
>
> Review request for Falcon.
>
>
> Bugs: FALCON-1406
> https://issues.apache.org/jira/browse/FALCON-1406
>
>
> Repository: falcon-git
>
>
> Description
> -------
>
> FALCON-1406. Initial patch for effective time in EntityMutations
>
>
> Diffs
> -----
>
> client/src/main/java/org/apache/falcon/cli/FalconCLI.java a1f42ce
> client/src/main/java/org/apache/falcon/cli/FalconEntityCLI.java 6f9d620
> client/src/main/java/org/apache/falcon/client/AbstractFalconClient.java 4f86d9b
> client/src/main/java/org/apache/falcon/client/FalconClient.java 597f608
> common/src/main/java/org/apache/falcon/entity/EntityUtil.java 96befa1
> common/src/main/java/org/apache/falcon/entity/FileSystemStorage.java ece8b5d
> common/src/main/java/org/apache/falcon/entity/ProcessHelper.java bbfca68
> common/src/main/java/org/apache/falcon/update/UpdateHelper.java 6603bc6
> common/src/main/java/org/apache/falcon/workflow/WorkflowExecutionArgs.java 3363e1f
> common/src/main/java/org/apache/falcon/workflow/WorkflowExecutionContext.java 5866369
> common/src/main/java/org/apache/falcon/workflow/WorkflowJobEndNotificationService.java faea25c
> common/src/main/java/org/apache/falcon/workflow/engine/AbstractWorkflowEngine.java b899a58
> oozie/src/main/java/org/apache/falcon/oozie/ExportWorkflowBuilder.java a55656c
> oozie/src/main/java/org/apache/falcon/oozie/ImportWorkflowBuilder.java cae8497
> oozie/src/main/java/org/apache/falcon/oozie/OozieBundleBuilder.java 5f93cc2
> oozie/src/main/java/org/apache/falcon/oozie/OozieCoordinatorBuilder.java f555b64
> oozie/src/main/java/org/apache/falcon/oozie/OozieEntityBuilder.java a36ee79
> oozie/src/main/java/org/apache/falcon/oozie/OozieOrchestrationWorkflowBuilder.java e137e11
> oozie/src/main/java/org/apache/falcon/oozie/feed/FeedBundleBuilder.java c758411
> oozie/src/main/java/org/apache/falcon/oozie/feed/FeedReplicationWorkflowBuilder.java 5a62130
> oozie/src/main/java/org/apache/falcon/oozie/feed/FeedRetentionWorkflowBuilder.java b9e3848
> oozie/src/main/java/org/apache/falcon/oozie/process/HiveProcessWorkflowBuilder.java 9f9579c
> oozie/src/main/java/org/apache/falcon/oozie/process/OozieProcessWorkflowBuilder.java f93a599
> oozie/src/main/java/org/apache/falcon/oozie/process/PigProcessWorkflowBuilder.java a1a7c12
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessBundleBuilder.java 806810e
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionCoordinatorBuilder.java f5c9948
> oozie/src/main/java/org/apache/falcon/oozie/process/ProcessExecutionWorkflowBuilder.java 7d5b331
> oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java ebf23da
> oozie/src/test/java/org/apache/falcon/oozie/process/OozieProcessWorkflowBuilderTest.java 8d824ba
> prism/src/main/java/org/apache/falcon/resource/AbstractEntityManager.java 3ebe612
> prism/src/main/java/org/apache/falcon/resource/AbstractInstanceManager.java b35ae9a
> prism/src/main/java/org/apache/falcon/resource/proxy/SchedulableEntityManagerProxy.java 2dc727d
> rerun/src/main/java/org/apache/falcon/rerun/handler/RetryHandler.java fac32b3
> rerun/src/main/java/org/apache/falcon/rerun/queue/ActiveMQueue.java 3168c31
> scheduler/src/main/java/org/apache/falcon/workflow/engine/FalconWorkflowEngine.java 7ce2420
> unit/src/main/java/org/apache/falcon/unit/FalconUnitClient.java 37221f3
> unit/src/main/java/org/apache/falcon/unit/LocalSchedulableEntityManager.java 7398c8a
> unit/src/test/java/org/apache/falcon/unit/TestFalconUnit.java aaf2b37
> webapp/src/main/java/org/apache/falcon/resource/ConfigSyncService.java aa15dcc
> webapp/src/main/java/org/apache/falcon/resource/SchedulableEntityManager.java e97adff
> webapp/src/test/java/org/apache/falcon/cli/FalconCLIIT.java a1668c1
> webapp/src/test/java/org/apache/falcon/resource/EntityManagerJerseyIT.java f336422
>
> Diff: https://reviews.apache.org/r/43829/diff/
>
>
> Testing
> -------
>
> Bit of manual testing done. I will further beautify the code along with few more UTS(which I am fixing currently). Till then consider this for functional review.
>
>
> Thanks,
>
> sandeep samudrala
>
>