You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@falcon.apache.org by so...@apache.org on 2015/10/21 20:31:32 UTC
falcon git commit: FALCON-1485 Add documentation for data transfer
details of filesystem replication. Contributed by Peeyush Bishnoi
Repository: falcon
Updated Branches:
refs/heads/0.8 432f8b0d7 -> 02b57221b
FALCON-1485 Add documentation for data transfer details of filesystem replication. Contributed by Peeyush Bishnoi
Project: http://git-wip-us.apache.org/repos/asf/falcon/repo
Commit: http://git-wip-us.apache.org/repos/asf/falcon/commit/02b57221
Tree: http://git-wip-us.apache.org/repos/asf/falcon/tree/02b57221
Diff: http://git-wip-us.apache.org/repos/asf/falcon/diff/02b57221
Branch: refs/heads/0.8
Commit: 02b57221bf0db321cb77c1dbe6176fe9dd3f4840
Parents: 432f8b0
Author: Sowmya Ramesh <sr...@hortonworks.com>
Authored: Wed Oct 21 11:31:27 2015 -0700
Committer: Sowmya Ramesh <sr...@hortonworks.com>
Committed: Wed Oct 21 11:31:27 2015 -0700
----------------------------------------------------------------------
CHANGES.txt | 2 ++
docs/src/site/twiki/FalconDocumentation.twiki | 10 ++++++++++
docs/src/site/twiki/Recipes.twiki | 4 ++++
3 files changed, 16 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/falcon/blob/02b57221/CHANGES.txt
----------------------------------------------------------------------
diff --git a/CHANGES.txt b/CHANGES.txt
index 5d6b994..2b15d82 100755
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -6,6 +6,8 @@ Trunk (Unreleased)
FALCON-1401 MetadataMappingService fails to add an edge for a process instance(Pallavi Rao)
NEW FEATURES
+ FALCON-1485 Add documentation for data transfer details of filesystem replication(Peeyush Bishnoi via Sowmya Ramesh)
+
FALCON-1315 Update falcon ui for HiveDR, secure clusters and bug fixes(Armando Reyna/Venkat Ranganathan via Sowmya Ramesh)
FALCON-1102 Gather data transfer details of filesystem replication(Peeyush Bishnoi via Sowmya Ramesh)
http://git-wip-us.apache.org/repos/asf/falcon/blob/02b57221/docs/src/site/twiki/FalconDocumentation.twiki
----------------------------------------------------------------------
diff --git a/docs/src/site/twiki/FalconDocumentation.twiki b/docs/src/site/twiki/FalconDocumentation.twiki
index 26a11e4..f384a42 100644
--- a/docs/src/site/twiki/FalconDocumentation.twiki
+++ b/docs/src/site/twiki/FalconDocumentation.twiki
@@ -321,6 +321,16 @@ replication instance delays. If the frequency of the feed is hours(2) and delay
instance will run every 2 hours and replicates data with an offset of 1 hour, i.e. at 09:00 UTC, feed instance which
is eligible for replication is 08:00; and 11:00 UTC, feed instance of 10:00 UTC is eligible and so on.
+If it is required to capture the feed replication metrics like TIMETAKEN, COPY, BYTESCOPIED, set the parameter "job.counter" to "true"
+in feed entity properties section. Captured metrics from instance will be populated to the GraphDB for display on UI.
+
+*Example:*
+<verbatim>
+<properties>
+ <property name="job.counter" value="true" />
+</properties>
+</verbatim>
+
---+++ Where is the feed path defined for File System Storage?
It's defined in the feed xml within the location tag.
http://git-wip-us.apache.org/repos/asf/falcon/blob/02b57221/docs/src/site/twiki/Recipes.twiki
----------------------------------------------------------------------
diff --git a/docs/src/site/twiki/Recipes.twiki b/docs/src/site/twiki/Recipes.twiki
index c6cfec3..ea29d94 100644
--- a/docs/src/site/twiki/Recipes.twiki
+++ b/docs/src/site/twiki/Recipes.twiki
@@ -62,6 +62,10 @@ Recipe template will have <workflow name="##workflow.name##">. Recipe tool will
and replace it with the property value "hdfs-dr-workflow". Substituted template will have <workflow name="hdfs-dr-workflow">
</verbatim>
+---++ Metrics
+HDFS DR recipes will capture the replication metrics like TIMETAKEN, COPY, BYTESCOPIED for an instance and populate to the
+GraphDB for display on UI.
+
---++ Managing the scheduled recipe process
* Scheduled recipe process is similar to regular process
* List : falcon entity -type process -name <recipe-process-name> -list