You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@falcon.apache.org by sr...@apache.org on 2013/08/21 14:29:13 UTC

svn commit: r1516144 [3/5] - in /incubator/falcon: site/ site/0.3-incubating/ site/0.3-incubating/css/ site/0.3-incubating/docs/ site/0.3-incubating/images/ site/0.3-incubating/images/logos/ site/0.3-incubating/images/profiles/ site/0.3-incubating/img/...

Added: incubator/falcon/site/0.3-incubating/docs/OnBoarding.html
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/docs/OnBoarding.html?rev=1516144&view=auto
==============================================================================
--- incubator/falcon/site/0.3-incubating/docs/OnBoarding.html (added)
+++ incubator/falcon/site/0.3-incubating/docs/OnBoarding.html Wed Aug 21 12:29:11 2013
@@ -0,0 +1,324 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at Aug 20, 2013
+ | Rendered using Apache Maven Fluido Skin 1.3.0
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20130820" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Falcon - Contents</title>
+    <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" />
+    <link rel="stylesheet" href="../css/site.css" />
+    <link rel="stylesheet" href="../css/print.css" media="print" />
+
+      
+    <script type="text/javascript" src="../js/apache-maven-fluido-1.3.0.min.js"></script>
+
+    
+            </head>
+        <body class="topBarDisabled">
+          
+                        
+                    
+    
+        <div class="container">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../../index.html" id="bannerLeft">
+                                                                                                <img src="../images/falcon-logo.png"  alt="Falcon" width="200px" height="45px"/>
+                </a>
+                      </div>
+        <div class="pull-right">                  <a href="http://incubator.apache.org" id="bannerRight">
+                                                                                                <img src="../images/apache-incubator-logo.png"  alt="Apache Incubator"/>
+                </a>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="../index.html" title="Home">
+        Home</a>
+        </li>
+      <li class="divider ">/</li>
+        <li class="">Contents</li>
+        
+                
+                    
+      
+                                              
+    <li class="pull-right">              <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314429&version=12324423" class="externalLink" title="Released: 2013-08-15">
+        Released: 2013-08-15</a>
+  </li>
+
+        <li class="divider pull-right">|</li>
+      
+    <li class="pull-right">              <a href="http://www.apache.org/dist/incubator/falcon" class="externalLink" title="0.3-incubating">
+        0.3-incubating</a>
+  </li>
+
+                        </ul>
+      </div>
+
+      
+                
+        <div id="bodyColumn" >
+                                  
+            <div class="section"><h3>Contents<a name="Contents"></a></h3><p></p><ul><li><a href="#Onboarding Steps">Onboarding Steps</a></li><li><a href="#Sample Pipeline">Sample Pipeline</a></li></ul></div><div class="section"><h4>Onboarding Steps<a name="Onboarding_Steps"></a></h4><p></p><ul><li>Create cluster definition for the cluster, specifying name node, job tracker, workflow engine endpoint, messaging endpoint. Refer to <a href="./EntitySpecification.html">cluster definition</a> for details.</li><li>Create Feed definitions for each of the input and output specifying frequency, data path, ownership. Refer to <a href="./EntitySpecification.html">feed definition</a> for details.</li><li>Create Process definition for your job. Process defines configuration for the workflow job. Important attributes are frequency, inputs/outputs and workflow path. Refer to <a href="./EntitySpecification.html">process definition</a> for process details.</li><li>Define workflow for your job using t
 he workflow engine(only oozie is supported as of now). Refer <a class="externalLink" href="http://incubator.apache.org/oozie/docs/3.1.3/docs/WorkflowFunctionalSpec.html">Oozie Workflow Specification</a>. The libraries required for the workflow should be available in lib folder in workflow path.</li><li>Set-up workflow definition, libraries and referenced scripts on hadoop.</li><li>Submit cluster definition</li><li>Submit and schedule feed and process definitions</li></ul></div><div class="section"><h4>Sample Pipeline<a name="Sample_Pipeline"></a></h4></div><div class="section"><h5>Cluster   <a name="Cluster"></a></h5><p>Cluster definition that contains end points for name node, job tracker, oozie and jms server:</p><div class="source"><pre class="prettyprint">
+&lt;?xml version=&quot;1.0&quot;?&gt;
+&lt;!--
+    Cluster configuration
+  --&gt;
+&lt;cluster colo=&quot;ua2&quot; description=&quot;&quot; name=&quot;corp&quot; xmlns=&quot;uri:falcon:cluster:0.1&quot;
+    xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot;&gt;    
+    &lt;interfaces&gt;
+        &lt;interface type=&quot;readonly&quot; endpoint=&quot;hftp://name-node.com:50070&quot; version=&quot;0.20.2-cdh3u0&quot; /&gt;
+
+        &lt;interface type=&quot;write&quot; endpoint=&quot;hdfs://name-node.com:54310&quot; version=&quot;0.20.2-cdh3u0&quot; /&gt;
+
+        &lt;interface type=&quot;execute&quot; endpoint=&quot;job-tracker:54311&quot; version=&quot;0.20.2-cdh3u0&quot; /&gt;
+
+        &lt;interface type=&quot;workflow&quot; endpoint=&quot;http://oozie.com:11000/oozie/&quot; version=&quot;3.1.4&quot; /&gt;
+
+        &lt;interface type=&quot;messaging&quot; endpoint=&quot;tcp://jms-server.com:61616?daemon=true&quot; version=&quot;5.1.6&quot; /&gt;
+    &lt;/interfaces&gt;
+
+    &lt;locations&gt;
+        &lt;location name=&quot;staging&quot; path=&quot;/projects/falcon/staging&quot; /&gt;
+        &lt;location name=&quot;temp&quot; path=&quot;/tmp&quot; /&gt;
+        &lt;location name=&quot;working&quot; path=&quot;/projects/falcon/working&quot; /&gt;
+    &lt;/locations&gt;
+&lt;/cluster&gt;
+
+</pre></div></div><div class="section"><h5>Input Feed<a name="Input_Feed"></a></h5><p>Hourly feed that defines feed path, frequency, ownership and validity:</p><div class="source"><pre class="prettyprint">
+&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;
+&lt;!--
+    Hourly sample input data
+  --&gt;
+
+&lt;feed description=&quot;sample input data&quot; name=&quot;SampleInput&quot; xmlns=&quot;uri:falcon:feed:0.1&quot;
+    xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot;&gt;
+    &lt;groups&gt;group&lt;/groups&gt;
+
+    &lt;frequency&gt;hours(1)&lt;/frequency&gt;
+
+    &lt;late-arrival cut-off=&quot;hours(6)&quot; /&gt;
+
+    &lt;clusters&gt;
+        &lt;cluster name=&quot;corp&quot; type=&quot;source&quot;&gt;
+            &lt;validity start=&quot;2009-01-01T00:00Z&quot; end=&quot;2099-12-31T00:00Z&quot; timezone=&quot;UTC&quot; /&gt;
+            &lt;retention limit=&quot;months(24)&quot; action=&quot;delete&quot; /&gt;
+        &lt;/cluster&gt;
+    &lt;/clusters&gt;
+
+    &lt;locations&gt;
+        &lt;location type=&quot;data&quot; path=&quot;/projects/bootcamp/data/${YEAR}-${MONTH}-${DAY}-${HOUR}/SampleInput&quot; /&gt;
+        &lt;location type=&quot;stats&quot; path=&quot;/projects/bootcamp/stats/SampleInput&quot; /&gt;
+        &lt;location type=&quot;meta&quot; path=&quot;/projects/bootcamp/meta/SampleInput&quot; /&gt;
+    &lt;/locations&gt;
+
+    &lt;ACL owner=&quot;suser&quot; group=&quot;users&quot; permission=&quot;0755&quot; /&gt;
+
+    &lt;schema location=&quot;/none&quot; provider=&quot;none&quot; /&gt;
+&lt;/feed&gt;
+
+</pre></div></div><div class="section"><h5>Output Feed<a name="Output_Feed"></a></h5><p>Daily feed that defines feed path, frequency, ownership and validity:</p><div class="source"><pre class="prettyprint">
+&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;
+&lt;!--
+    Daily sample output data
+  --&gt;
+
+&lt;feed description=&quot;sample output data&quot; name=&quot;SampleOutput&quot; xmlns=&quot;uri:falcon:feed:0.1&quot;
+xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot;&gt;
+    &lt;groups&gt;group&lt;/groups&gt;
+
+    &lt;frequency&gt;days(1)&lt;/frequency&gt;
+
+    &lt;late-arrival cut-off=&quot;hours(6)&quot; /&gt;
+
+    &lt;clusters&gt;
+        &lt;cluster name=&quot;corp&quot; type=&quot;source&quot;&gt;
+            &lt;validity start=&quot;2009-01-01T00:00Z&quot; end=&quot;2099-12-31T00:00Z&quot; timezone=&quot;UTC&quot; /&gt;
+            &lt;retention limit=&quot;months(24)&quot; action=&quot;delete&quot; /&gt;
+        &lt;/cluster&gt;
+    &lt;/clusters&gt;
+
+    &lt;locations&gt;
+        &lt;location type=&quot;data&quot; path=&quot;/projects/bootcamp/output/${YEAR}-${MONTH}-${DAY}/SampleOutput&quot; /&gt;
+        &lt;location type=&quot;stats&quot; path=&quot;/projects/bootcamp/stats/SampleOutput&quot; /&gt;
+        &lt;location type=&quot;meta&quot; path=&quot;/projects/bootcamp/meta/SampleOutput&quot; /&gt;
+    &lt;/locations&gt;
+
+    &lt;ACL owner=&quot;suser&quot; group=&quot;users&quot; permission=&quot;0755&quot; /&gt;
+
+    &lt;schema location=&quot;/none&quot; provider=&quot;none&quot; /&gt;
+&lt;/feed&gt;
+
+</pre></div></div><div class="section"><h5>Process<a name="Process"></a></h5><p>Sample process which runs daily at 6th hour on corp cluster. It takes one input - <a href="./SampleInput.html">SampleInput</a> for the previous day(24 instances). It generates one output - <a href="./SampleOutput.html">SampleOutput</a> for previous day. The workflow is defined at /projects/bootcamp/workflow/workflow.xml. Any libraries available for the workflow should be at /projects/bootcamp/workflow/lib. The process also defines properties queueName, ssh.host, and fileTimestamp which are passed to the workflow. In addition, Falcon exposes the following properties to the workflow: nameNode, jobTracker(hadoop properties), input and output(Input/Output properties).</p><div class="source"><pre class="prettyprint">
+&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;
+&lt;!--
+    Daily sample process. Runs at 6th hour every day. Input - last day's hourly data. Generates output for yesterday
+ --&gt;
+&lt;process name=&quot;SampleProcess&quot;&gt;
+    &lt;cluster name=&quot;corp&quot; /&gt;
+
+    &lt;frequency&gt;days(1)&lt;/frequency&gt;
+
+    &lt;validity start=&quot;2012-04-03T06:00Z&quot; end=&quot;2022-12-30T00:00Z&quot; timezone=&quot;UTC&quot; /&gt;
+
+    &lt;inputs&gt;
+        &lt;input name=&quot;input&quot; feed=&quot;SampleInput&quot; start=&quot;yesterday(0,0)&quot; end=&quot;today(-1,0)&quot; /&gt;
+    &lt;/inputs&gt;
+
+    &lt;outputs&gt;
+            &lt;output name=&quot;output&quot; feed=&quot;SampleOutput&quot; instance=&quot;yesterday(0,0)&quot; /&gt;
+    &lt;/outputs&gt;
+
+    &lt;properties&gt;
+        &lt;property name=&quot;queueName&quot; value=&quot;reports&quot; /&gt;
+        &lt;property name=&quot;ssh.host&quot; value=&quot;host.com&quot; /&gt;
+        &lt;property name=&quot;fileTimestamp&quot; value=&quot;${coord:formatTime(coord:nominalTime(), 'yyyy-MM-dd')}&quot; /&gt;
+    &lt;/properties&gt;
+
+    &lt;workflow engine=&quot;oozie&quot; path=&quot;/projects/bootcamp/workflow&quot; /&gt;
+
+    &lt;retry policy=&quot;backoff&quot; delay=&quot;minutes(5)&quot; attempts=&quot;3&quot; /&gt;
+    
+    &lt;late-process policy=&quot;exp-backoff&quot; delay=&quot;hours(1)&quot;&gt;
+        &lt;late-input input=&quot;input&quot; workflow-path=&quot;/projects/bootcamp/workflow/lateinput&quot; /&gt;
+    &lt;/late-process&gt;
+&lt;/process&gt;
+
+</pre></div></div><div class="section"><h5>Oozie Workflow<a name="Oozie_Workflow"></a></h5><p>The sample user workflow contains 3 actions:</p><ul><li>Pig action - Executes pig script /projects/bootcamp/workflow/script.pig</li><li>concatenator - Java action that concatenates part files and generates a single file</li><li>file upload - ssh action that gets the concatenated file from hadoop and sends the file to a remote host</li></ul><div class="source"><pre class="prettyprint">
+&lt;workflow-app xmlns=&quot;uri:oozie:workflow:0.2&quot; name=&quot;sample-wf&quot;&gt;
+        &lt;start to=&quot;pig&quot; /&gt;
+
+        &lt;action name=&quot;pig&quot;&gt;
+                &lt;pig&gt;
+                        &lt;job-tracker&gt;${jobTracker}&lt;/job-tracker&gt;
+                        &lt;name-node&gt;${nameNode}&lt;/name-node&gt;
+                        &lt;prepare&gt;
+                                &lt;delete path=&quot;${output}&quot;/&gt;
+                        &lt;/prepare&gt;
+                        &lt;configuration&gt;
+                                &lt;property&gt;
+                                        &lt;name&gt;mapred.job.queue.name&lt;/name&gt;
+                                        &lt;value&gt;${queueName}&lt;/value&gt;
+                                &lt;/property&gt;
+                                &lt;property&gt;
+                                        &lt;name&gt;mapreduce.fileoutputcommitter.marksuccessfuljobs&lt;/name&gt;
+                                        &lt;value&gt;true&lt;/value&gt;
+                                &lt;/property&gt;
+                        &lt;/configuration&gt;
+                        &lt;script&gt;${nameNode}/projects/bootcamp/workflow/script.pig&lt;/script&gt;
+                        &lt;param&gt;input=${input}&lt;/param&gt;
+                        &lt;param&gt;output=${output}&lt;/param&gt;
+                        &lt;file&gt;lib/dependent.jar&lt;/file&gt;
+                &lt;/pig&gt;
+                &lt;ok to=&quot;concatenator&quot; /&gt;
+                &lt;error to=&quot;fail&quot; /&gt;
+        &lt;/action&gt;
+
+        &lt;action name=&quot;concatenator&quot;&gt;
+                &lt;java&gt;
+                        &lt;job-tracker&gt;${jobTracker}&lt;/job-tracker&gt;
+                        &lt;name-node&gt;${nameNode}&lt;/name-node&gt;
+                        &lt;prepare&gt;
+                                &lt;delete path=&quot;${nameNode}/projects/bootcamp/concat/data-${fileTimestamp}.csv&quot;/&gt;
+                        &lt;/prepare&gt;
+                        &lt;configuration&gt;
+                                &lt;property&gt;
+                                        &lt;name&gt;mapred.job.queue.name&lt;/name&gt;
+                                        &lt;value&gt;${queueName}&lt;/value&gt;
+                                &lt;/property&gt;
+                        &lt;/configuration&gt;
+                        &lt;main-class&gt;com.wf.Concatenator&lt;/main-class&gt;
+                        &lt;arg&gt;${output}&lt;/arg&gt;
+                        &lt;arg&gt;${nameNode}/projects/bootcamp/concat/data-${fileTimestamp}.csv&lt;/arg&gt;
+                &lt;/java&gt;
+                &lt;ok to=&quot;fileupload&quot; /&gt;
+                &lt;error to=&quot;fail&quot;/&gt;
+        &lt;/action&gt;
+                        
+        &lt;action name=&quot;fileupload&quot;&gt;
+                &lt;ssh&gt;
+                        &lt;host&gt;localhost&lt;/host&gt;
+                        &lt;command&gt;/tmp/fileupload.sh&lt;/command&gt;
+                        &lt;args&gt;${nameNode}/projects/bootcamp/concat/data-${fileTimestamp}.csv&lt;/args&gt;
+                        &lt;args&gt;${wf:conf(&quot;ssh.host&quot;)}&lt;/args&gt;
+                        &lt;capture-output/&gt;
+                &lt;/ssh&gt;
+                &lt;ok to=&quot;fileUploadDecision&quot; /&gt;
+                &lt;error to=&quot;fail&quot;/&gt;
+        &lt;/action&gt;
+
+        &lt;decision name=&quot;fileUploadDecision&quot;&gt;
+                &lt;switch&gt;
+                        &lt;case to=&quot;end&quot;&gt;
+                                ${wf:actionData('fileupload')['output'] == '0'}
+                        &lt;/case&gt;
+                        &lt;default to=&quot;fail&quot;/&gt;
+                &lt;/switch&gt;
+        &lt;/decision&gt;
+
+        &lt;kill name=&quot;fail&quot;&gt;
+                &lt;message&gt;Workflow failed, error message[${wf:errorMessage(wf:lastErrorNode())}]&lt;/message&gt;
+        &lt;/kill&gt;
+
+        &lt;end name=&quot;end&quot; /&gt;
+&lt;/workflow-app&gt;
+
+</pre></div></div><div class="section"><h5>File Upload Script<a name="File_Upload_Script"></a></h5><p>The script gets the file from hadoop, rsyncs the file to /tmp on remote host and deletes the file from hadoop</p><div class="source"><pre class="prettyprint">
+#!/bin/bash
+
+trap 'echo &quot;output=$?&quot;; exit $?' ERR INT TERM
+
+echo &quot;Arguments: $@&quot;
+SRCFILE=$1
+DESTHOST=$3
+
+FILENAME=`basename $SRCFILE`
+rm -f /tmp/$FILENAME
+hadoop fs -copyToLocal $SRCFILE /tmp/
+echo &quot;Copied $SRCFILE to /tmp&quot;
+
+rsync -ztv --rsh=ssh --stats /tmp/$FILENAME $DESTHOST:/tmp
+echo &quot;rsynced $FILENAME to $DESTUSER@$DESTHOST:$DESTFILE&quot;
+
+hadoop fs -rmr $SRCFILE
+echo &quot;Deleted $SRCFILE&quot;
+
+rm -f /tmp/$FILENAME
+echo &quot;output=0&quot;
+
+</pre></div></div>
+                  </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container">
+              <div class="row span12">Copyright &copy;                    2013
+                        <a href="http://www.apache.org">Apache Software Foundation</a>.
+            All Rights Reserved.      
+                    
+      </div>
+
+                          
+                <p id="poweredBy" class="pull-right">
+                          <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
+        <img class="builtBy" alt="Built by Maven" src="../images/logos/maven-feather.png" />
+      </a>
+              </p>
+        
+                </div>
+    </footer>
+  </body>
+</html>

Added: incubator/falcon/site/0.3-incubating/images/Architecture.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/Architecture.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/Architecture.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/EntityDependency.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/EntityDependency.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/EntityDependency.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/FeedSchedule.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/FeedSchedule.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/FeedSchedule.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/PrismSetup.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/PrismSetup.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/PrismSetup.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/ProcessSchedule.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/ProcessSchedule.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/ProcessSchedule.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/accessories-text-editor.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/accessories-text-editor.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/accessories-text-editor.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/add.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/add.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/add.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/apache-incubator-logo.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/apache-incubator-logo.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/apache-incubator-logo.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/apache-maven-project-2.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/apache-maven-project-2.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/apache-maven-project-2.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/application-certificate.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/application-certificate.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/application-certificate.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/close.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/close.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/close.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/contact-new.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/contact-new.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/contact-new.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/document-properties.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/document-properties.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/document-properties.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/drive-harddisk.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/drive-harddisk.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/drive-harddisk.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/falcon-logo.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/falcon-logo.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/falcon-logo.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/fix.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/fix.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/fix.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/icon_error_sml.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/icon_error_sml.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/icon_error_sml.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/icon_help_sml.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/icon_help_sml.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/icon_help_sml.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/icon_info_sml.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/icon_info_sml.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/icon_info_sml.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/icon_success_sml.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/icon_success_sml.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/icon_success_sml.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/icon_warning_sml.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/icon_warning_sml.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/icon_warning_sml.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/image-x-generic.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/image-x-generic.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/image-x-generic.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/internet-web-browser.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/internet-web-browser.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/internet-web-browser.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/logos/build-by-maven-black.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/logos/build-by-maven-black.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/logos/build-by-maven-black.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/logos/build-by-maven-white.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/logos/build-by-maven-white.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/logos/build-by-maven-white.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/logos/maven-feather.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/logos/maven-feather.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/logos/maven-feather.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/network-server.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/network-server.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/network-server.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/package-x-generic.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/package-x-generic.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/package-x-generic.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/profiles/pre-release.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/profiles/pre-release.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/profiles/pre-release.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/profiles/retired.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/profiles/retired.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/profiles/retired.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/profiles/sandbox.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/profiles/sandbox.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/profiles/sandbox.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/remove.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/remove.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/remove.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/rss.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/rss.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/rss.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/update.gif
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/update.gif?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/update.gif
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/images/window-new.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/images/window-new.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/images/window-new.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/img/glyphicons-halflings-white.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/img/glyphicons-halflings-white.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/img/glyphicons-halflings-white.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/img/glyphicons-halflings.png
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/img/glyphicons-halflings.png?rev=1516144&view=auto
==============================================================================
Binary file - no diff available.

Propchange: incubator/falcon/site/0.3-incubating/img/glyphicons-halflings.png
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: incubator/falcon/site/0.3-incubating/index.html
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/index.html?rev=1516144&view=auto
==============================================================================
--- incubator/falcon/site/0.3-incubating/index.html (added)
+++ incubator/falcon/site/0.3-incubating/index.html Wed Aug 21 12:29:11 2013
@@ -0,0 +1,97 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at Aug 20, 2013
+ | Rendered using Apache Maven Fluido Skin 1.3.0
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20130820" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Falcon - Contents</title>
+    <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" />
+    <link rel="stylesheet" href="./css/site.css" />
+    <link rel="stylesheet" href="./css/print.css" media="print" />
+
+      
+    <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script>
+
+    
+            </head>
+        <body class="topBarDisabled">
+          
+                        
+                    
+    
+        <div class="container">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../index.html" id="bannerLeft">
+                                                                                                <img src="images/falcon-logo.png"  alt="Falcon" width="200px" height="45px"/>
+                </a>
+                      </div>
+        <div class="pull-right">                  <a href="http://incubator.apache.org" id="bannerRight">
+                                                                                                <img src="images/apache-incubator-logo.png"  alt="Apache Incubator"/>
+                </a>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="index.html" title="Home">
+        Home</a>
+        </li>
+      <li class="divider ">/</li>
+        <li class="">Contents</li>
+        
+                
+                    
+      
+                                              
+    <li class="pull-right">              <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314429&version=12324423" class="externalLink" title="Released: 2013-08-15">
+        Released: 2013-08-15</a>
+  </li>
+
+        <li class="divider pull-right">|</li>
+      
+    <li class="pull-right">              <a href="http://www.apache.org/dist/incubator/falcon" class="externalLink" title="0.3-incubating">
+        0.3-incubating</a>
+  </li>
+
+                        </ul>
+      </div>
+
+      
+                
+        <div id="bodyColumn" >
+                                  
+            <div class="section"><h4>Contents<a name="Contents"></a></h4><p></p><ul><li><a href="./docs/InstallationSteps.html">Simple setup</a></li></ul><p></p><ul><li><a href="./docs/FalconArchitecture.html">Overview</a></li></ul><p></p><ul><li><a href="./docs/OnBoarding.html">On boarding</a></li></ul><p></p><ul><li><a href="./docs/EntitySpecification.html">Entity specification</a></li></ul><p></p><ul><li><a href="./docs/FalconCLI.html">CLI</a></li></ul></div>
+                  </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container">
+              <div class="row span12">Copyright &copy;                    2013
+                        <a href="http://www.apache.org">Apache Software Foundation</a>.
+            All Rights Reserved.      
+                    
+      </div>
+
+                          
+                <p id="poweredBy" class="pull-right">
+                          <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
+        <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
+      </a>
+              </p>
+        
+                </div>
+    </footer>
+  </body>
+</html>

Added: incubator/falcon/site/0.3-incubating/integration.html
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/integration.html?rev=1516144&view=auto
==============================================================================
--- incubator/falcon/site/0.3-incubating/integration.html (added)
+++ incubator/falcon/site/0.3-incubating/integration.html Wed Aug 21 12:29:11 2013
@@ -0,0 +1,97 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at Aug 21, 2013
+ | Rendered using Apache Maven Fluido Skin 1.3.0
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20130821" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Falcon - Continuous Integration</title>
+    <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" />
+    <link rel="stylesheet" href="./css/site.css" />
+    <link rel="stylesheet" href="./css/print.css" media="print" />
+
+      
+    <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script>
+
+    
+            </head>
+        <body class="topBarDisabled">
+          
+                        
+                    
+    
+        <div class="container">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../index.html" id="bannerLeft">
+                                                                                                <img src="images/falcon-logo.png"  alt="Falcon" width="200px" height="45px"/>
+                </a>
+                      </div>
+        <div class="pull-right">                  <a href="http://incubator.apache.org" id="bannerRight">
+                                                                                                <img src="images/apache-incubator-logo.png"  alt="Apache Incubator"/>
+                </a>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="index.html" title="Home">
+        Home</a>
+        </li>
+      <li class="divider ">/</li>
+        <li class="">Continuous Integration</li>
+        
+                
+                    
+      
+                                              
+    <li class="pull-right">              <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314429&version=12324423" class="externalLink" title="Released: 2013-08-15">
+        Released: 2013-08-15</a>
+  </li>
+
+        <li class="divider pull-right">|</li>
+      
+    <li class="pull-right">              <a href="http://www.apache.org/dist/incubator/falcon" class="externalLink" title="0.3-incubating">
+        0.3-incubating</a>
+  </li>
+
+                        </ul>
+      </div>
+
+      
+                
+        <div id="bodyColumn" >
+                                  
+            <div class="section"><h2>Overview<a name="Overview"></a></h2><a name="Overview"></a><p>This project uses <a class="externalLink" href="http://jenkins-ci.org/">Jenkins</a>.</p></div><div class="section"><h2>Access<a name="Access"></a></h2><a name="Access"></a><p>The following is a link to the continuous integration system used by the project.</p><div class="source"><pre class="prettyprint"><a class="externalLink" href="https://builds.apache.org/job/falcon">https://builds.apache.org/job/falcon</a></pre></div></div><div class="section"><h2>Notifiers<a name="Notifiers"></a></h2><a name="Notifiers"></a><p>No notifiers are defined. Please check back at a later date.</p></div>
+                  </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container">
+              <div class="row span12">Copyright &copy;                    2013
+                        <a href="http://www.apache.org">Apache Software Foundation</a>.
+            All Rights Reserved.      
+                    
+      </div>
+
+                          
+                <p id="poweredBy" class="pull-right">
+                          <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
+        <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
+      </a>
+              </p>
+        
+                </div>
+    </footer>
+  </body>
+</html>

Added: incubator/falcon/site/0.3-incubating/issue-tracking.html
URL: http://svn.apache.org/viewvc/incubator/falcon/site/0.3-incubating/issue-tracking.html?rev=1516144&view=auto
==============================================================================
--- incubator/falcon/site/0.3-incubating/issue-tracking.html (added)
+++ incubator/falcon/site/0.3-incubating/issue-tracking.html Wed Aug 21 12:29:11 2013
@@ -0,0 +1,97 @@
+<!DOCTYPE html>
+<!--
+ | Generated by Apache Maven Doxia at Aug 21, 2013
+ | Rendered using Apache Maven Fluido Skin 1.3.0
+-->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
+    <meta name="Date-Revision-yyyymmdd" content="20130821" />
+    <meta http-equiv="Content-Language" content="en" />
+    <title>Falcon - Issue Tracking</title>
+    <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" />
+    <link rel="stylesheet" href="./css/site.css" />
+    <link rel="stylesheet" href="./css/print.css" media="print" />
+
+      
+    <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script>
+
+    
+            </head>
+        <body class="topBarDisabled">
+          
+                        
+                    
+    
+        <div class="container">
+          <div id="banner">
+        <div class="pull-left">
+                                                  <a href="../../index.html" id="bannerLeft">
+                                                                                                <img src="images/falcon-logo.png"  alt="Falcon" width="200px" height="45px"/>
+                </a>
+                      </div>
+        <div class="pull-right">                  <a href="http://incubator.apache.org" id="bannerRight">
+                                                                                                <img src="images/apache-incubator-logo.png"  alt="Apache Incubator"/>
+                </a>
+      </div>
+        <div class="clear"><hr/></div>
+      </div>
+
+      <div id="breadcrumbs">
+        <ul class="breadcrumb">
+                
+                    
+                              <li class="">
+                    <a href="index.html" title="Home">
+        Home</a>
+        </li>
+      <li class="divider ">/</li>
+        <li class="">Issue Tracking</li>
+        
+                
+                    
+      
+                                              
+    <li class="pull-right">              <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314429&version=12324423" class="externalLink" title="Released: 2013-08-15">
+        Released: 2013-08-15</a>
+  </li>
+
+        <li class="divider pull-right">|</li>
+      
+    <li class="pull-right">              <a href="http://www.apache.org/dist/incubator/falcon" class="externalLink" title="0.3-incubating">
+        0.3-incubating</a>
+  </li>
+
+                        </ul>
+      </div>
+
+      
+                
+        <div id="bodyColumn" >
+                                  
+            <div class="section"><h2>Overview<a name="Overview"></a></h2><a name="Overview"></a><p>This project uses <a class="externalLink" href="http://www.atlassian.com/software/jira">JIRA</a> a J2EE-based, issue tracking and project management application.</p></div><div class="section"><h2>Issue Tracking<a name="Issue_Tracking"></a></h2><a name="Issue_Tracking"></a><p>Issues, bugs, and feature requests should be submitted to the following issue tracking system for this project.</p><div class="source"><pre class="prettyprint"><a class="externalLink" href="https://issues.apache.org/jira/browse/FALCON">https://issues.apache.org/jira/browse/FALCON</a></pre></div></div>
+                  </div>
+          </div>
+
+    <hr/>
+
+    <footer>
+            <div class="container">
+              <div class="row span12">Copyright &copy;                    2013
+                        <a href="http://www.apache.org">Apache Software Foundation</a>.
+            All Rights Reserved.      
+                    
+      </div>
+
+                          
+                <p id="poweredBy" class="pull-right">
+                          <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
+        <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
+      </a>
+              </p>
+        
+                </div>
+    </footer>
+  </body>
+</html>