You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org> on 2014/03/11 12:22:44 UTC

[jira] [Updated] (FALCON-346) Feed can't be submitted

     [ https://issues.apache.org/jira/browse/FALCON-346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Baptiste Onofré updated FALCON-346:
----------------------------------------

    Description: 
With the latest build on master, I submitted the following cluster:

{code}
<cluster colo="local" description="Local cluster" name="local" xmlns="uri:falcon:cluster:0.1">
    <interfaces>
        <interface type="readonly" endpoint="hftp://localhost:50010" version="1.1.2"/>

        <interface type="write" endpoint="hdfs://localhost:8020" version="1.1.2"/>

        <interface type="execute" endpoint="localhost:8021" version="1.1.2"/>

        <interface type="workflow" endpoint="http://localhost:11000/oozie/" version="4.0.0"/>

        <interface type="messaging" endpoint="tcp://localhost:61616"  version="5.7.0"/>
    </interfaces>
    <locations>
        <location name="staging" path="/falcon/staging"/>
        <location name="temp" path="/falcon/tmp"/>
        <location name="working" path="/falcon/working"/>
    </locations>
    <properties>
    </properties>
</cluster>
{code}

with:

{code}
bin/falcon entity -submit -type cluster -file local.xml
{code}

The submit is OK, and I can see the cluster in the Falcon configuration store:

{code}
bin/falcon entity -list -type cluster
(cluster) local(null)
{code}

Now, I create the following feed:

{code}
<feed description="" name="output" xmlns="uri:falcon:feed:0.1">
    <groups>output</groups>

    <frequency>minutes(10)</frequency>

    <clusters>
        <cluster name="local">
            <validity start="2012-07-20T03:00Z" end="2099-07-16T00:00Z"/>
            <retention limit="hours(10)" action="delete"/>
        </cluster>
    </clusters>

    <locations>
        <location type="data" path="/data/output"/>
    </locations>
  
    <ACL owner="jbonofre" group="supergroup" permission="0x644"/>

    <schema location="none" provider="none"/>

</feed>
{code}

However, when I try to submit this feed, I got:

{code}
bin/falcon entity -submit -type feed -file ~/demo/entity/output.xml 
Error: Cluster entity vertex must exist: local

{code}

whereas local cluster exists.

It seems that it's a regression introduced in EntityRelationshipGraphBuilder.

I gonna take a look on that.

  was:
With the latest build on master, I submitted the following cluster:

{code}
<cluster colo="local" description="Local cluster" name="local" xmlns="uri:falcon:cluster:0.1">
    <interfaces>
        <interface type="readonly" endpoint="hftp://localhost:50010" version="1.1.2"/>

        <interface type="write" endpoint="hdfs://localhost:8020" version="1.1.2"/>

        <interface type="execute" endpoint="localhost:8021" version="1.1.2"/>

        <interface type="workflow" endpoint="http://localhost:11000/oozie/" version="4.0.0"/>

        <interface type="messaging" endpoint="tcp://localhost:61616"  version="5.7.0"/>
    </interfaces>
    <locations>
        <location name="staging" path="/falcon/staging"/>
        <location name="temp" path="/falcon/tmp"/>
        <location name="working" path="/falcon/working"/>
    </locations>
    <properties>
    </properties>
</cluster>
{code}

with:

bin/falcon entity -submit -type cluster -file local.xml

The submit is OK, and I can see the cluster in the Falcon configuration store:

{code}
bin/falcon entity -list -type cluster
(cluster) local(null)
{code}

Now, I create the following feed:

{code}
<feed description="" name="output" xmlns="uri:falcon:feed:0.1">
    <groups>output</groups>

    <frequency>minutes(10)</frequency>

    <clusters>
        <cluster name="local">
            <validity start="2012-07-20T03:00Z" end="2099-07-16T00:00Z"/>
            <retention limit="hours(10)" action="delete"/>
        </cluster>
    </clusters>

    <locations>
        <location type="data" path="/data/output"/>
    </locations>
  
    <ACL owner="jbonofre" group="supergroup" permission="0x644"/>

    <schema location="none" provider="none"/>

</feed>
{code}

However, when I try to submit this feed, I got:

{code}
bin/falcon entity -submit -type feed -file ~/demo/entity/output.xml 
Error: Cluster entity vertex must exist: local

{code}

whereas local cluster exists.

It seems that it's a regression introduced in EntityRelationshipGraphBuilder.

I gonna take a look on that.


> Feed can't be submitted
> -----------------------
>
>                 Key: FALCON-346
>                 URL: https://issues.apache.org/jira/browse/FALCON-346
>             Project: Falcon
>          Issue Type: Bug
>          Components: feed
>    Affects Versions: 0.5
>            Reporter: Jean-Baptiste Onofré
>            Assignee: Jean-Baptiste Onofré
>
> With the latest build on master, I submitted the following cluster:
> {code}
> <cluster colo="local" description="Local cluster" name="local" xmlns="uri:falcon:cluster:0.1">
>     <interfaces>
>         <interface type="readonly" endpoint="hftp://localhost:50010" version="1.1.2"/>
>         <interface type="write" endpoint="hdfs://localhost:8020" version="1.1.2"/>
>         <interface type="execute" endpoint="localhost:8021" version="1.1.2"/>
>         <interface type="workflow" endpoint="http://localhost:11000/oozie/" version="4.0.0"/>
>         <interface type="messaging" endpoint="tcp://localhost:61616"  version="5.7.0"/>
>     </interfaces>
>     <locations>
>         <location name="staging" path="/falcon/staging"/>
>         <location name="temp" path="/falcon/tmp"/>
>         <location name="working" path="/falcon/working"/>
>     </locations>
>     <properties>
>     </properties>
> </cluster>
> {code}
> with:
> {code}
> bin/falcon entity -submit -type cluster -file local.xml
> {code}
> The submit is OK, and I can see the cluster in the Falcon configuration store:
> {code}
> bin/falcon entity -list -type cluster
> (cluster) local(null)
> {code}
> Now, I create the following feed:
> {code}
> <feed description="" name="output" xmlns="uri:falcon:feed:0.1">
>     <groups>output</groups>
>     <frequency>minutes(10)</frequency>
>     <clusters>
>         <cluster name="local">
>             <validity start="2012-07-20T03:00Z" end="2099-07-16T00:00Z"/>
>             <retention limit="hours(10)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/data/output"/>
>     </locations>
>   
>     <ACL owner="jbonofre" group="supergroup" permission="0x644"/>
>     <schema location="none" provider="none"/>
> </feed>
> {code}
> However, when I try to submit this feed, I got:
> {code}
> bin/falcon entity -submit -type feed -file ~/demo/entity/output.xml 
> Error: Cluster entity vertex must exist: local
> {code}
> whereas local cluster exists.
> It seems that it's a regression introduced in EntityRelationshipGraphBuilder.
> I gonna take a look on that.



--
This message was sent by Atlassian JIRA
(v6.2#6252)