You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/02/02 09:19:51 UTC
[jira] [Commented] (FALCON-2267) Definition api fails if resources
are empty
[ https://issues.apache.org/jira/browse/FALCON-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849703#comment-15849703 ]
ASF GitHub Bot commented on FALCON-2267:
----------------------------------------
GitHub user pallavi-rao opened a pull request:
https://github.com/apache/falcon/pull/356
FALCON-2267 Definition api fails if resources are empty
Dev testing done:
`IM1738M1:falcon-0.11-SNAPSHOT pallavi.rao$ bin/falcon extension -enumerate
[
{
"name": "sample",
"type": "Custom extension",
"location": "hdfs://192.168.138.236:8020/tmp/extensions/extension-example"
},
…..
{
"name": "hive-mirroring",
"type": "Trusted extension",
"description": "This extension implements replicating hive metadata and data from one Hadoop cluster to another Hadoop cluster.",
"location": "file:/Users/pallavi.rao/falcon/falcon-0.11-SNAPSHOT/extensions/hive-mirroring"
}
]
IM1738M1:falcon-0.11-SNAPSHOT pallavi.rao$ bin/falcon extension -definition -extensionName hive-mirroring
{
"shortDescription":"This extension implements replicating hive metadata and data from one Hadoop cluster to another Hadoop cluster.",
"properties":[
{
"propertyName":"jobName",
"required":true,
"description":"Unique job name",
"example":"hive-monthly-sales-dr"
},
….
]
}
IM1738M1:falcon-0.11-SNAPSHOT pallavi.rao$ bin/falcon extension -definition -extensionName sample
Contents of file config:
Contents of file config2:
<workflow-app xmlns="uri:oozie:workflow:0.1" name="merlin-workflow">
….
IM1738M1:falcon-0.11-SNAPSHOT pallavi.rao$ bin/falcon extension -describe -extensionName sample
Extension Test
IM1738M1:falcon-0.11-SNAPSHOT pallavi.rao$ bin/falcon extension -describe -extensionName hive-mirroring
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
Hive Mirroring Extension
Overview
Falcon provides feature to replicate Hive metadata and data events from source cluster to destination cluster.
…..`
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/pallavi-rao/falcon 2267
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/falcon/pull/356.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #356
----
commit f8d67b2dcbae9dc628973abbccdae2d5cbed243b
Author: Pallavi Rao <pa...@inmobi.com>
Date: 2017-02-02T09:16:59Z
FALCON-2267 Definition api fails if resources are empty
----
> Definition api fails if resources are empty
> -------------------------------------------
>
> Key: FALCON-2267
> URL: https://issues.apache.org/jira/browse/FALCON-2267
> Project: Falcon
> Issue Type: Bug
> Components: extensions
> Affects Versions: trunk
> Reporter: Pragya Mittal
>
> {noformat}
> pragya.mittal@falcon1001:~$ falcon extension -definition -extensionName extension-example
> ERROR: Bad Request;Resource path cannot be null or empty
> {noformat}
> Hadoop path is :
> {noformat}
> pragya.mittal@falcon1001:~$ hl -R /tmp/extensions/extension-example
> /tmp/extensions/extension-example/META
> /tmp/extensions/extension-example/META/config
> /tmp/extensions/extension-example/README
> /tmp/extensions/extension-example/libs
> /tmp/extensions/extension-example/libs/build
> /tmp/extensions/extension-example/libs/build/falcon-extensions-0.11-SNAPSHOT-tests.jar
> /tmp/extensions/extension-example/libs/runtime
> /tmp/extensions/extension-example/resources
> /tmp/extensions/extension-example/resources/build
> /tmp/extensions/extension-example/resources/runtime
> {noformat}
> Extension is :
> {noformat}
> {
> "name": "extension-example",
> "type": "Custom extension",
> "location": "hdfs://192.168.138.236:8020/tmp/extensions/extension-example"
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)