You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Alejandro Fernandez <af...@hortonworks.com> on 2014/11/19 20:42:37 UTC
Review Request 28246: ADDITIONAL FIX: Falcon lineage needs changes to
startup.properties
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28246/
-----------------------------------------------------------
Review request for Ambari, Jaimin Jetly and Yusaku Sako.
Bugs: AMBARI-8379
https://issues.apache.org/jira/browse/AMBARI-8379
Repository: ambari
Description
-------
This is an additional fix for a patch that has already been committed, described below.
Summary of changes needed and implications
changes in falcon/conf/startup.properties:
1) For Falcon lineage to work below changes are needed on Ambari deployed configs for Falcon
Implications : Lineage feature of Falcon is blocked without these changes
MetadataMappingService is required for lineage:
```
*.application.services=org.apache.falcon.security.AuthenticationInitializationService,\
org.apache.falcon.workflow.WorkflowJobEndNotificationService,\
org.apache.falcon.service.ProcessSubscriberService,\
org.apache.falcon.entity.store.ConfigurationStore,\
org.apache.falcon.rerun.service.RetryService,\
org.apache.falcon.rerun.service.LateRunService,\
org.apache.falcon.service.LogCleanupService,\
org.apache.falcon.metadata.MetadataMappingService
```
```
######### Graph Database Properties #########
# Graph implementation
*.falcon.graph.blueprints.graph=com.thinkaurelius.titan.core.TitanFactory
# Graph Storage
*.falcon.graph.storage.directory=/grid/0/data/lineage/graphdb
*.falcon.graph.storage.backend=berkeleyje
*.falcon.graph.serialize.path=/grid/0/data/lineage
*.falcon.graph.preserve.history=false
```
The properties that need a directory in the local file system should detect a mount point that is available on the Falcon server, and the python scripts need to crease these directories when the Falcon service is configured.
The folder permission are,
owner:falcon user
group:hadoop
permissions:775
Diffs
-----
ambari-web/app/models/service_config.js 5527ed1
Diff: https://reviews.apache.org/r/28246/diff/
Testing
-------
Symlinked the web folder and created a cluster using the Install Wizard to verify the additional fix.
Thanks,
Alejandro Fernandez
Re: Review Request 28246: ADDITIONAL FIX: Falcon lineage needs
changes to startup.properties
Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28246/#review62212
-----------------------------------------------------------
Ship it!
Ship It!
- Sid Wagle
On Nov. 19, 2014, 7:56 p.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28246/
> -----------------------------------------------------------
>
> (Updated Nov. 19, 2014, 7:56 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly, Sid Wagle, and Yusaku Sako.
>
>
> Bugs: AMBARI-8379
> https://issues.apache.org/jira/browse/AMBARI-8379
>
>
> Repository: ambari
>
>
> Description
> -------
>
> This is an additional fix for a patch that has already been committed, described below.
>
>
> Summary of changes needed and implications
>
> changes in falcon/conf/startup.properties:
>
> 1) For Falcon lineage to work below changes are needed on Ambari deployed configs for Falcon
> Implications : Lineage feature of Falcon is blocked without these changes
>
> MetadataMappingService is required for lineage:
> ```
> *.application.services=org.apache.falcon.security.AuthenticationInitializationService,\
> org.apache.falcon.workflow.WorkflowJobEndNotificationService,\
> org.apache.falcon.service.ProcessSubscriberService,\
> org.apache.falcon.entity.store.ConfigurationStore,\
> org.apache.falcon.rerun.service.RetryService,\
> org.apache.falcon.rerun.service.LateRunService,\
> org.apache.falcon.service.LogCleanupService,\
> org.apache.falcon.metadata.MetadataMappingService
> ```
>
> ```
> ######### Graph Database Properties #########
> # Graph implementation
> *.falcon.graph.blueprints.graph=com.thinkaurelius.titan.core.TitanFactory
>
> # Graph Storage
> *.falcon.graph.storage.directory=/grid/0/data/lineage/graphdb
> *.falcon.graph.storage.backend=berkeleyje
> *.falcon.graph.serialize.path=/grid/0/data/lineage
> *.falcon.graph.preserve.history=false
> ```
>
> The properties that need a directory in the local file system should detect a mount point that is available on the Falcon server, and the python scripts need to crease these directories when the Falcon service is configured.
>
> The folder permission are,
> owner:falcon user
> group:hadoop
> permissions:775
>
>
> Diffs
> -----
>
> ambari-web/app/models/service_config.js 5527ed1
>
> Diff: https://reviews.apache.org/r/28246/diff/
>
>
> Testing
> -------
>
> Symlinked the web folder and created a cluster using the Install Wizard to verify the additional fix.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>
Re: Review Request 28246: ADDITIONAL FIX: Falcon lineage needs
changes to startup.properties
Posted by Jaimin Jetly <ja...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28246/#review62211
-----------------------------------------------------------
Ship it!
Ship It!
- Jaimin Jetly
On Nov. 19, 2014, 7:56 p.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28246/
> -----------------------------------------------------------
>
> (Updated Nov. 19, 2014, 7:56 p.m.)
>
>
> Review request for Ambari, Jaimin Jetly, Sid Wagle, and Yusaku Sako.
>
>
> Bugs: AMBARI-8379
> https://issues.apache.org/jira/browse/AMBARI-8379
>
>
> Repository: ambari
>
>
> Description
> -------
>
> This is an additional fix for a patch that has already been committed, described below.
>
>
> Summary of changes needed and implications
>
> changes in falcon/conf/startup.properties:
>
> 1) For Falcon lineage to work below changes are needed on Ambari deployed configs for Falcon
> Implications : Lineage feature of Falcon is blocked without these changes
>
> MetadataMappingService is required for lineage:
> ```
> *.application.services=org.apache.falcon.security.AuthenticationInitializationService,\
> org.apache.falcon.workflow.WorkflowJobEndNotificationService,\
> org.apache.falcon.service.ProcessSubscriberService,\
> org.apache.falcon.entity.store.ConfigurationStore,\
> org.apache.falcon.rerun.service.RetryService,\
> org.apache.falcon.rerun.service.LateRunService,\
> org.apache.falcon.service.LogCleanupService,\
> org.apache.falcon.metadata.MetadataMappingService
> ```
>
> ```
> ######### Graph Database Properties #########
> # Graph implementation
> *.falcon.graph.blueprints.graph=com.thinkaurelius.titan.core.TitanFactory
>
> # Graph Storage
> *.falcon.graph.storage.directory=/grid/0/data/lineage/graphdb
> *.falcon.graph.storage.backend=berkeleyje
> *.falcon.graph.serialize.path=/grid/0/data/lineage
> *.falcon.graph.preserve.history=false
> ```
>
> The properties that need a directory in the local file system should detect a mount point that is available on the Falcon server, and the python scripts need to crease these directories when the Falcon service is configured.
>
> The folder permission are,
> owner:falcon user
> group:hadoop
> permissions:775
>
>
> Diffs
> -----
>
> ambari-web/app/models/service_config.js 5527ed1
>
> Diff: https://reviews.apache.org/r/28246/diff/
>
>
> Testing
> -------
>
> Symlinked the web folder and created a cluster using the Install Wizard to verify the additional fix.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>
Re: Review Request 28246: ADDITIONAL FIX: Falcon lineage needs
changes to startup.properties
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28246/
-----------------------------------------------------------
(Updated Nov. 19, 2014, 7:56 p.m.)
Review request for Ambari, Jaimin Jetly, Sid Wagle, and Yusaku Sako.
Bugs: AMBARI-8379
https://issues.apache.org/jira/browse/AMBARI-8379
Repository: ambari
Description
-------
This is an additional fix for a patch that has already been committed, described below.
Summary of changes needed and implications
changes in falcon/conf/startup.properties:
1) For Falcon lineage to work below changes are needed on Ambari deployed configs for Falcon
Implications : Lineage feature of Falcon is blocked without these changes
MetadataMappingService is required for lineage:
```
*.application.services=org.apache.falcon.security.AuthenticationInitializationService,\
org.apache.falcon.workflow.WorkflowJobEndNotificationService,\
org.apache.falcon.service.ProcessSubscriberService,\
org.apache.falcon.entity.store.ConfigurationStore,\
org.apache.falcon.rerun.service.RetryService,\
org.apache.falcon.rerun.service.LateRunService,\
org.apache.falcon.service.LogCleanupService,\
org.apache.falcon.metadata.MetadataMappingService
```
```
######### Graph Database Properties #########
# Graph implementation
*.falcon.graph.blueprints.graph=com.thinkaurelius.titan.core.TitanFactory
# Graph Storage
*.falcon.graph.storage.directory=/grid/0/data/lineage/graphdb
*.falcon.graph.storage.backend=berkeleyje
*.falcon.graph.serialize.path=/grid/0/data/lineage
*.falcon.graph.preserve.history=false
```
The properties that need a directory in the local file system should detect a mount point that is available on the Falcon server, and the python scripts need to crease these directories when the Falcon service is configured.
The folder permission are,
owner:falcon user
group:hadoop
permissions:775
Diffs
-----
ambari-web/app/models/service_config.js 5527ed1
Diff: https://reviews.apache.org/r/28246/diff/
Testing
-------
Symlinked the web folder and created a cluster using the Install Wizard to verify the additional fix.
Thanks,
Alejandro Fernandez