You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Ayub Khan (JIRA)" <ji...@apache.org> on 2016/02/29 15:05:18 UTC
[jira] [Comment Edited] (ATLAS-536) Falcon hook loads incorrect
configuration when -Datlas.conf is not given when falcon server startup.
this needs to be documented.
[ https://issues.apache.org/jira/browse/ATLAS-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171888#comment-15171888 ]
Ayub Khan edited comment on ATLAS-536 at 2/29/16 2:04 PM:
----------------------------------------------------------
[~shwethags]
Thanks for reviewing the patch.
I have made the changes accordingly and submitted new patch.
was (Author: ayubkhan):
[~shwethags]
I have made the changes accordingly. Thanks for reviewing the patch.
> Falcon hook loads incorrect configuration when -Datlas.conf is not given when falcon server startup. this needs to be documented.
> ---------------------------------------------------------------------------------------------------------------------------------
>
> Key: ATLAS-536
> URL: https://issues.apache.org/jira/browse/ATLAS-536
> Project: Atlas
> Issue Type: Bug
> Affects Versions: trunk
> Reporter: Ayub Khan
> Assignee: Ayub Khan
> Priority: Critical
> Labels: patch
> Fix For: trunk
>
> Attachments: Adding_atlas_conf_path_to_falcon_server_opts-2.patch, Adding_atlas_conf_path_to_falcon_server_opts-3.patch, Adding_atlas_conf_path_to_falcon_server_opts.patch
>
>
> Problem:
> Falcon server startup expects "-Datlas.conf=<path to atlas conf dir>" to read the atlas configuration file(application.properties), if this is not provided, then falcon hook tries to read the default values from the atlas-typesystem jar file.
> *Basically falcon hook depends on "atlas.rest.address" config option present in application.properties to post the entity create/update to atlas. But in the above the scenario, when "atlas.conf" option is not provided at falcon server startup, this will read the atlas.rest.address as localhost which is incorrect and all the subsequent falcon hook updates will fail.*
> This also needs to be documented.
> Falcon applicaiton log showing the conf file is read from jar file which has default values
> {noformat}
> 2016-02-25 08:29:13,131 INFO - [main:] ~ Initiated backend operations thread pool of size 2 (Backend:148)
> 2016-02-25 08:29:13,510 INFO - [main:] ~ Indexes already exist for graph (MetadataMappingService:143)
> 2016-02-25 08:29:13,510 INFO - [main:] ~ Initialized graph db: titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb] (MetadataMappingService:88)
> 2016-02-25 08:29:13,511 INFO - [main:] ~ Init vertex property keys: [name, type, version, timestamp] (MetadataMappingService:91)
> 2016-02-25 08:29:13,511 INFO - [main:] ~ Init edge property keys: [name] (MetadataMappingService:94)
> 2016-02-25 08:29:13,515 INFO - [main:] ~ Service initialized: org.apache.falcon.metadata.MetadataMappingService (ServiceInitializer:52)
> 2016-02-25 08:29:13,517 INFO - [main:] ~ Initializing service: org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:45)
> 2016-02-25 08:29:13,522 INFO - [main:] ~ Loading application.properties from jar:file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/lib/atlas-typesystem-0.6.0.2.3.99.0-196.jar!/application.properties (ApplicationProperties:62)
> 2016-02-25 08:29:13,539 INFO - [main:] ~ Loading client.properties from file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/classes/client.properties (ApplicationProperties:62)
> 2016-02-25 08:29:13,914 INFO - [main:] ~ Real User: falcon (auth:SIMPLE), is from ticket cache? false (SecureClientUtils:90)
> 2016-02-25 08:29:13,915 INFO - [main:] ~ doAsUser: falcon (SecureClientUtils:93)
> 2016-02-25 08:29:14,780 INFO - [main:] ~ Created Atlas Hook for Falcon (FalconHook:144)
> 2016-02-25 08:29:14,780 INFO - [main:] ~ Service initialized: org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:52)
> 2016-02-25 08:29:14,782 INFO - [main:] ~ FalconAuditFilter initialization started (FalconAuditFilter:49)
> 2016-02-25 08:29:14,785 INFO - [main:] ~ FalconAuthenticationFilter initialization started (FalconAuthenticationFilter:83)
> 2016-02-25 08:29:14,802 INFO - [main:] ~ Falcon is running with authorization enabled (FalconAuthorizationFilter:62)
> {noformat}
> Falcon application log showing conf file read from /etc/atlas/conf when -Datlas.conf is provided
> {noformat}
> 2016-02-25 11:36:52,605 INFO - [main:] ~ Initiated backend operations thread pool of size 2 (Backend:148)
> 2016-02-25 11:36:53,119 INFO - [main:] ~ Indexes already exist for graph (MetadataMappingService:143)
> 2016-02-25 11:36:53,120 INFO - [main:] ~ Initialized graph db: titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb] (MetadataMappingService:88)
> 2016-02-25 11:36:53,122 INFO - [main:] ~ Init vertex property keys: [name, type, version, timestamp] (MetadataMappingService:91)
> 2016-02-25 11:36:53,123 INFO - [main:] ~ Init edge property keys: [name] (MetadataMappingService:94)
> 2016-02-25 11:36:53,128 INFO - [main:] ~ Service initialized: org.apache.falcon.metadata.MetadataMappingService (ServiceInitializer:52)
> 2016-02-25 11:36:53,130 INFO - [main:] ~ Initializing service: org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:45)
> 2016-02-25 11:36:53,135 INFO - [main:] ~ Loading application.properties from file:/etc/atlas/conf/application.properties (ApplicationProperties:62)
> 2016-02-25 11:36:53,163 INFO - [main:] ~ Loading client.properties from file:/etc/atlas/conf/client.properties (ApplicationProperties:62)
> 2016-02-25 11:36:53,396 INFO - [main:] ~ Real User: falcon (auth:SIMPLE), is from ticket cache? false (SecureClientUtils:90)
> 2016-02-25 11:36:53,396 INFO - [main:] ~ doAsUser: falcon (SecureClientUtils:93)
> 2016-02-25 11:36:54,178 INFO - [main:] ~ Created Atlas Hook for Falcon (FalconHook:144)
> 2016-02-25 11:36:54,178 INFO - [main:] ~ Service initialized: org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:52)
> 2016-02-25 11:36:54,180 INFO - [main:] ~ FalconAuditFilter initialization started (FalconAuditFilter:49)
> 2016-02-25 11:36:54,184 INFO - [main:] ~ FalconAuthenticationFilter initialization started (FalconAuthenticationFilter:83)
> 2016-02-25 11:36:54,214 INFO - [main:] ~ Falcon is running with authorization enabled (FalconAuthorizationFilter:62)
> 2016-02-25 11:36:55,389 INFO - [main:] ~ Started SocketConnector@0.0.0.0:15000 (log:67)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)