You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Abhishek Tiwari (JIRA)" <ji...@apache.org> on 2018/07/13 13:35:00 UTC
[jira] [Assigned] (GOBBLIN-531) Gobblin AWS Worker cannot start
because of state store type and uri mismatch
[ https://issues.apache.org/jira/browse/GOBBLIN-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhishek Tiwari reassigned GOBBLIN-531:
---------------------------------------
Assignee: Hung Tran (was: Abhishek Tiwari)
> Gobblin AWS Worker cannot start because of state store type and uri mismatch
> ----------------------------------------------------------------------------
>
> Key: GOBBLIN-531
> URL: https://issues.apache.org/jira/browse/GOBBLIN-531
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-aws
> Affects Versions: 0.12.0
> Reporter: Joel Baranick
> Assignee: Hung Tran
> Priority: Major
> Labels: aws, helix
> Attachments: Screen Shot 2018-07-12 at 8.47.07 AM.png
>
>
> Something has changed from 0.10.0 to 0.12.0 which causes the _StateStores_ class to be instantiated with a _state.store.fs.uri_ which is mismatched with the _state.store.type_.
> The problem seems to be from: [GobblinTaskRunner.java#L250|https://github.com/apache/incubator-gobblin/blob/0.12.0/gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinTaskRunner.java#L250]
> It create a new _Config_ for like:
>
> {code:java}
> Config stateStoreJobConfig = ConfigUtils.propertiesToConfig(properties)
> .withValue(ConfigurationKeys.STATE_STORE_FS_URI_KEY,
> ConfigValueFactory.fromAnyRef(rootPathUri.toString()));
> {code}
> Compare this to: [GobblinHelixJobLauncher.java#L156|https://github.com/apache/incubator-gobblin/blob/0.12.0/gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinHelixJobLauncher.java#L156]
>
> It creates a new _Config_ like:
>
> {code:java}
> Config stateStoreJobConfig = ConfigUtils.propertiesToConfig(jobProps) .withValue(ConfigurationKeys.STATE_STORE_FS_URI_KEY, ConfigValueFactory.fromAnyRef( new URI(appWorkDir.toUri().getScheme(), null, appWorkDir.toUri().getHost(), appWorkDir.toUri().getPort(), null, null, null).toString()));
> {code}
> The following screenshot shows the callstack and the overridden value.
> !Screen Shot 2018-07-12 at 8.47.07 AM.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)