[jira] [Created] (GOBBLIN-531) Gobblin AWS Worker cannot start because of state store type and uri mismatch

["Joel Baranick (JIRA)" <ji...@apache.org>]

Joel Baranick created GOBBLIN-531:
-------------------------------------

             Summary: Gobblin AWS Worker cannot start because of state store type and uri mismatch
                 Key: GOBBLIN-531
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-531
             Project: Apache Gobblin
          Issue Type: Bug
          Components: gobblin-aws
    Affects Versions: 0.12.0
            Reporter: Joel Baranick
            Assignee: Abhishek Tiwari


Something has changed from 0.10.0 to 0.12.0 which causes the _StateStores_ class to be instantiated with a _state.store.fs.uri_ which is mismatched with the _state.store.type_.  

The problem seems to be from: [GobblinTaskRunner.java#L250|https://github.com/apache/incubator-gobblin/blob/0.12.0/gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinTaskRunner.java#L250]

It create a new _Config_ for like: 

 
{code:java}
Config stateStoreJobConfig = ConfigUtils.propertiesToConfig(properties)
  .withValue(ConfigurationKeys.STATE_STORE_FS_URI_KEY,
    ConfigValueFactory.fromAnyRef(rootPathUri.toString()));
{code}
Compare this to: [GobblinHelixJobLauncher.java#L156|https://github.com/apache/incubator-gobblin/blob/0.12.0/gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinHelixJobLauncher.java#L156]

 

It creates a new _Config_ like:

 
{code:java}
Config stateStoreJobConfig = ConfigUtils.propertiesToConfig(jobProps)    .withValue(ConfigurationKeys.STATE_STORE_FS_URI_KEY, ConfigValueFactory.fromAnyRef( new URI(appWorkDir.toUri().getScheme(), null, appWorkDir.toUri().getHost(), appWorkDir.toUri().getPort(), null, null, null).toString()));
{code}
The following screenshot shows the callstack and the overridden value.

!Screen Shot 2018-07-12 at 8.47.07 AM.png!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)