[jira] [Updated] (SAMZA-930) samza-autoscaling YarnUtils json deserialisation fails with list values

["Alex Buck (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SAMZA-930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alex Buck updated SAMZA-930:
----------------------------
    Attachment: json_deser_bug.patch

[~nickpan47] perhaps you could take a look?

> samza-autoscaling YarnUtils json deserialisation fails with list values
> -----------------------------------------------------------------------
>
>                 Key: SAMZA-930
>                 URL: https://issues.apache.org/jira/browse/SAMZA-930
>             Project: Samza
>          Issue Type: Bug
>    Affects Versions: 0.10.1
>            Reporter: Alex Buck
>            Assignee: Alex Buck
>              Labels: patch
>         Attachments: json_deser_bug.patch
>
>
> Current:
> The `getRunningAppId` method in `org.apache.samza.autoscaling.utils.YarnUtil` attempts to deserialise the json from this endpoint `/ws/v1/cluster/apps` on the resource manager into the following shape: `<Map<String, Map<String, List<Map<String, String>>>>>`
> The problem is that when there is a running job there is a property called `resourceRequests` which has a json array as a value. Therefore Jackson throws an exception when it tries to deserialise a json array into a string.
> Proposed:
> Deserialise the json into the following structure: `<Map<String, Map<String, List<Map<String, Object>>>>>`. The only property being queried for is the `state` so I think this is appropiate.
> I have written the first test for this module. Very open to feedback and improvements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)