[jira] [Updated] (GIRAPH-789) Upgrade hive-io to 0.20 - less metastore accesses

["Maja Kabiljo (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/GIRAPH-789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maja Kabiljo updated GIRAPH-789:
--------------------------------

    Attachment: GIRAPH-789.patch

Hive-io changed so it doesn't access metastore when schema/table info is already present in Configuration, and HiveGiraphRunner is now initializing all the formats to fill up the Configuration. If HiveGiraphRunner is not used everything will still work, but we'll have accesses to metastore from workers.

> Upgrade hive-io to 0.20 - less metastore accesses
> -------------------------------------------------
>
>                 Key: GIRAPH-789
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-789
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>         Attachments: GIRAPH-789.patch
>
>
> Currently each worker is sending multiple requests to metastore to get info about io formats, which is unnecessary and can cause issues when metastore is having problems.



--
This message was sent by Atlassian JIRA
(v6.1#6144)