You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by "shanyu zhao (JIRA)" <ji...@apache.org> on 2016/02/22 20:58:18 UTC
[jira] [Created] (SLIDER-1090) Speed up SliderClient and AM by
reading metainfo from accompany file
shanyu zhao created SLIDER-1090:
-----------------------------------
Summary: Speed up SliderClient and AM by reading metainfo from accompany file
Key: SLIDER-1090
URL: https://issues.apache.org/jira/browse/SLIDER-1090
Project: Slider
Issue Type: Bug
Affects Versions: Slider 0.90.2, Slider 0.81
Reporter: shanyu zhao
Today both SliderClient and SliderAM read package metainfo from HDFS. This requires downloading the whole package from HDFS. If package size is big (~200MB), this operation wastes tens of seconds in starting up the application.
To speed up the operation of reading metainfo, we can read from an accompany xml/json file if it exists in the same HDFS folder as the zip package. If the accompany file does not exist, it falls back to the old way of downloading the zip package.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)