You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Harish Jaiprakash (JIRA)" <ji...@apache.org> on 2017/02/07 11:07:41 UTC
[jira] [Updated] (TEZ-3609) Improve ATSv15 performance for DAG
entities read calls.
[ https://issues.apache.org/jira/browse/TEZ-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harish Jaiprakash updated TEZ-3609:
-----------------------------------
Attachment: TEZ-3609.01.patch
Removing application entity id generation from TimelineCachePluginImpl for dag entities.
[~sseth] Please review.
> Improve ATSv15 performance for DAG entities read calls.
> -------------------------------------------------------
>
> Key: TEZ-3609
> URL: https://issues.apache.org/jira/browse/TEZ-3609
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Harish Jaiprakash
> Assignee: Harish Jaiprakash
> Attachments: TEZ-3609.01.patch
>
>
> TimelineCachePluginImpl generates TimelineEntityGroupId.newInstance(appId, appId.toString()) as an EntityGroupId for dag entities. This results entities in file based on application EntityGroupId to loaded by ATS during a read operation. This file can become very large in long running AM and causes timeout and delays in ATS.
> Removing this id, reduces this parsing time and prevents the application entities from being loaded into cache.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)