You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Bikas Saha (JIRA)" <ji...@apache.org> on 2015/09/08 23:34:47 UTC
[jira] [Commented] (TEZ-2789) Backport events added in TEZ-2612 to
branch-0.7
[ https://issues.apache.org/jira/browse/TEZ-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735659#comment-14735659 ]
Bikas Saha commented on TEZ-2789:
---------------------------------
[~rajesh.balamohan] could you please take a quick look in case I have missed something. Thanks!
Pulled in the following under TEZ-2612 and deleted all files touched under plugins or analyzers since they dont exist in branch-0.7
Tested this by running jobs with branch-0.7 jars with simple history logging. Then analyzing the simple history events using critical path analyzer from master.
{noformat}commit 0ecb6e2e85fc32151ce648b158e08e66ea474c6f
Author: Bikas Saha <bi...@apache.org>
Date: Mon Sep 7 16:50:33 2015 -0700
TEZ-2778. Improvements to handle multiple read errors with complex DAGs (bikas)
(cherry picked from commit 171d4850443a9e67aa5a68d4c8482779c0caa8eb)
Conflicts:
CHANGES.txt
tez-dag/src/main/java/org/apache/tez/dag/app/TaskCommunicatorManager.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/TaskAttemptInfo.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/utils/Utils.java
tez-plugins/tez-history-parser/src/test/java/org/apache/tez/history/TestHistoryParser.java
tez-tools/analyzers/job-analyzer/src/main/java/org/apache/tez/analyzer/plugins/CriticalPathAnalyzer.java
tez-tools/analyzers/job-analyzer/src/test/java/org/apache/tez/analyzer/TestAnalyzer.java
commit 5fde1b5cd06fc780c7c7ea83651f098e4065d933
Author: Bikas Saha <bi...@apache.org>
Date: Thu Aug 13 17:53:52 2015 -0700
TEZ-2701. Add time at which container was allocated to attempt (bikas)
(cherry picked from commit 6b67b0bc1eb010f6dc8af2936ae738909e1244ff)
Conflicts:
CHANGES.txt
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/TaskAttemptInfo.java
tez-plugins/tez-history-parser/src/test/java/org/apache/tez/history/TestHistoryParser.java
commit cdc450f95bc071620af71a5a20fe5fabf059c0f2
Author: Bikas Saha <bi...@apache.org>
Date: Wed Aug 5 12:35:30 2015 -0700
TEZ-2650. Timing details on Vertex state changes (bikas)
(cherry picked from commit 6970fb01bc7bd8a838dc55c5e38cbad41b1c3140)
Conflicts:
CHANGES.txt
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/BaseInfo.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/BaseParser.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/DagInfo.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/TaskAttemptInfo.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/TaskInfo.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/VertexInfo.java
tez-plugins/tez-history-parser/src/test/java/org/apache/tez/history/TestATSFileParser.java
tez-tools/analyzers/job-analyzer/src/main/java/org/apache/tez/analyzer/plugins/SlowestVertexAnalyzer.java
commit 25a6b66f80a1b93e843b1e8f810bc66c2f916dd6
Author: Bikas Saha <bi...@apache.org>
Date: Tue Aug 4 10:42:40 2015 -0700
TEZ-2647. Add input causality dependency for attempts (bikas)
(cherry picked from commit 6a99798f250310f8bd819aae89123e6146364983)
Conflicts:
CHANGES.txt
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/TaskAttemptInfo.java
tez-plugins/tez-history-parser/src/test/java/org/apache/tez/history/TestATSFileParser.java
commit f8511b7538f782d97a01b27acd479551fe3c68b1
Author: Bikas Saha <bi...@apache.org>
Date: Mon Aug 3 11:38:15 2015 -0700
TEZ-2646. Add scheduling casual dependency for attempts (bikas)
(cherry picked from commit 4d381d778f82d8d17ea9f718bbac3938ce4cc40d)
Conflicts:
CHANGES.txt
tez-dag/src/test/java/org/apache/tez/dag/app/dag/impl/TestTaskImpl.java
tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/datamodel/TaskAttemptInfo.java
tez-plugins/tez-history-parser/src/test/java/org/apache/tez/history/TestATSFileParser.java
{noformat}
> Backport events added in TEZ-2612 to branch-0.7
> -----------------------------------------------
>
> Key: TEZ-2789
> URL: https://issues.apache.org/jira/browse/TEZ-2789
> Project: Apache Tez
> Issue Type: Task
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-2789.1.patch
>
>
> Having the events in the 0.7 line will allow them to be persisted to ATS or SimpleHistory logging. After that, the latest analyzers from master or 0.8 could be used to analyze them. At some point when the analzyers are stable, they could move into the UI directly or be back-ported in bulk to the 0.7.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)