You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2021/08/05 07:07:00 UTC
[jira] [Issue Comment Deleted] (TEZ-4318) Tez debugging tools
webapp
[ https://issues.apache.org/jira/browse/TEZ-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
László Bodor updated TEZ-4318:
------------------------------
Comment: was deleted
(was: | (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 16m 8s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m 0s{color} | {color:green} No case conflicting files found. {color} |
| {color:blue}0{color} | {color:blue} shelldocs {color} | {color:blue} 0m 1s{color} | {color:blue} Shelldocs was not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m 0s{color} | {color:red} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 5m 7s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 49s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m 14s{color} | {color:green} master passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m 55s{color} | {color:green} master passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 40s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 53s{color} | {color:green} master passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 16s{color} | {color:green} master passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m 38s{color} | {color:blue} Used deprecated FindBugs config; considering switching to SpotBugs. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 1m 8s{color} | {color:blue} tez-tools in master has 2 extant findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 5m 58s{color} | {color:blue} root in master has 2 extant findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 35s{color} | {color:blue} tez-tools/analyzers/job-analyzer in master has 4 extant findbugs warnings. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 16s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 35s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m 43s{color} | {color:green} the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 3m 43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m 24s{color} | {color:green} the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 3m 24s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 19s{color} | {color:orange} tez-tools: The patch generated 13 new + 46 unchanged - 0 fixed = 59 total (was 46) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 20s{color} | {color:orange} tez-tools/analyzers/job-analyzer: The patch generated 2 new + 46 unchanged - 0 fixed = 48 total (was 46) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 16s{color} | {color:orange} tez-tools/tez-tools-webapp: The patch generated 11 new + 0 unchanged - 0 fixed = 11 total (was 0) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange} 0m 47s{color} | {color:orange} root: The patch generated 13 new + 46 unchanged - 0 fixed = 59 total (was 46) {color} |
| {color:green}+1{color} | {color:green} hadolint {color} | {color:green} 0m 1s{color} | {color:green} There were no new hadolint issues. {color} |
| {color:red}-1{color} | {color:red} markdownlint {color} | {color:red} 0m 1s{color} | {color:red} The patch generated 6 new + 0 unchanged - 0 fixed = 6 total (was 0) {color} |
| {color:green}+1{color} | {color:green} shellcheck {color} | {color:green} 0m 0s{color} | {color:green} There were no new shellcheck issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 5s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m 9s{color} | {color:green} the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m 23s{color} | {color:red} tez-tools-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m 20s{color} | {color:red} tez-tools_tez-tools-webapp-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 1m 39s{color} | {color:red} root-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 45s{color} | {color:red} tez-tools in the patch failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m 22s{color} | {color:red} tez-tools-webapp in the patch failed. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 5m 53s{color} | {color:red} root in the patch failed. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 49s{color} | {color:green} tez-tools in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 35s{color} | {color:green} job-analyzer in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 23s{color} | {color:green} tez-tools-webapp in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 72m 48s{color} | {color:green} root in the patch passed. {color} |
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 1m 31s{color} | {color:red} The patch generated 5 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}161m 58s{color} | {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/tez/pull/139 |
| JIRA Issue | TEZ-4318 |
| Optional Tests | dupname asflicense javac javadoc unit xml compile spotbugs findbugs checkstyle hadolint shellcheck shelldocs markdownlint |
| uname | Linux fc74f8a8c1df 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 464d86d8f |
| Default Java | Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-checkstyle-tez-tools.txt |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-checkstyle-tez-tools_analyzers_job-analyzer.txt |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-checkstyle-tez-tools_tez-tools-webapp.txt |
| checkstyle | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-checkstyle-root.txt |
| markdownlint | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-patch-markdownlint.txt |
| javadoc | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-javadoc-javadoc-tez-tools-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt |
| javadoc | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-javadoc-javadoc-tez-tools_tez-tools-webapp-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt |
| javadoc | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/diff-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt |
| findbugs | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/patch-findbugs-tez-tools.txt |
| findbugs | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/patch-findbugs-tez-tools_tez-tools-webapp.txt |
| findbugs | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/patch-findbugs-root.txt |
| Test Results | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/testReport/ |
| asflicense | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/artifact/out/patch-asflicense-problems.txt |
| Max. process+thread count | 2089 (vs. ulimit of 5500) |
| modules | C: tez-tools tez-tools/analyzers/job-analyzer tez-tools/tez-tools-webapp . U: . |
| Console output | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/1/console |
| versions | git=2.25.1 maven=3.6.3 shellcheck=0.7.1 findbugs=3.0.1 hadolint=1.18.0-0-g76eee5c markdownlint=0.23.2 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
)
> Tez debugging tools webapp
> --------------------------
>
> Key: TEZ-4318
> URL: https://issues.apache.org/jira/browse/TEZ-4318
> Project: Apache Tez
> Issue Type: New Feature
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Attachments: Screenshot 2021-08-01 at 14.11.26.png, dag_1627089048261_0000_1_1, dag_1627089048261_0000_1_1_1, dag_1627810632098_0001_1.zip, history.txt
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> This is about creating a very simple UI for postprocessing info about tez dags.
> The primary focus is on [analyzers|https://github.com/apache/tez/tree/master/tez-tools/analyzers/job-analyzer].
> I use analyzers quite often, thinking about a browser-based solution, which can be started easily locally, and lets the user do something like:
> 1. upload history logging file (simple, proto)
> 2. run a set of analyzers (change config opts from UI)
> 3. return 1 or more xls / cvs files with the result(s) (format can be picked on UI)
> [tez-tools|https://github.com/apache/tez/tree/master/tez-tools] has lot more tools there, but for me, the real benefit would be having analyzers in the first round
> also interested in the dockerized approach
--
This message was sent by Atlassian Jira
(v8.3.4#803005)