You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Tez CI (Jira)" <ji...@apache.org> on 2021/04/02 08:59:00 UTC

[jira] [Commented] (TEZ-4300) Download protoc automatically compile/development time

    [ https://issues.apache.org/jira/browse/TEZ-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17313718#comment-17313718 ] 

Tez CI commented on TEZ-4300:
-----------------------------

| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 17m 23s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green}  0m  0s{color} | {color:green} No case conflicting files found. {color} |
| {color:blue}0{color} | {color:blue} shelldocs {color} | {color:blue}  0m  0s{color} | {color:blue} Shelldocs was not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  0s{color} | {color:red} The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  5m 57s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  8m 38s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  3m  1s{color} | {color:green} master passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  3m 25s{color} | {color:green} master passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  3m 40s{color} | {color:green} master passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green}  3m  3s{color} | {color:green} master passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m 21s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red}  0m 10s{color} | {color:red} tez-api in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red}  0m 20s{color} | {color:red} tez-api in the patch failed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  0m 20s{color} | {color:red} tez-api in the patch failed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red}  0m 20s{color} | {color:red} tez-api in the patch failed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red}  0m 20s{color} | {color:red} tez-api in the patch failed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08. {color} |
| {color:red}-1{color} | {color:red} shellcheck {color} | {color:red}  0m  0s{color} | {color:red} The patch generated 17 new + 0 unchanged - 0 fixed = 17 total (was 0) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green}  0m  0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green}  0m  3s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 19s{color} | {color:red} tez-api in the patch failed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red}  0m 19s{color} | {color:red} tez-api in the patch failed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}  0m 18s{color} | {color:red} tez-api in the patch failed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 76m 55s{color} | {color:green} root in the patch passed. {color} |
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red}  0m 55s{color} | {color:red} The patch generated 1 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}141m  4s{color} | {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/tez/pull/115 |
| JIRA Issue | TEZ-4300 |
| Optional Tests | dupname asflicense shellcheck shelldocs javac javadoc unit xml compile |
| uname | Linux ccfdaf8664d4 4.15.0-136-generic #140-Ubuntu SMP Thu Jan 28 05:20:47 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 2dcbe0bca |
| Default Java | Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 |
| mvninstall | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-mvninstall-tez-api.txt |
| compile | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-compile-tez-api-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt |
| javac | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-compile-tez-api-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt |
| compile | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-compile-tez-api-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt |
| javac | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-compile-tez-api-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt |
| shellcheck | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/diff-patch-shellcheck.txt |
| javadoc | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-javadoc-tez-api-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt |
| javadoc | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-javadoc-tez-api-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt |
| unit | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-unit-tez-api.txt |
|  Test Results | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/testReport/ |
| asflicense | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/artifact/out/patch-asflicense-problems.txt |
| Max. process+thread count | 1520 (vs. ulimit of 5500) |
| modules | C: tez-api . U: . |
| Console output | https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-115/3/console |
| versions | git=2.25.1 maven=3.6.3 shellcheck=0.7.1 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |


This message was automatically generated.



> Download protoc automatically compile/development time
> ------------------------------------------------------
>
>                 Key: TEZ-4300
>                 URL: https://issues.apache.org/jira/browse/TEZ-4300
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: László Bodor
>            Assignee: László Bodor
>            Priority: Major
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Currently, Tez cannot be built out of the box because tez-api needs a protobuf compiler (protoc executable), which was also a problematic dependency in a sense that downloading/installing it is a burden on developers. Even if we have tons of [gists|https://gist.github.com/abstractdog/1eddeac9cc09815ded5253e3a83293a8] for that, it's still uncomfortable. Not to mention if we want to support more versions at the same time. 
> Shipping the typically used versions (2.5.0, 3.x for later) of the protoc executable could make sense, but I'm not sure at the moment if it has any license issues, [need to check|https://github.com/protocolbuffers/protobuf/blob/master/LICENSE], also it's not general, instead an intelligent script could do it for developers.
> For 2.5, it should be done from source: https://github.com/protocolbuffers/protobuf/releases/tag/v2.5.0
> But for newer versions, the protoc executable can be downloaded from the releases page: https://github.com/protocolbuffers/protobuf/releases/tag/v3.7.1
> https://github.com/protocolbuffers/protobuf/releases/download/v3.7.1/protoc-3.7.1-osx-x86_64.zip
> https://github.com/protocolbuffers/protobuf/releases/download/v3.7.1/protoc-3.7.1-linux-x86_64.zip



--
This message was sent by Atlassian Jira
(v8.3.4#803005)