[jira] [Commented] (FLINK-20092) [Java 11] Multi-thread Flink compilation not working

["Jim Hughes (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-20092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17636830#comment-17636830 ] 

Jim Hughes commented on FLINK-20092:
------------------------------------

Hi all, I chatted with [~chesnay] about this some.  He identified that https://issues.apache.org/jira/browse/MSHADE-413 may be the issue and suggested that I could try version 3.4.1 (the latest and the fix version for that JIRA) of the Maven Shade plugin.

Updating the plugin is being discussed on this PR: [https://github.com/apache/flink/pull/21344/files] 

> [Java 11] Multi-thread Flink compilation not working
> ----------------------------------------------------
>
>                 Key: FLINK-20092
>                 URL: https://issues.apache.org/jira/browse/FLINK-20092
>             Project: Flink
>          Issue Type: Bug
>          Components: Build System
>            Reporter: Maciej Bryński
>            Priority: Not a Priority
>              Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> I'd like to use maven -T option when compiling flink.
> {code:java}
>  mvn -T 2C clean install -D"scala-2.12" -DskipTests{code}
> Unfortunately my build is stuck on:
> {code:java}
> [INFO] --- maven-shade-plugin:3.2.1:shade (shade-flink) @ flink-fs-hadoop-shaded ---
> [INFO] Including org.apache.hadoop:hadoop-common:jar:3.1.0 in the shaded jar.
> [INFO] Including org.apache.hadoop:hadoop-annotations:jar:3.1.0 in the shaded jar.
> [INFO] Including com.google.guava:guava:jar:11.0.2 in the shaded jar.
> [INFO] Including commons-io:commons-io:jar:2.7 in the shaded jar.
> [INFO] Including commons-collections:commons-collections:jar:3.2.2 in the shaded jar.
> [INFO] Including commons-logging:commons-logging:jar:1.1.3 in the shaded jar.
> [INFO] Including commons-lang:commons-lang:jar:2.6 in the shaded jar.
> [INFO] Including commons-beanutils:commons-beanutils:jar:1.9.3 in the shaded jar.
> [INFO] Including org.apache.commons:commons-configuration2:jar:2.1.1 in the shaded jar.
> [INFO] Including org.apache.commons:commons-lang3:jar:3.3.2 in the shaded jar.
> [INFO] Including com.google.re2j:re2j:jar:1.1 in the shaded jar.
> [INFO] Including org.apache.hadoop:hadoop-auth:jar:3.1.0 in the shaded jar.
> [INFO] Including org.apache.htrace:htrace-core4:jar:4.1.0-incubating in the shaded jar.
> [INFO] Including com.fasterxml.jackson.core:jackson-databind:jar:2.10.1 in the shaded jar.
> [INFO] Including com.fasterxml.jackson.core:jackson-annotations:jar:2.10.1 in the shaded jar.
> [INFO] Including com.fasterxml.jackson.core:jackson-core:jar:2.10.1 in the shaded jar.
> [INFO] Including org.codehaus.woodstox:stax2-api:jar:3.1.4 in the shaded jar.
> [INFO] Including com.fasterxml.woodstox:woodstox-core:jar:5.0.3 in the shaded jar.
> [INFO] Including org.apache.flink:force-shading:jar:1.12-SNAPSHOT in the shaded jar.
> [INFO] No artifact matching filter io.netty:netty
> [WARNING] Discovered module-info.class. Shading will break its strong encapsulation.
> [WARNING] Discovered module-info.class. Shading will break its strong encapsulation.
> [WARNING] Discovered module-info.class. Shading will break its strong encapsulation.
> [INFO] Replacing original artifact with shaded artifact.
> [INFO] Replacing /home/maverick/flink/flink-filesystems/flink-fs-hadoop-shaded/target/flink-fs-hadoop-shaded-1.12-SNAPSHOT.jar with /home/maverick/flink/flink-filesystems/flink-fs-hadoop-shaded/target/flink-fs-hadoop-shaded-1.12-SNAPSHOT-shaded.jar
> [INFO] Dependency-reduced POM written at: /home/maverick/flink/flink-filesystems/flink-fs-hadoop-shaded/target/dependency-reduced-pom.xml
> {code}
> Can we make flink compilation working with multiple maven threads ?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)