You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by 老胡 <23...@qq.com.INVALID> on 2023/02/07 18:45:45 UTC
回复： idea构建flink源码失败
感谢，解决了。4.scala-compiler的server也要设置jdk8 这一步没走。
------------------ 原始邮件 ------------------
发件人: "Ran Tao"<chucheng.tr@gmail.com>;
发送时间: 2023年2月7日(星期二) 下午4:33
收件人: "user-zh"<user-zh@flink.apache.org>;
主题: Re: idea构建flink源码失败
jdk8 & scala2.12的组合是支持的，你这个问题一般就是jdk和idea设置问题。可以通过以下方法尝试下：
1.注意查看 maven profile，查看勾选的profile（可以使用scala-2.12）。
2.ProjectStrccture -> modules 设置各个module 匹配 jdk8
3.IDEA-Settings-Builder-Compiler 设置 jdk8，以及使用jdk11的话注意开启交叉编译
4.scala-compiler的server也要设置jdk8
tiger <2372554140@qq.com.invalid> 于2023年2月4日周六 18:06写道：
> hi，
>
>
> 各位大佬好，在idea构建flink源码失败，吧几乎所有scala版本，sbt版本都下载下来，一一测试都失败了。
>
> 环境如下：
>
> 操作系统：Ubuntu22.04
>
> idea：2022.3.2
>
> jdk:
>
> java version "1.8.0_191"
> Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
> Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)
>
> scala:
>
> 2.12.0，2.12.14（都下载下来了.........
> 2.12.1,2.12.2，2.12.3，2.12.4，2.13.3）
>
>
> sbt:
>
> sbt-1.3.6 （ 都下载下：sbt-1.1.4 sbt-1.2.0 ， sbt-1.4.0 sbt-1.5.5
> sbt-1.6.1 sbt-1.7.2 sbt-1.8.1）
>
>
> mvn:
>
> 3.8.7，3.2.5
>
>
> 目前的异常是：
>
> scalac: Error: assertion failed:
> (class DataStream,iterate$default$2)
> while compiling:
>
> /java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
> during phase: typer
> library version: version 2.12.14
> compiler version: version 2.12.14
> reconstructed args: -nobootcp -classpath
>
> /jdk/development/jre/lib/charsets.jar:/jdk/development/jre/lib/deploy.jar:/jdk/development/jre/lib/ext/cldrdata.jar:/jdk/development/jre/lib/ext/dnsns.jar:/jdk/development/jre/lib/ext/jaccess.jar:/jdk/development/jre/lib/ext/jfxrt.jar:/jdk/development/jre/lib/ext/localedata.jar:/jdk/development/jre/lib/ext/nashorn.jar:/jdk/development/jre/lib/ext/sunec.jar:/jdk/development/jre/lib/ext/sunjce_provider.jar:/jdk/development/jre/lib/ext/sunpkcs11.jar:/jdk/development/jre/lib/ext/zipfs.jar:/jdk/development/jre/lib/javaws.jar:/jdk/development/jre/lib/jce.jar:/jdk/development/jre/lib/jfr.jar:/jdk/development/jre/lib/jfxswt.jar:/jdk/development/jre/lib/jsse.jar:/jdk/development/jre/lib/management-agent.jar:/jdk/development/jre/lib/plugin.jar:/jdk/development/jre/lib/resources.jar:/jdk/development/jre/lib/rt.jar:/java-source/flink/flink-streaming-scala/target/classes:/java-source/flink/flink-streaming-java/target/classes:/java-source/flink/flink-core/target/classes:/java-source/flink/flink-connectors/flink-file-sink-common/target/classes:/java-source/flink/flink-runtime/target/classes:/java-source/flink/flink-java/target/classes:/rely/maven/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/rely/maven/repository/org/apache/flink/flink-shaded-guava/30.1.1-jre-15.0/flink-shaded-guava-30.1.1-jre-15.0.jar:/rely/maven/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/java-source/flink/flink-scala/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-asm-9/9.2-15.0/flink-shaded-asm-9-9.2-15.0.jar:/rely/maven/repository/com/twitter/chill_2.12/0.7.6/chill_2.12-0.7.6.jar:/rely/maven/repository/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar:/rely/maven/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar:/java-source/flink/flink-annotations/target/classes:/java-source/flink/flink-metrics/flink-metrics-core/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-jackson/2.12.4-15.0/flink-shaded-jackson-2.12.4-15.0.jar:/rely/maven/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/rely/maven/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/rely/maven/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/rely/maven/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/rely/maven/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/java-source/flink/flink-rpc/flink-rpc-core/target/classes:/java-source/flink/flink-rpc/flink-rpc-akka-loader/target/classes:/java-source/flink/flink-queryable-state/flink-queryable-state-client-java/target/classes:/java-source/flink/flink-filesystems/flink-hadoop-fs/target/classes:/rely/maven/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-netty/
> 4.1.70.
> Final-15.0/flink-shaded-netty-4.1.70.Final-15.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-zookeeper-3/3.5.9-15.0/flink-shaded-zookeeper-3-3.5.9-15.0.jar:/rely/maven/repository/commons-cli/commons-cli/1.5.0/commons-cli-1.5.0.jar:/rely/maven/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/rely/maven/repository/org/xerial/snappy/snappy-java/
> 1.1.8.3/snappy-java-1.1.8.3.jar:/rely/maven/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/rely/maven/repository/io/airlift/aircompressor/0.21/aircompressor-0.21.jar:/rely/maven/repository/org/apache/flink/flink-shaded-force-shading/15.0/flink-shaded-force-shading-15.0.jar:/rely/maven/repository/org/slf4j/slf4j-api/1.7.32/slf4j-api-1.7.32.jar:/rely/maven/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/rely/maven/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/disk/scala/scala-2.12.14/lib/scala-parser-combinators_2.12-1.0.7.jar:/home/disk/scala/scala-2.12.14/lib/scala-reflect.jar:/home/disk/scala/scala-2.12.14/lib/scala-swing_2.12-2.0.3.jar:/home/disk/scala/scala-2.12.14/lib/scala-xml_2.12-1.0.6.jar:/home/disk/scala/scala-2.12.14/lib/scala-library.jar
>
> -Xplugin:/rely/maven/repository/org/scalamacros/paradise_2.12.7/2.1.1/paradise_2.12.7-2.1.1.jar
>
> last tree to typer: TypeBoundsTree
> tree position: line 578 of
>
> /java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
> symbol: null
> call site: method iterate in class DataStream in package scala
>
> == Source file context for tree position ==
>
> 575 * refer to the [[setParallelism]] method for parallelism
> modification
> 576 */
> 577 @PublicEvolving
> 578 def iterate[R](
> 579 stepFunction: DataStream[T] => (DataStream[T],
> DataStream[R]),
> 580 maxWaitTimeMillis: Long = 0): DataStream[R] = {
> 581 val iterativeStream = stream.iterate(maxWaitTimeMillis)
> java.lang.AssertionError: assertion failed:
> (class DataStream,iterate$default$2)
> while compiling:
>
> /opensource/java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
> during phase: typer
> library version: version 2.12.14
> compiler version: version 2.12.14
> reconstructed args: -nobootcp
>
> -classpath/jdk/development/jre/lib/charsets.jar:/jdk/development/jre/lib/deploy.jar:/leaning/software/language/jdk/development/jre/lib/ext/cldrdata.jar:/jdk/development/jre/lib/ext/dnsns.jar:/jdk/development/jre/lib/ext/jaccess.jar:/jdk/development/jre/lib/ext/jfxrt.jar:/jdk/development/jre/lib/ext/localedata.jar:/jdk/development/jre/lib/ext/nashorn.jar:/jdk/development/jre/lib/ext/sunec.jar:/jdk/development/jre/lib/ext/sunjce_provider.jar:/jdk/development/jre/lib/ext/sunpkcs11.jar:/jdk/development/jre/lib/ext/zipfs.jar:/jdk/development/jre/lib/javaws.jar:/jdk/development/jre/lib/jce.jar:/jdk/development/jre/lib/jfr.jar:/jdk/development/jre/lib/jfxswt.jar:/jdk/development/jre/lib/jsse.jar:/jdk/development/jre/lib/management-agent.jar:/jdk/development/jre/lib/plugin.jar:/jdk/development/jre/lib/resources.jar:/jdk/development/jre/lib/rt.jar:/java-source/flink/flink-streaming-scala/target/classes:/java-source/flink/flink-streaming-java/target/classes:/java-source/flink/flink-core/target/classes:/java-source/flink/flink-connectors/flink-file-sink-common/target/classes:/java-source/flink/flink-runtime/target/classes:/java-source/flink/flink-java/target/classes:/rely/maven/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/rely/maven/repository/org/apache/flink/flink-shaded-guava/30.1.1-jre-15.0/flink-shaded-guava-30.1.1-jre-15.0.jar:/rely/maven/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/java-source/flink/flink-scala/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-asm-9/9.2-15.0/flink-shaded-asm-9-9.2-15.0.jar:/rely/maven/repository/com/twitter/chill_2.12/0.7.6/chill_2.12-0.7.6.jar:/rely/maven/repository/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar:/rely/maven/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar:/java-source/flink/flink-annotations/target/classes:/java-source/flink/flink-metrics/flink-metrics-core/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-jackson/2.12.4-15.0/flink-shaded-jackson-2.12.4-15.0.jar:/rely/maven/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/rely/maven/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/rely/maven/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/rely/maven/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/rely/maven/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/java-source/flink/flink-rpc/flink-rpc-core/target/classes:/java-source/flink/flink-rpc/flink-rpc-akka-loader/target/classes:/java-source/flink/flink-queryable-state/flink-queryable-state-client-java/target/classes:/java-source/flink/flink-filesystems/flink-hadoop-fs/target/classes:/rely/maven/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-netty/
> 4.1.70.
> Final-15.0/flink-shaded-netty-4.1.70.Final-15.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-zookeeper-3/3.5.9-15.0/flink-shaded-zookeeper-3-3.5.9-15.0.jar:/home/disk/leaning/rely/maven/repository/commons-cli/commons-cli/1.5.0/commons-cli-1.5.0.jar:/rely/maven/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/rely/maven/repository/org/xerial/snappy/snappy-java/
> 1.1.8.3/snappy-java-1.1.8.3.jar:/rely/maven/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/rely/maven/repository/io/airlift/aircompressor/0.21/aircompressor-0.21.jar:/rely/maven/repository/org/apache/flink/flink-shaded-force-shading/15.0/flink-shaded-force-shading-15.0.jar:/rely/maven/repository/org/slf4j/slf4j-api/1.7.32/slf4j-api-1.7.32.jar:/rely/maven/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/rely/maven/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/disk/scala/scala-2.12.14/lib/scala-parser-combinators_2.12-1.0.7.jar:/home/disk/scala/scala-2.12.14/lib/scala-reflect.jar:/home/disk/scala/scala-2.12.14/lib/scala-swing_2.12-2.0.3.jar:/home/disk/scala/scala-2.12.14/lib/scala-xml_2.12-1.0.6.jar:/home/disk/scala/scala-2.12.14/lib/scala-library.jar
>
> -Xplugin:/rely/maven/repository/org/scalamacros/paradise_2.12.7/2.1.1/paradise_2.12.7-2.1.1.jar
>
> last tree to typer: TypeBoundsTree
> tree position: line 578 of
>
> /java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
> symbol: null
> call site: method iterate in class DataStream in package scala
>
> == Source file context for tree position ==
>
> 575 * refer to the [[setParallelism]] method for parallelism
> modification
> 576 */
> 577 @PublicEvolving
> 578 def iterate[R](
> 579 stepFunction: DataStream[T] => (DataStream[T],
> DataStream[R]),
> 580 maxWaitTimeMillis: Long = 0): DataStream[R] = {
> 581 val iterativeStream = stream.iterate(maxWaitTimeMillis)
> at
>
> scala.reflect.internal.SymbolTable.throwAssertionError(SymbolTable.scala:185)
> at
>
> scala.tools.nsc.typechecker.Namers$Namer.$anonfun$addDefaultGetters$10(Namers.scala:1613)
> at
>
> scala.tools.nsc.typechecker.Namers$Namer$DefaultMethodInOwningScope.addGetter(Namers.scala:1689)
> at
>
> scala.tools.nsc.typechecker.Namers$Namer.$anonfun$addDefaultGetters$8(Namers.scala:1583)
> at
>
> scala.tools.nsc.typechecker.Namers$Namer.$anonfun$addDefaultGetters$6(Namers.scala:1554)
> at
>
> scala.tools.nsc.typechecker.Namers$Namer.addDefaultGetters(Namers.scala:1550)
> at
> scala.tools.nsc.typechecker.Namers$Namer.methodSig(Namers.scala:1439)
> at
> scala.tools.nsc.typechecker.Namers$Namer.memberSig(Namers.scala:1918)
> at scala.tools.nsc.typechecker.Namers$Namer.typeSig(Namers.scala:1870)
> at
>
> scala.tools.nsc.typechecker.Namers$Namer$MonoTypeCompleter.completeImpl(Namers.scala:877)
> at
>
> scala.tools.nsc.typechecker.Namers$LockingTypeCompleter.complete(Namers.scala:2082)
> at
>
> scala.tools.nsc.typechecker.Namers$LockingTypeCompleter.complete$(Namers.scala:2080)
> at
>
> scala.tools.nsc.typechecker.Namers$TypeCompleterBase.complete(Namers.scala:2075)
> at
>
> scala.tools.nsc.typechecker.Namers$PolyTypeCompleter.completeImpl(Namers.scala:2115)
> at
>
> scala.tools.nsc.typechecker.Namers$LockingTypeCompleter.complete(Namers.scala:2082)
> at
>
> scala.tools.nsc.typechecker.Namers$LockingTypeCompleter.complete$(Namers.scala:2080)
> at
>
> scala.tools.nsc.typechecker.Namers$PolyTypeCompleter.complete(Namers.scala:2094)
> at
> scala.reflect.internal.Symbols$Symbol.completeInfo(Symbols.scala:1542)
> at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1514)
> at
> scala.reflect.internal.Symbols$Symbol.initialize(Symbols.scala:1698)
> at scala.tools.nsc.typechecker.Typers$Typer.typed1(Typers.scala:5406)
> at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5781)
> at
> scala.tools.nsc.typechecker.Typers$Typer.typedStat$1(Typers.scala:5845)
> at
>
> scala.tools.nsc.typechecker.Typers$Typer.$anonfun$typedStats$10(Typers.scala:3337)
> at
> scala.tools.nsc.typechecker.Typers$Typer.typedStats(Typers.scala:3337)
> at
> scala.tools.nsc.typechecker.Typers$Typer.typedTemplate(Typers.scala:2019)
> at
> scala.tools.nsc.typechecker.Typers$Typer.typedClassDef(Typers.scala:1832)
> at scala.tools.nsc.typechecker.Typers$Typer.typed1(Typers.scala:5702)
> at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5781)
> at
> scala.tools.nsc.typechecker.Typers$Typer.typedStat$1(Typers.scala:5845)
> at
>
> scala.tools.nsc.typechecker.Typers$Typer.$anonfun$typedStats$10(Typers.scala:3337)
> at
> scala.tools.nsc.typechecker.Typers$Typer.typedStats(Typers.scala:3337)
> at
>
> scala.tools.nsc.typechecker.Typers$Typer.typedPackageDef$1(Typers.scala:5413)
> at scala.tools.nsc.typechecker.Typers$Typer.typed1(Typers.scala:5705)
> at scala.tools.nsc.typechecker.Typers$Typer.typed(Typers.scala:5781)
> at
>
> scala.tools.nsc.typechecker.Analyzer$typerFactory$TyperPhase.apply(Analyzer.scala:114)
> at scala.tools.nsc.Global$GlobalPhase.applyPhase(Global.scala:453)
> at
>
> scala.tools.nsc.typechecker.Analyzer$typerFactory$TyperPhase.run(Analyzer.scala:102)
> at scala.tools.nsc.Global$Run.compileUnitsInternal(Global.scala:1514)
> at scala.tools.nsc.Global$Run.compileUnits(Global.scala:1498)
> at scala.tools.nsc.Global$Run.compileSources(Global.scala:1491)
> at scala.tools.nsc.Global$Run.compileFiles(Global.scala:1602)
> at xsbt.CachedCompiler0.run(CompilerBridge.scala:163)
> at xsbt.CachedCompiler0.run(CompilerBridge.scala:134)
> at xsbt.CompilerBridge.run(CompilerBridge.scala:39)
> at
> sbt.internal.inc.AnalyzingCompiler.compile(AnalyzingCompiler.scala:91)
> at
>
> org.jetbrains.jps.incremental.scala.local.IdeaIncrementalCompiler.compile(IdeaIncrementalCompiler.scala:48)
> at
>
> org.jetbrains.jps.incremental.scala.local.LocalServer.doCompile(LocalServer.scala:47)
> at
>
> org.jetbrains.jps.incremental.scala.local.LocalServer.compile(LocalServer.scala:25)
> at
>
> org.jetbrains.jps.incremental.scala.remote.Main$.compileLogic(Main.scala:197)
> at
>
> org.jetbrains.jps.incremental.scala.remote.Main$.$anonfun$handleCommand$1(Main.scala:184)
> at
>
> org.jetbrains.jps.incremental.scala.remote.Main$.decorated$1(Main.scala:174)
> at
>
> org.jetbrains.jps.incremental.scala.remote.Main$.handleCommand(Main.scala:181)
> at
>
> org.jetbrains.jps.incremental.scala.remote.Main$.serverLogic(Main.scala:157)
> at
> org.jetbrains.jps.incremental.scala.remote.Main$.nailMain(Main.scala:97)
> at
> org.jetbrains.jps.incremental.scala.remote.Main.nailMain(Main.scala)
> at jdk.internal.reflect.GeneratedMethodAccessor1.invoke(Unknown
> Source)
> at
>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:568)
> at com.facebook.nailgun.NGSession.runImpl(NGSession.java:312)
> at com.facebook.nailgun.NGSession.run(NGSession.java:198)
>
>
>
>
>
>
>
>
--
Best Regards,
Ran Tao
https://github.com/chucheng92