You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2017/12/08 17:04:48 UTC
BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Hi,
Just got BUILD FAILURE and have been wondering if it's just me or is this a
known issue that's being worked on?
(Sorry if that's just my local setup that I got broken)
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
spark-catalyst_2.11 ---
[INFO] Using zinc server for incremental compilation
[warn] Pruning sources from previous analysis, due to incompatible
CompileSetup.
[info] Compiling 222 Scala sources and 27 Java sources to
/Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes...
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728:
not found: value AnalysisBarrier
[error] AnalysisBarrier(newRight)
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081:
not found: value AnalysisBarrier
[error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) => sa
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134:
not found: value AnalysisBarrier
[error] return AnalysisBarrier(plan)
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409:
not found: value AnalysisBarrier
[error] case filter @ Filter(havingCondition,
AnalysisBarrier(aggregate: Aggregate)) =>
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410:
not found: value AnalysisBarrier
[error] apply(Filter(havingCondition,
aggregate)).mapChildren(AnalysisBarrier)
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470:
not found: value AnalysisBarrier
[error] case sort @ Sort(sortOrder, global,
AnalysisBarrier(aggregate: Aggregate)) =>
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471:
not found: value AnalysisBarrier
[error] apply(Sort(sortOrder, global,
aggregate)).mapChildren(AnalysisBarrier)
[error] ^
[error]
/Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345:
not found: value AnalysisBarrier
[error] case AnalysisBarrier(child) => child
[error] ^
[error] 8 errors found
[error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s]
[INFO]
------------------------------------------------------------------------
Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
Re: BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Posted by Jacek Laskowski <ja...@japila.pl>.
Hi,
Thanks Sean! You're right -- my local repo got hosed. I don't know why the
patch with AnalysisBarrier didn't go through.
Speaking of the patch [1] I've noticed a sentence in the scaladoc of
AnalysisBarrier that does not make much sense to me. There's something
missing in it, isn't there?
> The SQL Analyzer goes through a whole query plan even most part of it is
analyzed.
What is this sentence telling me? `if` missing in between "even most"?
[1]
https://github.com/apache/spark/blob/00d176d2fe7bbdf55cb3146a9cb04ca99b1858b7/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala?utf8=%E2%9C%93#L890
Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
On Fri, Dec 8, 2017 at 6:40 PM, Sean Owen <so...@cloudera.com> wrote:
> Build is fine for me, and on Jenkins. Try a clean build?
>
> On Fri, Dec 8, 2017 at 11:04 AM Jacek Laskowski <ja...@japila.pl> wrote:
>
>> Hi,
>>
>> Just got BUILD FAILURE and have been wondering if it's just me or is this
>> a known issue that's being worked on?
>>
>> (Sorry if that's just my local setup that I got broken)
>>
>> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
>> spark-catalyst_2.11 ---
>> [INFO] Using zinc server for incremental compilation
>> [warn] Pruning sources from previous analysis, due to incompatible
>> CompileSetup.
>> [info] Compiling 222 Scala sources and 27 Java sources to
>> /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes...
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728: not found:
>> value AnalysisBarrier
>> [error] AnalysisBarrier(newRight)
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081: not found:
>> value AnalysisBarrier
>> [error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) =>
>> sa
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134: not found:
>> value AnalysisBarrier
>> [error] return AnalysisBarrier(plan)
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409: not found:
>> value AnalysisBarrier
>> [error] case filter @ Filter(havingCondition,
>> AnalysisBarrier(aggregate: Aggregate)) =>
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410: not found:
>> value AnalysisBarrier
>> [error] apply(Filter(havingCondition, aggregate)).mapChildren(
>> AnalysisBarrier)
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470: not found:
>> value AnalysisBarrier
>> [error] case sort @ Sort(sortOrder, global,
>> AnalysisBarrier(aggregate: Aggregate)) =>
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471: not found:
>> value AnalysisBarrier
>> [error] apply(Sort(sortOrder, global, aggregate)).mapChildren(
>> AnalysisBarrier)
>> [error] ^
>> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/
>> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345: not found:
>> value AnalysisBarrier
>> [error] case AnalysisBarrier(child) => child
>> [error] ^
>> [error] 8 errors found
>> [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s]
>> [INFO] ------------------------------------------------------------
>> ------------
>>
>> Pozdrawiam,
>> Jacek Laskowski
>> ----
>> https://about.me/JacekLaskowski
>> Spark Structured Streaming https://bit.ly/spark-structured-streaming
>> Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
>> Follow me at https://twitter.com/jaceklaskowski
>>
>
Re: BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Posted by Sean Owen <so...@cloudera.com>.
Build is fine for me, and on Jenkins. Try a clean build?
On Fri, Dec 8, 2017 at 11:04 AM Jacek Laskowski <ja...@japila.pl> wrote:
> Hi,
>
> Just got BUILD FAILURE and have been wondering if it's just me or is this
> a known issue that's being worked on?
>
> (Sorry if that's just my local setup that I got broken)
>
> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
> spark-catalyst_2.11 ---
> [INFO] Using zinc server for incremental compilation
> [warn] Pruning sources from previous analysis, due to incompatible
> CompileSetup.
> [info] Compiling 222 Scala sources and 27 Java sources to
> /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes...
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728:
> not found: value AnalysisBarrier
> [error] AnalysisBarrier(newRight)
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081:
> not found: value AnalysisBarrier
> [error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) => sa
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134:
> not found: value AnalysisBarrier
> [error] return AnalysisBarrier(plan)
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409:
> not found: value AnalysisBarrier
> [error] case filter @ Filter(havingCondition,
> AnalysisBarrier(aggregate: Aggregate)) =>
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410:
> not found: value AnalysisBarrier
> [error] apply(Filter(havingCondition,
> aggregate)).mapChildren(AnalysisBarrier)
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470:
> not found: value AnalysisBarrier
> [error] case sort @ Sort(sortOrder, global,
> AnalysisBarrier(aggregate: Aggregate)) =>
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471:
> not found: value AnalysisBarrier
> [error] apply(Sort(sortOrder, global,
> aggregate)).mapChildren(AnalysisBarrier)
> [error] ^
> [error]
> /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345:
> not found: value AnalysisBarrier
> [error] case AnalysisBarrier(child) => child
> [error] ^
> [error] 8 errors found
> [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s]
> [INFO]
> ------------------------------------------------------------------------
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski
> Spark Structured Streaming https://bit.ly/spark-structured-streaming
> Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>