You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Lincoln Atkinson <la...@microsoft.com> on 2015/07/07 19:04:46 UTC
Windows - endless "Dependency-reduced POM written..." in Bagel build
I'm trying to build Spark from source on Windows 8.1, using a recent Cygwin install and JDK 8u45. From the root of my enlistment, I'm running `build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package`
The build moves along just fine for a while, until it builds "Spark Project Bagel 1.5.0-SNAPSHOT". At this point it gets stuck in a seemingly endless loop, repeating "[INFO] Dependency-reduced POM written at: C:\Users\latkin\Source\Repos\spark\bagel\dependency-reduced-pom.xml". I let this go on for maybe 30-45 min before killing the build. The XML file itself appears to have quite a lot of repeated data.
Is this expected, and it will finish eventually? Is there a workaround? I've shared my full build log and pom XML at https://gist.github.com/latkin/1bdfeb1380d0dced0601
Thanks,
-Lincoln
RE: Windows - endless "Dependency-reduced POM written..." in Bagel
build
Posted by Lincoln Atkinson <la...@microsoft.com>.
That solved it. Thanks!
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Tuesday, July 07, 2015 10:21 AM
To: Lincoln Atkinson
Cc: user@spark.apache.org
Subject: Re: Windows - endless "Dependency-reduced POM written..." in Bagel build
Looks like a workaround has gone in:
[SPARK-8819] Fix build for maven 3.3.x
FYI
On Tue, Jul 7, 2015 at 10:09 AM, Ted Yu <yu...@gmail.com>> wrote:
See this thread: http://search-hadoop.com/m/q3RTtxVUrL1AvnPj2
On Tue, Jul 7, 2015 at 10:04 AM, Lincoln Atkinson <la...@microsoft.com>> wrote:
I’m trying to build Spark from source on Windows 8.1, using a recent Cygwin install and JDK 8u45. From the root of my enlistment, I’m running `build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package`
The build moves along just fine for a while, until it builds “Spark Project Bagel 1.5.0-SNAPSHOT”. At this point it gets stuck in a seemingly endless loop, repeating “[INFO] Dependency-reduced POM written at: C:\Users\latkin\Source\Repos\spark\bagel\dependency-reduced-pom.xml”. I let this go on for maybe 30-45 min before killing the build. The XML file itself appears to have quite a lot of repeated data.
Is this expected, and it will finish eventually? Is there a workaround? I’ve shared my full build log and pom XML at https://gist.github.com/latkin/1bdfeb1380d0dced0601
Thanks,
-Lincoln
Re: Windows - endless "Dependency-reduced POM written..." in Bagel build
Posted by Ted Yu <yu...@gmail.com>.
Looks like a workaround has gone in:
[SPARK-8819] Fix build for maven 3.3.x
FYI
On Tue, Jul 7, 2015 at 10:09 AM, Ted Yu <yu...@gmail.com> wrote:
> See this thread: http://search-hadoop.com/m/q3RTtxVUrL1AvnPj2
>
> On Tue, Jul 7, 2015 at 10:04 AM, Lincoln Atkinson <la...@microsoft.com>
> wrote:
>
>> I’m trying to build Spark from source on Windows 8.1, using a recent
>> Cygwin install and JDK 8u45. From the root of my enlistment, I’m running
>> `build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean
>> package`
>>
>>
>>
>> The build moves along just fine for a while, until it builds “Spark
>> Project Bagel 1.5.0-SNAPSHOT”. At this point it gets stuck in a seemingly
>> endless loop, repeating “[INFO] Dependency-reduced POM written at:
>> C:\Users\latkin\Source\Repos\spark\bagel\dependency-reduced-pom.xml”. I
>> let this go on for maybe 30-45 min before killing the build. The XML file
>> itself appears to have quite a lot of repeated data.
>>
>>
>>
>> Is this expected, and it will finish eventually? Is there a workaround?
>> I’ve shared my full build log and pom XML at
>> https://gist.github.com/latkin/1bdfeb1380d0dced0601
>>
>>
>>
>> Thanks,
>>
>> -Lincoln
>>
>
>
Re: Windows - endless "Dependency-reduced POM written..." in Bagel build
Posted by Ted Yu <yu...@gmail.com>.
See this thread: http://search-hadoop.com/m/q3RTtxVUrL1AvnPj2
On Tue, Jul 7, 2015 at 10:04 AM, Lincoln Atkinson <la...@microsoft.com>
wrote:
> I’m trying to build Spark from source on Windows 8.1, using a recent
> Cygwin install and JDK 8u45. From the root of my enlistment, I’m running
> `build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean
> package`
>
>
>
> The build moves along just fine for a while, until it builds “Spark
> Project Bagel 1.5.0-SNAPSHOT”. At this point it gets stuck in a seemingly
> endless loop, repeating “[INFO] Dependency-reduced POM written at:
> C:\Users\latkin\Source\Repos\spark\bagel\dependency-reduced-pom.xml”. I
> let this go on for maybe 30-45 min before killing the build. The XML file
> itself appears to have quite a lot of repeated data.
>
>
>
> Is this expected, and it will finish eventually? Is there a workaround?
> I’ve shared my full build log and pom XML at
> https://gist.github.com/latkin/1bdfeb1380d0dced0601
>
>
>
> Thanks,
>
> -Lincoln
>