You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Tarek Auel <ta...@gmail.com> on 2015/07/03 22:13:19 UTC
Can not build master
Hi all,
I am trying to build the master, but it stucks and prints
[INFO] Dependency-reduced POM written at:
/Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
build command: mvn -DskipTests clean package
Do others have the same issue?
Regards,
Tarek
Re: Can not build master
Posted by Patrick Wendell <pw...@gmail.com>.
Hi Tomo,
For now you can do that as a work around. We are working on a fix for
this in the master branch but it may take a couple of days since the
issue is fairly complicated.
- Patrick
On Sat, Jul 4, 2015 at 7:00 AM, tomo cocoa <co...@gmail.com> wrote:
> Hi all,
>
> I have a same error and it seems depending on Maven versions.
>
> I tried building Spark using Maven with several versions on Jenkins.
>
> + Output of
> "/Users/tomohiko/.jenkins/tools/hudson.tasks.Maven_MavenInstallation/mvn-3.3.3/bin/mvn
> -version":
>
> Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06;
> 2015-04-22T20:57:37+09:00)
> Maven home:
> /Users/tomohiko/.jenkins/tools/hudson.tasks.Maven_MavenInstallation/mvn-3.3.3
> Java version: 1.8.0, vendor: Oracle Corporation
> Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>
> + Jenkins Configuration:
> Jenkins project type: Maven Project
> Goals and options: -Phadoop-2.6 -DskipTests clean package
>
> + Maven versions and results:
> 3.3.3 -> infinite loop
> 3.3.1 -> infinite loop
> 3.2.5 -> SUCCESS
>
>
> So do we prefer to build Spark with Maven 3.2.5?
>
>
> On 4 July 2015 at 12:28, Andrew Or <an...@databricks.com> wrote:
>>
>> Thanks, I just tried it with 3.3.3 and I was able to reproduce it as well.
>>
>> 2015-07-03 18:51 GMT-07:00 Tarek Auel <ta...@gmail.com>:
>>>
>>> That's mine
>>>
>>> Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06;
>>> 2015-04-22T04:57:37-07:00)
>>>
>>> Maven home: /usr/local/Cellar/maven/3.3.3/libexec
>>>
>>> Java version: 1.8.0_45, vendor: Oracle Corporation
>>>
>>> Java home:
>>> /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
>>>
>>> Default locale: en_US, platform encoding: UTF-8
>>>
>>> OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>>>
>>>
>>> On Fri, Jul 3, 2015 at 6:32 PM Ted Yu <yu...@gmail.com> wrote:
>>>>
>>>> Here is mine:
>>>>
>>>> Apache Maven 3.3.1 (cab6659f9874fa96462afef40fcf6bc033d58c1c;
>>>> 2015-03-13T13:10:27-07:00)
>>>> Maven home: /home/hbase/apache-maven-3.3.1
>>>> Java version: 1.8.0_45, vendor: Oracle Corporation
>>>> Java home: /home/hbase/jdk1.8.0_45/jre
>>>> Default locale: en_US, platform encoding: UTF-8
>>>> OS name: "linux", version: "2.6.32-504.el6.x86_64", arch: "amd64",
>>>> family: "unix"
>>>>
>>>> On Fri, Jul 3, 2015 at 6:05 PM, Andrew Or <an...@databricks.com> wrote:
>>>>>
>>>>> @Tarek and Ted, what maven versions are you using?
>>>>>
>>>>> 2015-07-03 17:35 GMT-07:00 Krishna Sankar <ks...@gmail.com>:
>>>>>>
>>>>>> Patrick,
>>>>>> I assume an RC3 will be out for folks like me to test the
>>>>>> distribution. As usual, I will run the tests when you have a new
>>>>>> distribution.
>>>>>> Cheers
>>>>>> <k/>
>>>>>>
>>>>>> On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com>
>>>>>> wrote:
>>>>>>>
>>>>>>> Patch that added test-jar dependencies:
>>>>>>> https://github.com/apache/spark/commit/bfe74b34
>>>>>>>
>>>>>>> Patch that originally disabled dependency reduced poms:
>>>>>>>
>>>>>>> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>>>>>>>
>>>>>>> Patch that reverted the disabling of dependency reduced poms:
>>>>>>>
>>>>>>> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>>>>>>>
>>>>>>> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
>>>>>>> wrote:
>>>>>>> > Okay I did some forensics with Sean Owen. Some things about this
>>>>>>> > bug:
>>>>>>> >
>>>>>>> > 1. The underlying cause is that we added some code to make the
>>>>>>> > tests
>>>>>>> > of sub modules depend on the core tests. For unknown reasons this
>>>>>>> > causes Spark to hit MSHADE-148 for *some* combinations of build
>>>>>>> > profiles.
>>>>>>> >
>>>>>>> > 2. MSHADE-148 can be worked around by disabling building of
>>>>>>> > "dependency reduced poms" because then the buggy code path is
>>>>>>> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
>>>>>>> > However, that is not a tenable option for us because our
>>>>>>> > *published*
>>>>>>> > pom files require dependency reduction to substitute in the scala
>>>>>>> > version correctly for the poms published to maven central.
>>>>>>> >
>>>>>>> > 3. As a result, Andrew Or reverted his patch recently, causing some
>>>>>>> > package builds to start failing again (but publishing works now).
>>>>>>> >
>>>>>>> > 4. The reason this is not detected in our test harness or release
>>>>>>> > build is that it is sensitive to the profiles enabled. The
>>>>>>> > combination
>>>>>>> > of profiles we enable in the test harness and release builds do not
>>>>>>> > trigger this bug.
>>>>>>> >
>>>>>>> > The best path I see forward right now is to do the following:
>>>>>>> >
>>>>>>> > 1. Disable creation of dependency reduced poms by default (this
>>>>>>> > doesn't matter for people doing a package build) so typical users
>>>>>>> > won't have this bug.
>>>>>>> >
>>>>>>> > 2. Add a profile that re-enables that setting.
>>>>>>> >
>>>>>>> > 3. Use the above profile when publishing release artifacts to maven
>>>>>>> > central.
>>>>>>> >
>>>>>>> > 4. Hope that we don't hit this bug for publishing.
>>>>>>> >
>>>>>>> > - Patrick
>>>>>>> >
>>>>>>> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com>
>>>>>>> > wrote:
>>>>>>> >> Doesn't change anything for me.
>>>>>>> >>
>>>>>>> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell
>>>>>>> >> <pw...@gmail.com> wrote:
>>>>>>> >>>
>>>>>>> >>> Can you try using the built in maven "build/mvn..."? All of our
>>>>>>> >>> builds
>>>>>>> >>> are passing on Jenkins so I wonder if it's a maven version issue:
>>>>>>> >>>
>>>>>>> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>>>>>> >>>
>>>>>>> >>> - Patrick
>>>>>>> >>>
>>>>>>> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com>
>>>>>>> >>> wrote:
>>>>>>> >>> > Please take a look at SPARK-8781
>>>>>>> >>> > (https://github.com/apache/spark/pull/7193)
>>>>>>> >>> >
>>>>>>> >>> > Cheers
>>>>>>> >>> >
>>>>>>> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel
>>>>>>> >>> > <ta...@gmail.com> wrote:
>>>>>>> >>> >>
>>>>>>> >>> >> I found a solution, there might be a better one.
>>>>>>> >>> >>
>>>>>>> >>> >> https://github.com/apache/spark/pull/7217
>>>>>>> >>> >>
>>>>>>> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East
>>>>>>> >>> >> <ro...@xense.co.uk>
>>>>>>> >>> >> wrote:
>>>>>>> >>> >>>
>>>>>>> >>> >>> Yes me too
>>>>>>> >>> >>>
>>>>>>> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>>>>>> >>> >>>
>>>>>>> >>> >>> This is what I got (the last line was repeated non-stop):
>>>>>>> >>> >>>
>>>>>>> >>> >>> [INFO] Replacing original artifact with shaded artifact.
>>>>>>> >>> >>> [INFO] Replacing
>>>>>>> >>> >>>
>>>>>>> >>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>>>>>>> >>> >>> with
>>>>>>> >>> >>>
>>>>>>> >>> >>>
>>>>>>> >>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>>>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>>>>> >>> >>>
>>>>>>> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel
>>>>>>> >>> >>> <ta...@gmail.com>
>>>>>>> >>> >>> wrote:
>>>>>>> >>> >>>>
>>>>>>> >>> >>>> Hi all,
>>>>>>> >>> >>>>
>>>>>>> >>> >>>> I am trying to build the master, but it stucks and prints
>>>>>>> >>> >>>>
>>>>>>> >>> >>>> [INFO] Dependency-reduced POM written at:
>>>>>>> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>>>>>> >>> >>>>
>>>>>>> >>> >>>> build command: mvn -DskipTests clean package
>>>>>>> >>> >>>>
>>>>>>> >>> >>>> Do others have the same issue?
>>>>>>> >>> >>>>
>>>>>>> >>> >>>> Regards,
>>>>>>> >>> >>>> Tarek
>>>>>>> >>> >>>
>>>>>>> >>> >>>
>>>>>>> >>> >>>
>>>>>>> >>> >
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>>>>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>>>>>
>>>>>>
>>>>>
>>>>
>>
>
>
>
> --
> class Cocoatomo:
> name = 'cocoatomo'
> email_address = 'cocoatomo77@gmail.com'
> twitter_id = '@cocoatomo'
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Can not build master
Posted by tomo cocoa <co...@gmail.com>.
Hi all,
I have a same error and it seems depending on Maven versions.
I tried building Spark using Maven with several versions on Jenkins.
+ Output of
"/Users/tomohiko/.jenkins/tools/hudson.tasks.Maven_MavenInstallation/mvn-3.3.3/bin/mvn
-version":
Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06;
2015-04-22T20:57:37+09:00)
Maven home:
/Users/tomohiko/.jenkins/tools/hudson.tasks.Maven_MavenInstallation/mvn-3.3.3
Java version: 1.8.0, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
+ Jenkins Configuration:
Jenkins project type: Maven Project
Goals and options: -Phadoop-2.6 -DskipTests clean package
+ Maven versions and results:
3.3.3 -> infinite loop
3.3.1 -> infinite loop
3.2.5 -> SUCCESS
So do we prefer to build Spark with Maven 3.2.5?
On 4 July 2015 at 12:28, Andrew Or <an...@databricks.com> wrote:
> Thanks, I just tried it with 3.3.3 and I was able to reproduce it as well.
>
> 2015-07-03 18:51 GMT-07:00 Tarek Auel <ta...@gmail.com>:
>
>> That's mine
>>
>> Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06;
>> 2015-04-22T04:57:37-07:00)
>>
>> Maven home: /usr/local/Cellar/maven/3.3.3/libexec
>>
>> Java version: 1.8.0_45, vendor: Oracle Corporation
>>
>> Java home:
>> /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
>>
>> Default locale: en_US, platform encoding: UTF-8
>>
>> OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>>
>> On Fri, Jul 3, 2015 at 6:32 PM Ted Yu <yu...@gmail.com> wrote:
>>
>>> Here is mine:
>>>
>>> Apache Maven 3.3.1 (cab6659f9874fa96462afef40fcf6bc033d58c1c;
>>> 2015-03-13T13:10:27-07:00)
>>> Maven home: /home/hbase/apache-maven-3.3.1
>>> Java version: 1.8.0_45, vendor: Oracle Corporation
>>> Java home: /home/hbase/jdk1.8.0_45/jre
>>> Default locale: en_US, platform encoding: UTF-8
>>> OS name: "linux", version: "2.6.32-504.el6.x86_64", arch: "amd64",
>>> family: "unix"
>>>
>>> On Fri, Jul 3, 2015 at 6:05 PM, Andrew Or <an...@databricks.com> wrote:
>>>
>>>> @Tarek and Ted, what maven versions are you using?
>>>>
>>>> 2015-07-03 17:35 GMT-07:00 Krishna Sankar <ks...@gmail.com>:
>>>>
>>>>> Patrick,
>>>>> I assume an RC3 will be out for folks like me to test the
>>>>> distribution. As usual, I will run the tests when you have a new
>>>>> distribution.
>>>>> Cheers
>>>>> <k/>
>>>>>
>>>>> On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Patch that added test-jar dependencies:
>>>>>> https://github.com/apache/spark/commit/bfe74b34
>>>>>>
>>>>>> Patch that originally disabled dependency reduced poms:
>>>>>>
>>>>>> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>>>>>>
>>>>>> Patch that reverted the disabling of dependency reduced poms:
>>>>>>
>>>>>> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>>>>>>
>>>>>> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
>>>>>> wrote:
>>>>>> > Okay I did some forensics with Sean Owen. Some things about this
>>>>>> bug:
>>>>>> >
>>>>>> > 1. The underlying cause is that we added some code to make the tests
>>>>>> > of sub modules depend on the core tests. For unknown reasons this
>>>>>> > causes Spark to hit MSHADE-148 for *some* combinations of build
>>>>>> > profiles.
>>>>>> >
>>>>>> > 2. MSHADE-148 can be worked around by disabling building of
>>>>>> > "dependency reduced poms" because then the buggy code path is
>>>>>> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
>>>>>> > However, that is not a tenable option for us because our *published*
>>>>>> > pom files require dependency reduction to substitute in the scala
>>>>>> > version correctly for the poms published to maven central.
>>>>>> >
>>>>>> > 3. As a result, Andrew Or reverted his patch recently, causing some
>>>>>> > package builds to start failing again (but publishing works now).
>>>>>> >
>>>>>> > 4. The reason this is not detected in our test harness or release
>>>>>> > build is that it is sensitive to the profiles enabled. The
>>>>>> combination
>>>>>> > of profiles we enable in the test harness and release builds do not
>>>>>> > trigger this bug.
>>>>>> >
>>>>>> > The best path I see forward right now is to do the following:
>>>>>> >
>>>>>> > 1. Disable creation of dependency reduced poms by default (this
>>>>>> > doesn't matter for people doing a package build) so typical users
>>>>>> > won't have this bug.
>>>>>> >
>>>>>> > 2. Add a profile that re-enables that setting.
>>>>>> >
>>>>>> > 3. Use the above profile when publishing release artifacts to maven
>>>>>> central.
>>>>>> >
>>>>>> > 4. Hope that we don't hit this bug for publishing.
>>>>>> >
>>>>>> > - Patrick
>>>>>> >
>>>>>> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com>
>>>>>> wrote:
>>>>>> >> Doesn't change anything for me.
>>>>>> >>
>>>>>> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com>
>>>>>> wrote:
>>>>>> >>>
>>>>>> >>> Can you try using the built in maven "build/mvn..."? All of our
>>>>>> builds
>>>>>> >>> are passing on Jenkins so I wonder if it's a maven version issue:
>>>>>> >>>
>>>>>> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>>>>> >>>
>>>>>> >>> - Patrick
>>>>>> >>>
>>>>>> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com>
>>>>>> wrote:
>>>>>> >>> > Please take a look at SPARK-8781
>>>>>> >>> > (https://github.com/apache/spark/pull/7193)
>>>>>> >>> >
>>>>>> >>> > Cheers
>>>>>> >>> >
>>>>>> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <
>>>>>> tarek.auel@gmail.com> wrote:
>>>>>> >>> >>
>>>>>> >>> >> I found a solution, there might be a better one.
>>>>>> >>> >>
>>>>>> >>> >> https://github.com/apache/spark/pull/7217
>>>>>> >>> >>
>>>>>> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <
>>>>>> robin.east@xense.co.uk>
>>>>>> >>> >> wrote:
>>>>>> >>> >>>
>>>>>> >>> >>> Yes me too
>>>>>> >>> >>>
>>>>>> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>>>>> >>> >>>
>>>>>> >>> >>> This is what I got (the last line was repeated non-stop):
>>>>>> >>> >>>
>>>>>> >>> >>> [INFO] Replacing original artifact with shaded artifact.
>>>>>> >>> >>> [INFO] Replacing
>>>>>> >>> >>>
>>>>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>>>>>> >>> >>> with
>>>>>> >>> >>>
>>>>>> >>> >>>
>>>>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>>>> >>> >>>
>>>>>> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <
>>>>>> tarek.auel@gmail.com>
>>>>>> >>> >>> wrote:
>>>>>> >>> >>>>
>>>>>> >>> >>>> Hi all,
>>>>>> >>> >>>>
>>>>>> >>> >>>> I am trying to build the master, but it stucks and prints
>>>>>> >>> >>>>
>>>>>> >>> >>>> [INFO] Dependency-reduced POM written at:
>>>>>> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>>>>> >>> >>>>
>>>>>> >>> >>>> build command: mvn -DskipTests clean package
>>>>>> >>> >>>>
>>>>>> >>> >>>> Do others have the same issue?
>>>>>> >>> >>>>
>>>>>> >>> >>>> Regards,
>>>>>> >>> >>>> Tarek
>>>>>> >>> >>>
>>>>>> >>> >>>
>>>>>> >>> >>>
>>>>>> >>> >
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>>>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>
--
class Cocoatomo:
name = 'cocoatomo'
email_address = 'cocoatomo77@gmail.com'
twitter_id = '@cocoatomo'
Re: Can not build master
Posted by Andrew Or <an...@databricks.com>.
Thanks, I just tried it with 3.3.3 and I was able to reproduce it as well.
2015-07-03 18:51 GMT-07:00 Tarek Auel <ta...@gmail.com>:
> That's mine
>
> Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06;
> 2015-04-22T04:57:37-07:00)
>
> Maven home: /usr/local/Cellar/maven/3.3.3/libexec
>
> Java version: 1.8.0_45, vendor: Oracle Corporation
>
> Java home:
> /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
>
> Default locale: en_US, platform encoding: UTF-8
>
> OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
>
> On Fri, Jul 3, 2015 at 6:32 PM Ted Yu <yu...@gmail.com> wrote:
>
>> Here is mine:
>>
>> Apache Maven 3.3.1 (cab6659f9874fa96462afef40fcf6bc033d58c1c;
>> 2015-03-13T13:10:27-07:00)
>> Maven home: /home/hbase/apache-maven-3.3.1
>> Java version: 1.8.0_45, vendor: Oracle Corporation
>> Java home: /home/hbase/jdk1.8.0_45/jre
>> Default locale: en_US, platform encoding: UTF-8
>> OS name: "linux", version: "2.6.32-504.el6.x86_64", arch: "amd64",
>> family: "unix"
>>
>> On Fri, Jul 3, 2015 at 6:05 PM, Andrew Or <an...@databricks.com> wrote:
>>
>>> @Tarek and Ted, what maven versions are you using?
>>>
>>> 2015-07-03 17:35 GMT-07:00 Krishna Sankar <ks...@gmail.com>:
>>>
>>>> Patrick,
>>>> I assume an RC3 will be out for folks like me to test the
>>>> distribution. As usual, I will run the tests when you have a new
>>>> distribution.
>>>> Cheers
>>>> <k/>
>>>>
>>>> On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com>
>>>> wrote:
>>>>
>>>>> Patch that added test-jar dependencies:
>>>>> https://github.com/apache/spark/commit/bfe74b34
>>>>>
>>>>> Patch that originally disabled dependency reduced poms:
>>>>>
>>>>> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>>>>>
>>>>> Patch that reverted the disabling of dependency reduced poms:
>>>>>
>>>>> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>>>>>
>>>>> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
>>>>> wrote:
>>>>> > Okay I did some forensics with Sean Owen. Some things about this bug:
>>>>> >
>>>>> > 1. The underlying cause is that we added some code to make the tests
>>>>> > of sub modules depend on the core tests. For unknown reasons this
>>>>> > causes Spark to hit MSHADE-148 for *some* combinations of build
>>>>> > profiles.
>>>>> >
>>>>> > 2. MSHADE-148 can be worked around by disabling building of
>>>>> > "dependency reduced poms" because then the buggy code path is
>>>>> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
>>>>> > However, that is not a tenable option for us because our *published*
>>>>> > pom files require dependency reduction to substitute in the scala
>>>>> > version correctly for the poms published to maven central.
>>>>> >
>>>>> > 3. As a result, Andrew Or reverted his patch recently, causing some
>>>>> > package builds to start failing again (but publishing works now).
>>>>> >
>>>>> > 4. The reason this is not detected in our test harness or release
>>>>> > build is that it is sensitive to the profiles enabled. The
>>>>> combination
>>>>> > of profiles we enable in the test harness and release builds do not
>>>>> > trigger this bug.
>>>>> >
>>>>> > The best path I see forward right now is to do the following:
>>>>> >
>>>>> > 1. Disable creation of dependency reduced poms by default (this
>>>>> > doesn't matter for people doing a package build) so typical users
>>>>> > won't have this bug.
>>>>> >
>>>>> > 2. Add a profile that re-enables that setting.
>>>>> >
>>>>> > 3. Use the above profile when publishing release artifacts to maven
>>>>> central.
>>>>> >
>>>>> > 4. Hope that we don't hit this bug for publishing.
>>>>> >
>>>>> > - Patrick
>>>>> >
>>>>> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com>
>>>>> wrote:
>>>>> >> Doesn't change anything for me.
>>>>> >>
>>>>> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com>
>>>>> wrote:
>>>>> >>>
>>>>> >>> Can you try using the built in maven "build/mvn..."? All of our
>>>>> builds
>>>>> >>> are passing on Jenkins so I wonder if it's a maven version issue:
>>>>> >>>
>>>>> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>>>> >>>
>>>>> >>> - Patrick
>>>>> >>>
>>>>> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com>
>>>>> wrote:
>>>>> >>> > Please take a look at SPARK-8781
>>>>> >>> > (https://github.com/apache/spark/pull/7193)
>>>>> >>> >
>>>>> >>> > Cheers
>>>>> >>> >
>>>>> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com>
>>>>> wrote:
>>>>> >>> >>
>>>>> >>> >> I found a solution, there might be a better one.
>>>>> >>> >>
>>>>> >>> >> https://github.com/apache/spark/pull/7217
>>>>> >>> >>
>>>>> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <
>>>>> robin.east@xense.co.uk>
>>>>> >>> >> wrote:
>>>>> >>> >>>
>>>>> >>> >>> Yes me too
>>>>> >>> >>>
>>>>> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>>>> >>> >>>
>>>>> >>> >>> This is what I got (the last line was repeated non-stop):
>>>>> >>> >>>
>>>>> >>> >>> [INFO] Replacing original artifact with shaded artifact.
>>>>> >>> >>> [INFO] Replacing
>>>>> >>> >>>
>>>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>>>>> >>> >>> with
>>>>> >>> >>>
>>>>> >>> >>>
>>>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>>> >>> >>>
>>>>> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <
>>>>> tarek.auel@gmail.com>
>>>>> >>> >>> wrote:
>>>>> >>> >>>>
>>>>> >>> >>>> Hi all,
>>>>> >>> >>>>
>>>>> >>> >>>> I am trying to build the master, but it stucks and prints
>>>>> >>> >>>>
>>>>> >>> >>>> [INFO] Dependency-reduced POM written at:
>>>>> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>>>> >>> >>>>
>>>>> >>> >>>> build command: mvn -DskipTests clean package
>>>>> >>> >>>>
>>>>> >>> >>>> Do others have the same issue?
>>>>> >>> >>>>
>>>>> >>> >>>> Regards,
>>>>> >>> >>>> Tarek
>>>>> >>> >>>
>>>>> >>> >>>
>>>>> >>> >>>
>>>>> >>> >
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>>>
>>>>>
>>>>
>>>
>>
Re: Can not build master
Posted by Tarek Auel <ta...@gmail.com>.
That's mine
Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06;
2015-04-22T04:57:37-07:00)
Maven home: /usr/local/Cellar/maven/3.3.3/libexec
Java version: 1.8.0_45, vendor: Oracle Corporation
Java home:
/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.10.3", arch: "x86_64", family: "mac"
On Fri, Jul 3, 2015 at 6:32 PM Ted Yu <yu...@gmail.com> wrote:
> Here is mine:
>
> Apache Maven 3.3.1 (cab6659f9874fa96462afef40fcf6bc033d58c1c;
> 2015-03-13T13:10:27-07:00)
> Maven home: /home/hbase/apache-maven-3.3.1
> Java version: 1.8.0_45, vendor: Oracle Corporation
> Java home: /home/hbase/jdk1.8.0_45/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "2.6.32-504.el6.x86_64", arch: "amd64", family:
> "unix"
>
> On Fri, Jul 3, 2015 at 6:05 PM, Andrew Or <an...@databricks.com> wrote:
>
>> @Tarek and Ted, what maven versions are you using?
>>
>> 2015-07-03 17:35 GMT-07:00 Krishna Sankar <ks...@gmail.com>:
>>
>>> Patrick,
>>> I assume an RC3 will be out for folks like me to test the
>>> distribution. As usual, I will run the tests when you have a new
>>> distribution.
>>> Cheers
>>> <k/>
>>>
>>> On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com>
>>> wrote:
>>>
>>>> Patch that added test-jar dependencies:
>>>> https://github.com/apache/spark/commit/bfe74b34
>>>>
>>>> Patch that originally disabled dependency reduced poms:
>>>>
>>>> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>>>>
>>>> Patch that reverted the disabling of dependency reduced poms:
>>>>
>>>> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>>>>
>>>> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
>>>> wrote:
>>>> > Okay I did some forensics with Sean Owen. Some things about this bug:
>>>> >
>>>> > 1. The underlying cause is that we added some code to make the tests
>>>> > of sub modules depend on the core tests. For unknown reasons this
>>>> > causes Spark to hit MSHADE-148 for *some* combinations of build
>>>> > profiles.
>>>> >
>>>> > 2. MSHADE-148 can be worked around by disabling building of
>>>> > "dependency reduced poms" because then the buggy code path is
>>>> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
>>>> > However, that is not a tenable option for us because our *published*
>>>> > pom files require dependency reduction to substitute in the scala
>>>> > version correctly for the poms published to maven central.
>>>> >
>>>> > 3. As a result, Andrew Or reverted his patch recently, causing some
>>>> > package builds to start failing again (but publishing works now).
>>>> >
>>>> > 4. The reason this is not detected in our test harness or release
>>>> > build is that it is sensitive to the profiles enabled. The combination
>>>> > of profiles we enable in the test harness and release builds do not
>>>> > trigger this bug.
>>>> >
>>>> > The best path I see forward right now is to do the following:
>>>> >
>>>> > 1. Disable creation of dependency reduced poms by default (this
>>>> > doesn't matter for people doing a package build) so typical users
>>>> > won't have this bug.
>>>> >
>>>> > 2. Add a profile that re-enables that setting.
>>>> >
>>>> > 3. Use the above profile when publishing release artifacts to maven
>>>> central.
>>>> >
>>>> > 4. Hope that we don't hit this bug for publishing.
>>>> >
>>>> > - Patrick
>>>> >
>>>> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com>
>>>> wrote:
>>>> >> Doesn't change anything for me.
>>>> >>
>>>> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com>
>>>> wrote:
>>>> >>>
>>>> >>> Can you try using the built in maven "build/mvn..."? All of our
>>>> builds
>>>> >>> are passing on Jenkins so I wonder if it's a maven version issue:
>>>> >>>
>>>> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>>> >>>
>>>> >>> - Patrick
>>>> >>>
>>>> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
>>>> >>> > Please take a look at SPARK-8781
>>>> >>> > (https://github.com/apache/spark/pull/7193)
>>>> >>> >
>>>> >>> > Cheers
>>>> >>> >
>>>> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com>
>>>> wrote:
>>>> >>> >>
>>>> >>> >> I found a solution, there might be a better one.
>>>> >>> >>
>>>> >>> >> https://github.com/apache/spark/pull/7217
>>>> >>> >>
>>>> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <
>>>> robin.east@xense.co.uk>
>>>> >>> >> wrote:
>>>> >>> >>>
>>>> >>> >>> Yes me too
>>>> >>> >>>
>>>> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>>> >>> >>>
>>>> >>> >>> This is what I got (the last line was repeated non-stop):
>>>> >>> >>>
>>>> >>> >>> [INFO] Replacing original artifact with shaded artifact.
>>>> >>> >>> [INFO] Replacing
>>>> >>> >>>
>>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>>>> >>> >>> with
>>>> >>> >>>
>>>> >>> >>>
>>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>> >>> >>>
>>>> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <
>>>> tarek.auel@gmail.com>
>>>> >>> >>> wrote:
>>>> >>> >>>>
>>>> >>> >>>> Hi all,
>>>> >>> >>>>
>>>> >>> >>>> I am trying to build the master, but it stucks and prints
>>>> >>> >>>>
>>>> >>> >>>> [INFO] Dependency-reduced POM written at:
>>>> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>>> >>> >>>>
>>>> >>> >>>> build command: mvn -DskipTests clean package
>>>> >>> >>>>
>>>> >>> >>>> Do others have the same issue?
>>>> >>> >>>>
>>>> >>> >>>> Regards,
>>>> >>> >>>> Tarek
>>>> >>> >>>
>>>> >>> >>>
>>>> >>> >>>
>>>> >>> >
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>>
>>>>
>>>
>>
>
Re: Can not build master
Posted by Ted Yu <yu...@gmail.com>.
Here is mine:
Apache Maven 3.3.1 (cab6659f9874fa96462afef40fcf6bc033d58c1c;
2015-03-13T13:10:27-07:00)
Maven home: /home/hbase/apache-maven-3.3.1
Java version: 1.8.0_45, vendor: Oracle Corporation
Java home: /home/hbase/jdk1.8.0_45/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-504.el6.x86_64", arch: "amd64", family:
"unix"
On Fri, Jul 3, 2015 at 6:05 PM, Andrew Or <an...@databricks.com> wrote:
> @Tarek and Ted, what maven versions are you using?
>
> 2015-07-03 17:35 GMT-07:00 Krishna Sankar <ks...@gmail.com>:
>
>> Patrick,
>> I assume an RC3 will be out for folks like me to test the
>> distribution. As usual, I will run the tests when you have a new
>> distribution.
>> Cheers
>> <k/>
>>
>> On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com>
>> wrote:
>>
>>> Patch that added test-jar dependencies:
>>> https://github.com/apache/spark/commit/bfe74b34
>>>
>>> Patch that originally disabled dependency reduced poms:
>>>
>>> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>>>
>>> Patch that reverted the disabling of dependency reduced poms:
>>>
>>> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>>>
>>> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
>>> wrote:
>>> > Okay I did some forensics with Sean Owen. Some things about this bug:
>>> >
>>> > 1. The underlying cause is that we added some code to make the tests
>>> > of sub modules depend on the core tests. For unknown reasons this
>>> > causes Spark to hit MSHADE-148 for *some* combinations of build
>>> > profiles.
>>> >
>>> > 2. MSHADE-148 can be worked around by disabling building of
>>> > "dependency reduced poms" because then the buggy code path is
>>> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
>>> > However, that is not a tenable option for us because our *published*
>>> > pom files require dependency reduction to substitute in the scala
>>> > version correctly for the poms published to maven central.
>>> >
>>> > 3. As a result, Andrew Or reverted his patch recently, causing some
>>> > package builds to start failing again (but publishing works now).
>>> >
>>> > 4. The reason this is not detected in our test harness or release
>>> > build is that it is sensitive to the profiles enabled. The combination
>>> > of profiles we enable in the test harness and release builds do not
>>> > trigger this bug.
>>> >
>>> > The best path I see forward right now is to do the following:
>>> >
>>> > 1. Disable creation of dependency reduced poms by default (this
>>> > doesn't matter for people doing a package build) so typical users
>>> > won't have this bug.
>>> >
>>> > 2. Add a profile that re-enables that setting.
>>> >
>>> > 3. Use the above profile when publishing release artifacts to maven
>>> central.
>>> >
>>> > 4. Hope that we don't hit this bug for publishing.
>>> >
>>> > - Patrick
>>> >
>>> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com>
>>> wrote:
>>> >> Doesn't change anything for me.
>>> >>
>>> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com>
>>> wrote:
>>> >>>
>>> >>> Can you try using the built in maven "build/mvn..."? All of our
>>> builds
>>> >>> are passing on Jenkins so I wonder if it's a maven version issue:
>>> >>>
>>> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>> >>>
>>> >>> - Patrick
>>> >>>
>>> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
>>> >>> > Please take a look at SPARK-8781
>>> >>> > (https://github.com/apache/spark/pull/7193)
>>> >>> >
>>> >>> > Cheers
>>> >>> >
>>> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com>
>>> wrote:
>>> >>> >>
>>> >>> >> I found a solution, there might be a better one.
>>> >>> >>
>>> >>> >> https://github.com/apache/spark/pull/7217
>>> >>> >>
>>> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <robin.east@xense.co.uk
>>> >
>>> >>> >> wrote:
>>> >>> >>>
>>> >>> >>> Yes me too
>>> >>> >>>
>>> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>> >>> >>>
>>> >>> >>> This is what I got (the last line was repeated non-stop):
>>> >>> >>>
>>> >>> >>> [INFO] Replacing original artifact with shaded artifact.
>>> >>> >>> [INFO] Replacing
>>> >>> >>>
>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>>> >>> >>> with
>>> >>> >>>
>>> >>> >>>
>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>> >>> >>> [INFO] Dependency-reduced POM written at:
>>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>> >>> >>>
>>> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <tarek.auel@gmail.com
>>> >
>>> >>> >>> wrote:
>>> >>> >>>>
>>> >>> >>>> Hi all,
>>> >>> >>>>
>>> >>> >>>> I am trying to build the master, but it stucks and prints
>>> >>> >>>>
>>> >>> >>>> [INFO] Dependency-reduced POM written at:
>>> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>> >>> >>>>
>>> >>> >>>> build command: mvn -DskipTests clean package
>>> >>> >>>>
>>> >>> >>>> Do others have the same issue?
>>> >>> >>>>
>>> >>> >>>> Regards,
>>> >>> >>>> Tarek
>>> >>> >>>
>>> >>> >>>
>>> >>> >>>
>>> >>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>
>>>
>>
>
Re: Can not build master
Posted by Andrew Or <an...@databricks.com>.
@Tarek and Ted, what maven versions are you using?
2015-07-03 17:35 GMT-07:00 Krishna Sankar <ks...@gmail.com>:
> Patrick,
> I assume an RC3 will be out for folks like me to test the distribution.
> As usual, I will run the tests when you have a new distribution.
> Cheers
> <k/>
>
> On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
>> Patch that added test-jar dependencies:
>> https://github.com/apache/spark/commit/bfe74b34
>>
>> Patch that originally disabled dependency reduced poms:
>>
>> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>>
>> Patch that reverted the disabling of dependency reduced poms:
>>
>> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>>
>> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
>> wrote:
>> > Okay I did some forensics with Sean Owen. Some things about this bug:
>> >
>> > 1. The underlying cause is that we added some code to make the tests
>> > of sub modules depend on the core tests. For unknown reasons this
>> > causes Spark to hit MSHADE-148 for *some* combinations of build
>> > profiles.
>> >
>> > 2. MSHADE-148 can be worked around by disabling building of
>> > "dependency reduced poms" because then the buggy code path is
>> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
>> > However, that is not a tenable option for us because our *published*
>> > pom files require dependency reduction to substitute in the scala
>> > version correctly for the poms published to maven central.
>> >
>> > 3. As a result, Andrew Or reverted his patch recently, causing some
>> > package builds to start failing again (but publishing works now).
>> >
>> > 4. The reason this is not detected in our test harness or release
>> > build is that it is sensitive to the profiles enabled. The combination
>> > of profiles we enable in the test harness and release builds do not
>> > trigger this bug.
>> >
>> > The best path I see forward right now is to do the following:
>> >
>> > 1. Disable creation of dependency reduced poms by default (this
>> > doesn't matter for people doing a package build) so typical users
>> > won't have this bug.
>> >
>> > 2. Add a profile that re-enables that setting.
>> >
>> > 3. Use the above profile when publishing release artifacts to maven
>> central.
>> >
>> > 4. Hope that we don't hit this bug for publishing.
>> >
>> > - Patrick
>> >
>> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com>
>> wrote:
>> >> Doesn't change anything for me.
>> >>
>> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com>
>> wrote:
>> >>>
>> >>> Can you try using the built in maven "build/mvn..."? All of our builds
>> >>> are passing on Jenkins so I wonder if it's a maven version issue:
>> >>>
>> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>> >>>
>> >>> - Patrick
>> >>>
>> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
>> >>> > Please take a look at SPARK-8781
>> >>> > (https://github.com/apache/spark/pull/7193)
>> >>> >
>> >>> > Cheers
>> >>> >
>> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com>
>> wrote:
>> >>> >>
>> >>> >> I found a solution, there might be a better one.
>> >>> >>
>> >>> >> https://github.com/apache/spark/pull/7217
>> >>> >>
>> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk>
>> >>> >> wrote:
>> >>> >>>
>> >>> >>> Yes me too
>> >>> >>>
>> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>> >>> >>>
>> >>> >>> This is what I got (the last line was repeated non-stop):
>> >>> >>>
>> >>> >>> [INFO] Replacing original artifact with shaded artifact.
>> >>> >>> [INFO] Replacing
>> >>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>> >>> >>> with
>> >>> >>>
>> >>> >>>
>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>> >>> >>> [INFO] Dependency-reduced POM written at:
>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>> >>> >>> [INFO] Dependency-reduced POM written at:
>> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>> >>> >>>
>> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com>
>> >>> >>> wrote:
>> >>> >>>>
>> >>> >>>> Hi all,
>> >>> >>>>
>> >>> >>>> I am trying to build the master, but it stucks and prints
>> >>> >>>>
>> >>> >>>> [INFO] Dependency-reduced POM written at:
>> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>> >>> >>>>
>> >>> >>>> build command: mvn -DskipTests clean package
>> >>> >>>>
>> >>> >>>> Do others have the same issue?
>> >>> >>>>
>> >>> >>>> Regards,
>> >>> >>>> Tarek
>> >>> >>>
>> >>> >>>
>> >>> >>>
>> >>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
>
Re: Can not build master
Posted by Krishna Sankar <ks...@gmail.com>.
Patrick,
I assume an RC3 will be out for folks like me to test the distribution.
As usual, I will run the tests when you have a new distribution.
Cheers
<k/>
On Fri, Jul 3, 2015 at 4:38 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Patch that added test-jar dependencies:
> https://github.com/apache/spark/commit/bfe74b34
>
> Patch that originally disabled dependency reduced poms:
>
> https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
>
> Patch that reverted the disabling of dependency reduced poms:
>
> https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
>
> On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
> > Okay I did some forensics with Sean Owen. Some things about this bug:
> >
> > 1. The underlying cause is that we added some code to make the tests
> > of sub modules depend on the core tests. For unknown reasons this
> > causes Spark to hit MSHADE-148 for *some* combinations of build
> > profiles.
> >
> > 2. MSHADE-148 can be worked around by disabling building of
> > "dependency reduced poms" because then the buggy code path is
> > circumvented. Andrew Or did this in a patch on the 1.4 branch.
> > However, that is not a tenable option for us because our *published*
> > pom files require dependency reduction to substitute in the scala
> > version correctly for the poms published to maven central.
> >
> > 3. As a result, Andrew Or reverted his patch recently, causing some
> > package builds to start failing again (but publishing works now).
> >
> > 4. The reason this is not detected in our test harness or release
> > build is that it is sensitive to the profiles enabled. The combination
> > of profiles we enable in the test harness and release builds do not
> > trigger this bug.
> >
> > The best path I see forward right now is to do the following:
> >
> > 1. Disable creation of dependency reduced poms by default (this
> > doesn't matter for people doing a package build) so typical users
> > won't have this bug.
> >
> > 2. Add a profile that re-enables that setting.
> >
> > 3. Use the above profile when publishing release artifacts to maven
> central.
> >
> > 4. Hope that we don't hit this bug for publishing.
> >
> > - Patrick
> >
> > On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com> wrote:
> >> Doesn't change anything for me.
> >>
> >> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com>
> wrote:
> >>>
> >>> Can you try using the built in maven "build/mvn..."? All of our builds
> >>> are passing on Jenkins so I wonder if it's a maven version issue:
> >>>
> >>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
> >>>
> >>> - Patrick
> >>>
> >>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
> >>> > Please take a look at SPARK-8781
> >>> > (https://github.com/apache/spark/pull/7193)
> >>> >
> >>> > Cheers
> >>> >
> >>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com>
> wrote:
> >>> >>
> >>> >> I found a solution, there might be a better one.
> >>> >>
> >>> >> https://github.com/apache/spark/pull/7217
> >>> >>
> >>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk>
> >>> >> wrote:
> >>> >>>
> >>> >>> Yes me too
> >>> >>>
> >>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
> >>> >>>
> >>> >>> This is what I got (the last line was repeated non-stop):
> >>> >>>
> >>> >>> [INFO] Replacing original artifact with shaded artifact.
> >>> >>> [INFO] Replacing
> >>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
> >>> >>> with
> >>> >>>
> >>> >>>
> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
> >>> >>> [INFO] Dependency-reduced POM written at:
> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
> >>> >>> [INFO] Dependency-reduced POM written at:
> >>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
> >>> >>>
> >>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com>
> >>> >>> wrote:
> >>> >>>>
> >>> >>>> Hi all,
> >>> >>>>
> >>> >>>> I am trying to build the master, but it stucks and prints
> >>> >>>>
> >>> >>>> [INFO] Dependency-reduced POM written at:
> >>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
> >>> >>>>
> >>> >>>> build command: mvn -DskipTests clean package
> >>> >>>>
> >>> >>>> Do others have the same issue?
> >>> >>>>
> >>> >>>> Regards,
> >>> >>>> Tarek
> >>> >>>
> >>> >>>
> >>> >>>
> >>> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: Can not build master
Posted by Patrick Wendell <pw...@gmail.com>.
Patch that added test-jar dependencies:
https://github.com/apache/spark/commit/bfe74b34
Patch that originally disabled dependency reduced poms:
https://github.com/apache/spark/commit/984ad60147c933f2d5a2040c87ae687c14eb1724
Patch that reverted the disabling of dependency reduced poms:
https://github.com/apache/spark/commit/bc51bcaea734fe64a90d007559e76f5ceebfea9e
On Fri, Jul 3, 2015 at 4:36 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Okay I did some forensics with Sean Owen. Some things about this bug:
>
> 1. The underlying cause is that we added some code to make the tests
> of sub modules depend on the core tests. For unknown reasons this
> causes Spark to hit MSHADE-148 for *some* combinations of build
> profiles.
>
> 2. MSHADE-148 can be worked around by disabling building of
> "dependency reduced poms" because then the buggy code path is
> circumvented. Andrew Or did this in a patch on the 1.4 branch.
> However, that is not a tenable option for us because our *published*
> pom files require dependency reduction to substitute in the scala
> version correctly for the poms published to maven central.
>
> 3. As a result, Andrew Or reverted his patch recently, causing some
> package builds to start failing again (but publishing works now).
>
> 4. The reason this is not detected in our test harness or release
> build is that it is sensitive to the profiles enabled. The combination
> of profiles we enable in the test harness and release builds do not
> trigger this bug.
>
> The best path I see forward right now is to do the following:
>
> 1. Disable creation of dependency reduced poms by default (this
> doesn't matter for people doing a package build) so typical users
> won't have this bug.
>
> 2. Add a profile that re-enables that setting.
>
> 3. Use the above profile when publishing release artifacts to maven central.
>
> 4. Hope that we don't hit this bug for publishing.
>
> - Patrick
>
> On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com> wrote:
>> Doesn't change anything for me.
>>
>> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com> wrote:
>>>
>>> Can you try using the built in maven "build/mvn..."? All of our builds
>>> are passing on Jenkins so I wonder if it's a maven version issue:
>>>
>>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>>
>>> - Patrick
>>>
>>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
>>> > Please take a look at SPARK-8781
>>> > (https://github.com/apache/spark/pull/7193)
>>> >
>>> > Cheers
>>> >
>>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com> wrote:
>>> >>
>>> >> I found a solution, there might be a better one.
>>> >>
>>> >> https://github.com/apache/spark/pull/7217
>>> >>
>>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk>
>>> >> wrote:
>>> >>>
>>> >>> Yes me too
>>> >>>
>>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>> >>>
>>> >>> This is what I got (the last line was repeated non-stop):
>>> >>>
>>> >>> [INFO] Replacing original artifact with shaded artifact.
>>> >>> [INFO] Replacing
>>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>>> >>> with
>>> >>>
>>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>> >>> [INFO] Dependency-reduced POM written at:
>>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>> >>> [INFO] Dependency-reduced POM written at:
>>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>> >>>
>>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com>
>>> >>> wrote:
>>> >>>>
>>> >>>> Hi all,
>>> >>>>
>>> >>>> I am trying to build the master, but it stucks and prints
>>> >>>>
>>> >>>> [INFO] Dependency-reduced POM written at:
>>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>> >>>>
>>> >>>> build command: mvn -DskipTests clean package
>>> >>>>
>>> >>>> Do others have the same issue?
>>> >>>>
>>> >>>> Regards,
>>> >>>> Tarek
>>> >>>
>>> >>>
>>> >>>
>>> >
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Can not build master
Posted by Patrick Wendell <pw...@gmail.com>.
Okay I did some forensics with Sean Owen. Some things about this bug:
1. The underlying cause is that we added some code to make the tests
of sub modules depend on the core tests. For unknown reasons this
causes Spark to hit MSHADE-148 for *some* combinations of build
profiles.
2. MSHADE-148 can be worked around by disabling building of
"dependency reduced poms" because then the buggy code path is
circumvented. Andrew Or did this in a patch on the 1.4 branch.
However, that is not a tenable option for us because our *published*
pom files require dependency reduction to substitute in the scala
version correctly for the poms published to maven central.
3. As a result, Andrew Or reverted his patch recently, causing some
package builds to start failing again (but publishing works now).
4. The reason this is not detected in our test harness or release
build is that it is sensitive to the profiles enabled. The combination
of profiles we enable in the test harness and release builds do not
trigger this bug.
The best path I see forward right now is to do the following:
1. Disable creation of dependency reduced poms by default (this
doesn't matter for people doing a package build) so typical users
won't have this bug.
2. Add a profile that re-enables that setting.
3. Use the above profile when publishing release artifacts to maven central.
4. Hope that we don't hit this bug for publishing.
- Patrick
On Fri, Jul 3, 2015 at 3:51 PM, Tarek Auel <ta...@gmail.com> wrote:
> Doesn't change anything for me.
>
> On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com> wrote:
>>
>> Can you try using the built in maven "build/mvn..."? All of our builds
>> are passing on Jenkins so I wonder if it's a maven version issue:
>>
>> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>>
>> - Patrick
>>
>> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
>> > Please take a look at SPARK-8781
>> > (https://github.com/apache/spark/pull/7193)
>> >
>> > Cheers
>> >
>> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com> wrote:
>> >>
>> >> I found a solution, there might be a better one.
>> >>
>> >> https://github.com/apache/spark/pull/7217
>> >>
>> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk>
>> >> wrote:
>> >>>
>> >>> Yes me too
>> >>>
>> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>> >>>
>> >>> This is what I got (the last line was repeated non-stop):
>> >>>
>> >>> [INFO] Replacing original artifact with shaded artifact.
>> >>> [INFO] Replacing
>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar
>> >>> with
>> >>>
>> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>> >>> [INFO] Dependency-reduced POM written at:
>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>> >>> [INFO] Dependency-reduced POM written at:
>> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>> >>>
>> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com>
>> >>> wrote:
>> >>>>
>> >>>> Hi all,
>> >>>>
>> >>>> I am trying to build the master, but it stucks and prints
>> >>>>
>> >>>> [INFO] Dependency-reduced POM written at:
>> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>> >>>>
>> >>>> build command: mvn -DskipTests clean package
>> >>>>
>> >>>> Do others have the same issue?
>> >>>>
>> >>>> Regards,
>> >>>> Tarek
>> >>>
>> >>>
>> >>>
>> >
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Can not build master
Posted by Tarek Auel <ta...@gmail.com>.
Doesn't change anything for me.
On Fri, Jul 3, 2015 at 3:45 PM Patrick Wendell <pw...@gmail.com> wrote:
> Can you try using the built in maven "build/mvn..."? All of our builds
> are passing on Jenkins so I wonder if it's a maven version issue:
>
> https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
>
> - Patrick
>
> On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
> > Please take a look at SPARK-8781 (
> https://github.com/apache/spark/pull/7193)
> >
> > Cheers
> >
> > On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com> wrote:
> >>
> >> I found a solution, there might be a better one.
> >>
> >> https://github.com/apache/spark/pull/7217
> >>
> >> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk>
> wrote:
> >>>
> >>> Yes me too
> >>>
> >>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
> >>>
> >>> This is what I got (the last line was repeated non-stop):
> >>>
> >>> [INFO] Replacing original artifact with shaded artifact.
> >>> [INFO] Replacing
> >>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with
> >>>
> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
> >>> [INFO] Dependency-reduced POM written at:
> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
> >>> [INFO] Dependency-reduced POM written at:
> >>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
> >>>
> >>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com>
> wrote:
> >>>>
> >>>> Hi all,
> >>>>
> >>>> I am trying to build the master, but it stucks and prints
> >>>>
> >>>> [INFO] Dependency-reduced POM written at:
> >>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
> >>>>
> >>>> build command: mvn -DskipTests clean package
> >>>>
> >>>> Do others have the same issue?
> >>>>
> >>>> Regards,
> >>>> Tarek
> >>>
> >>>
> >>>
> >
>
Re: Can not build master
Posted by Patrick Wendell <pw...@gmail.com>.
Can you try using the built in maven "build/mvn..."? All of our builds
are passing on Jenkins so I wonder if it's a maven version issue:
https://amplab.cs.berkeley.edu/jenkins/view/Spark-QA-Compile/
- Patrick
On Fri, Jul 3, 2015 at 3:14 PM, Ted Yu <yu...@gmail.com> wrote:
> Please take a look at SPARK-8781 (https://github.com/apache/spark/pull/7193)
>
> Cheers
>
> On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com> wrote:
>>
>> I found a solution, there might be a better one.
>>
>> https://github.com/apache/spark/pull/7217
>>
>> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk> wrote:
>>>
>>> Yes me too
>>>
>>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>>
>>> This is what I got (the last line was repeated non-stop):
>>>
>>> [INFO] Replacing original artifact with shaded artifact.
>>> [INFO] Replacing
>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with
>>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>>> [INFO] Dependency-reduced POM written at:
>>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>> [INFO] Dependency-reduced POM written at:
>>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>>
>>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com> wrote:
>>>>
>>>> Hi all,
>>>>
>>>> I am trying to build the master, but it stucks and prints
>>>>
>>>> [INFO] Dependency-reduced POM written at:
>>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>>>
>>>> build command: mvn -DskipTests clean package
>>>>
>>>> Do others have the same issue?
>>>>
>>>> Regards,
>>>> Tarek
>>>
>>>
>>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Can not build master
Posted by Ted Yu <yu...@gmail.com>.
Please take a look at SPARK-8781 (https://github.com/apache/spark/pull/7193)
Cheers
On Fri, Jul 3, 2015 at 3:05 PM, Tarek Auel <ta...@gmail.com> wrote:
> I found a solution, there might be a better one.
>
> https://github.com/apache/spark/pull/7217
>
> On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk> wrote:
>
>> Yes me too
>>
>> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>>
>> This is what I got (the last line was repeated non-stop):
>>
>> [INFO] Replacing original artifact with shaded artifact.
>> [INFO] Replacing
>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with
>> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
>> [INFO] Dependency-reduced POM written at:
>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>> [INFO] Dependency-reduced POM written at:
>> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>>
>> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I am trying to build the master, but it stucks and prints
>>>
>>> [INFO] Dependency-reduced POM written at:
>>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>>
>>> build command: mvn -DskipTests clean package
>>>
>>> Do others have the same issue?
>>>
>>> Regards,
>>> Tarek
>>>
>>
>>
>>
Re: Can not build master
Posted by Tarek Auel <ta...@gmail.com>.
I found a solution, there might be a better one.
https://github.com/apache/spark/pull/7217
On Fri, Jul 3, 2015 at 2:28 PM Robin East <ro...@xense.co.uk> wrote:
> Yes me too
>
> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>
> This is what I got (the last line was repeated non-stop):
>
> [INFO] Replacing original artifact with shaded artifact.
> [INFO] Replacing
> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with
> /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
> [INFO] Dependency-reduced POM written at:
> /home/hbase/spark/bagel/dependency-reduced-pom.xml
> [INFO] Dependency-reduced POM written at:
> /home/hbase/spark/bagel/dependency-reduced-pom.xml
>
> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com> wrote:
>
>> Hi all,
>>
>> I am trying to build the master, but it stucks and prints
>>
>> [INFO] Dependency-reduced POM written at:
>> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>>
>> build command: mvn -DskipTests clean package
>>
>> Do others have the same issue?
>>
>> Regards,
>> Tarek
>>
>
>
>
Re: Can not build master
Posted by Robin East <ro...@xense.co.uk>.
Yes me too
> On 3 Jul 2015, at 22:21, Ted Yu <yu...@gmail.com> wrote:
>
> This is what I got (the last line was repeated non-stop):
>
> [INFO] Replacing original artifact with shaded artifact.
> [INFO] Replacing /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with /home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
> [INFO] Dependency-reduced POM written at: /home/hbase/spark/bagel/dependency-reduced-pom.xml
> [INFO] Dependency-reduced POM written at: /home/hbase/spark/bagel/dependency-reduced-pom.xml
>
> On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <tarek.auel@gmail.com <ma...@gmail.com>> wrote:
> Hi all,
>
> I am trying to build the master, but it stucks and prints
>
> [INFO] Dependency-reduced POM written at: /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>
> build command: mvn -DskipTests clean package
>
> Do others have the same issue?
>
> Regards,
> Tarek
>
Re: Can not build master
Posted by Ted Yu <yu...@gmail.com>.
This is what I got (the last line was repeated non-stop):
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing
/home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT.jar with
/home/hbase/spark/bagel/target/spark-bagel_2.10-1.5.0-SNAPSHOT-shaded.jar
[INFO] Dependency-reduced POM written at:
/home/hbase/spark/bagel/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at:
/home/hbase/spark/bagel/dependency-reduced-pom.xml
On Fri, Jul 3, 2015 at 1:13 PM, Tarek Auel <ta...@gmail.com> wrote:
> Hi all,
>
> I am trying to build the master, but it stucks and prints
>
> [INFO] Dependency-reduced POM written at:
> /Users/tarek/test/spark/bagel/dependency-reduced-pom.xml
>
> build command: mvn -DskipTests clean package
>
> Do others have the same issue?
>
> Regards,
> Tarek
>