You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ashwin Shankar <as...@gmail.com> on 2014/11/12 21:14:08 UTC
Building spark targz
Hi,
I just cloned spark from the github and I'm trying to build to generate a
tar ball.
I'm doing : mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
-DskipTests clean package
Although the build is successful, I don't see the targz generated.
Am I running the wrong command ?
--
Thanks,
Ashwin
Re: Building spark targz
Posted by Ashwin Shankar <as...@gmail.com>.
Yes, I'm looking at assembly/target. I don't see the tar ball.
I only see scala-2.10/spark-assembly-1.2.0-SNAPSHOT-hadoop2.4.0.jar
,classes,test-classes,
maven-shared-archive-resources,spark-test-classpath.txt.
On Wed, Nov 12, 2014 at 12:16 PM, Sadhan Sood <sa...@gmail.com> wrote:
> Just making sure but are you looking for the tar in assembly/target dir ?
>
> On Wed, Nov 12, 2014 at 3:14 PM, Ashwin Shankar <ashwinshankar77@gmail.com
> > wrote:
>
>> Hi,
>> I just cloned spark from the github and I'm trying to build to generate a
>> tar ball.
>> I'm doing : mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
>> -DskipTests clean package
>>
>> Although the build is successful, I don't see the targz generated.
>>
>> Am I running the wrong command ?
>>
>> --
>> Thanks,
>> Ashwin
>>
>>
>>
>
--
Thanks,
Ashwin
Re: Building spark targz
Posted by Sadhan Sood <sa...@gmail.com>.
Just making sure but are you looking for the tar in assembly/target dir ?
On Wed, Nov 12, 2014 at 3:14 PM, Ashwin Shankar <as...@gmail.com>
wrote:
> Hi,
> I just cloned spark from the github and I'm trying to build to generate a
> tar ball.
> I'm doing : mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
> -DskipTests clean package
>
> Although the build is successful, I don't see the targz generated.
>
> Am I running the wrong command ?
>
> --
> Thanks,
> Ashwin
>
>
>
Re: Building spark targz
Posted by Sadhan Sood <sa...@gmail.com>.
I think you can provide -Pbigtop-dist to build the tar.
On Wed, Nov 12, 2014 at 3:21 PM, Sean Owen <so...@cloudera.com> wrote:
> mvn package doesn't make tarballs. It creates artifacts that will
> generally appear in target/ and subdirectories, and likewise within
> modules. Look at make-distribution.sh
>
> On Wed, Nov 12, 2014 at 8:14 PM, Ashwin Shankar <ashwinshankar77@gmail.com
> > wrote:
>
>> Hi,
>> I just cloned spark from the github and I'm trying to build to generate a
>> tar ball.
>> I'm doing : mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
>> -DskipTests clean package
>>
>> Although the build is successful, I don't see the targz generated.
>>
>> Am I running the wrong command ?
>>
>> --
>> Thanks,
>> Ashwin
>>
>>
>>
>
Re: Building spark targz
Posted by Sean Owen <so...@cloudera.com>.
mvn package doesn't make tarballs. It creates artifacts that will generally
appear in target/ and subdirectories, and likewise within modules. Look at
make-distribution.sh
On Wed, Nov 12, 2014 at 8:14 PM, Ashwin Shankar <as...@gmail.com>
wrote:
> Hi,
> I just cloned spark from the github and I'm trying to build to generate a
> tar ball.
> I'm doing : mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
> -DskipTests clean package
>
> Although the build is successful, I don't see the targz generated.
>
> Am I running the wrong command ?
>
> --
> Thanks,
> Ashwin
>
>
>
Re: Building spark targz
Posted by Akhil Das <ak...@sigmoidanalytics.com>.
You need to run the make-distribution.sh
<https://github.com/apache/spark/blob/master/make-distribution.sh> to get
the tar ball.
Thanks
Best Regards
On Thu, Nov 13, 2014 at 1:44 AM, Ashwin Shankar <as...@gmail.com>
wrote:
> Hi,
> I just cloned spark from the github and I'm trying to build to generate a
> tar ball.
> I'm doing : mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive
> -DskipTests clean package
>
> Although the build is successful, I don't see the targz generated.
>
> Am I running the wrong command ?
>
> --
> Thanks,
> Ashwin
>
>
>