You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Alexander Pivovarov <ap...@gmail.com> on 2015/12/01 08:38:37 UTC

Re: How to add 1.5.2 support to ec2/spark_ec2.py ?

just want to follow up
On Nov 25, 2015 9:19 PM, "Alexander Pivovarov" <ap...@gmail.com> wrote:

> Hi Everyone
>
> I noticed that spark ec2 script is outdated.
> How to add 1.5.2 support to ec2/spark_ec2.py?
> What else (except of updating spark version in the script) should be done
> to add 1.5.2 support?
>
> We also need to update scala to 2.10.4 (currently it's 2.10.3)
>
> Alex
>

Re: How to add 1.5.2 support to ec2/spark_ec2.py ?

Posted by Alexander Pivovarov <ap...@gmail.com>.
Did 6 min ago

On Tue, Dec 1, 2015 at 12:49 AM, Shivaram Venkataraman <
shivaram@eecs.berkeley.edu> wrote:

> Yeah - that needs to be changed as well. Could you send a PR to fix this ?
>
> Shivaram
>
> On Tue, Dec 1, 2015 at 12:32 AM, Alexander Pivovarov
> <ap...@gmail.com> wrote:
> > Thank you,
> > I looked at master branch. I did not realize that it's behind branch-1.5
> > BTW, line 54 still has SPARK_EC2_VERSION = "1.5.1"
> >
> > On Tue, Dec 1, 2015 at 12:22 AM, Shivaram Venkataraman
> > <sh...@eecs.berkeley.edu> wrote:
> >>
> >> Yeah we just need to add 1.5.2 as in
> >>
> >>
> https://github.com/apache/spark/commit/97956669053646f00131073358e53b05d0c3d5d0#diff-ada66bbeb2f1327b508232ef6c3805a5
> >> to the master branch as well
> >>
> >> Thanks
> >> Shivaram
> >>
> >>
> >>
> >> On Mon, Nov 30, 2015 at 11:38 PM, Alexander Pivovarov
> >> <ap...@gmail.com> wrote:
> >> > just want to follow up
> >> >
> >> > On Nov 25, 2015 9:19 PM, "Alexander Pivovarov" <ap...@gmail.com>
> >> > wrote:
> >> >>
> >> >> Hi Everyone
> >> >>
> >> >> I noticed that spark ec2 script is outdated.
> >> >> How to add 1.5.2 support to ec2/spark_ec2.py?
> >> >> What else (except of updating spark version in the script) should be
> >> >> done
> >> >> to add 1.5.2 support?
> >> >>
> >> >> We also need to update scala to 2.10.4 (currently it's 2.10.3)
> >> >>
> >> >> Alex
> >
> >
>

Re: How to add 1.5.2 support to ec2/spark_ec2.py ?

Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Yeah - that needs to be changed as well. Could you send a PR to fix this ?

Shivaram

On Tue, Dec 1, 2015 at 12:32 AM, Alexander Pivovarov
<ap...@gmail.com> wrote:
> Thank you,
> I looked at master branch. I did not realize that it's behind branch-1.5
> BTW, line 54 still has SPARK_EC2_VERSION = "1.5.1"
>
> On Tue, Dec 1, 2015 at 12:22 AM, Shivaram Venkataraman
> <sh...@eecs.berkeley.edu> wrote:
>>
>> Yeah we just need to add 1.5.2 as in
>>
>> https://github.com/apache/spark/commit/97956669053646f00131073358e53b05d0c3d5d0#diff-ada66bbeb2f1327b508232ef6c3805a5
>> to the master branch as well
>>
>> Thanks
>> Shivaram
>>
>>
>>
>> On Mon, Nov 30, 2015 at 11:38 PM, Alexander Pivovarov
>> <ap...@gmail.com> wrote:
>> > just want to follow up
>> >
>> > On Nov 25, 2015 9:19 PM, "Alexander Pivovarov" <ap...@gmail.com>
>> > wrote:
>> >>
>> >> Hi Everyone
>> >>
>> >> I noticed that spark ec2 script is outdated.
>> >> How to add 1.5.2 support to ec2/spark_ec2.py?
>> >> What else (except of updating spark version in the script) should be
>> >> done
>> >> to add 1.5.2 support?
>> >>
>> >> We also need to update scala to 2.10.4 (currently it's 2.10.3)
>> >>
>> >> Alex
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Re: How to add 1.5.2 support to ec2/spark_ec2.py ?

Posted by Alexander Pivovarov <ap...@gmail.com>.
Thank you,
I looked at master branch. I did not realize that it's behind branch-1.5
BTW, line 54 still has SPARK_EC2_VERSION = "1.5.1"

On Tue, Dec 1, 2015 at 12:22 AM, Shivaram Venkataraman <
shivaram@eecs.berkeley.edu> wrote:

> Yeah we just need to add 1.5.2 as in
>
> https://github.com/apache/spark/commit/97956669053646f00131073358e53b05d0c3d5d0#diff-ada66bbeb2f1327b508232ef6c3805a5
> to the master branch as well
>
> Thanks
> Shivaram
>
>
>
> On Mon, Nov 30, 2015 at 11:38 PM, Alexander Pivovarov
> <ap...@gmail.com> wrote:
> > just want to follow up
> >
> > On Nov 25, 2015 9:19 PM, "Alexander Pivovarov" <ap...@gmail.com>
> wrote:
> >>
> >> Hi Everyone
> >>
> >> I noticed that spark ec2 script is outdated.
> >> How to add 1.5.2 support to ec2/spark_ec2.py?
> >> What else (except of updating spark version in the script) should be
> done
> >> to add 1.5.2 support?
> >>
> >> We also need to update scala to 2.10.4 (currently it's 2.10.3)
> >>
> >> Alex
>

Re: How to add 1.5.2 support to ec2/spark_ec2.py ?

Posted by Shivaram Venkataraman <sh...@eecs.berkeley.edu>.
Yeah we just need to add 1.5.2 as in
https://github.com/apache/spark/commit/97956669053646f00131073358e53b05d0c3d5d0#diff-ada66bbeb2f1327b508232ef6c3805a5
to the master branch as well

Thanks
Shivaram



On Mon, Nov 30, 2015 at 11:38 PM, Alexander Pivovarov
<ap...@gmail.com> wrote:
> just want to follow up
>
> On Nov 25, 2015 9:19 PM, "Alexander Pivovarov" <ap...@gmail.com> wrote:
>>
>> Hi Everyone
>>
>> I noticed that spark ec2 script is outdated.
>> How to add 1.5.2 support to ec2/spark_ec2.py?
>> What else (except of updating spark version in the script) should be done
>> to add 1.5.2 support?
>>
>> We also need to update scala to 2.10.4 (currently it's 2.10.3)
>>
>> Alex

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org