You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/02/11 12:34:16 UTC

EC2 script is missing in Spark 2.0.0~2.1.0

Dear Spark Users,

I was wondering why the EC2 script is missing in Spark release
2.0.0.~2.1.0? Is there any specific reason for that?

Please note that I have chosen the package type: Pre-built for Hadoop 2.7
and later for Spark 2.1.0 for example. Am I doing something wrong?



Regards,
_________________________________
*Md. Rezaul Karim*, BSc, MSc
PhD Researcher, INSIGHT Centre for Data Analytics
National University of Ireland, Galway
IDA Business Park, Dangan, Galway, Ireland
Web: http://www.reza-analytics.eu/index.html
<http://139.59.184.114/index.html>

Re: EC2 script is missing in Spark 2.0.0~2.1.0

Posted by "Md. Rezaul Karim" <re...@insight-centre.org>.
Thanks for the great help. Appreciated!

Regards,
_________________________________
*Md. Rezaul Karim*, BSc, MSc
PhD Researcher, INSIGHT Centre for Data Analytics
National University of Ireland, Galway
IDA Business Park, Dangan, Galway, Ireland
Web: http://www.reza-analytics.eu/index.html
<http://139.59.184.114/index.html>

On 11 February 2017 at 13:11, Takeshi Yamamuro <li...@gmail.com>
wrote:

> Moved to https://github.com/amplab/spark-ec2.
> Yea, I think the script just was moved there, so you can use it in the
> same way.
>
> On Sat, Feb 11, 2017 at 9:59 PM, Md. Rezaul Karim <
> rezaul.karim@insight-centre.org> wrote:
>
>> Hi Takeshi,
>>
>> Now  I understand that spark-ec2 script was moved to AMPLab. How could I
>> use that one i.e. new location/URL, please? Alternatively, can I use the
>> same script provided with prior Spark releases?
>>
>> Regards,
>> _________________________________
>> *Md. Rezaul Karim*, BSc, MSc
>> PhD Researcher, INSIGHT Centre for Data Analytics
>> National University of Ireland, Galway
>> IDA Business Park, Dangan, Galway, Ireland
>> Web: http://www.reza-analytics.eu/index.html
>> <http://139.59.184.114/index.html>
>>
>> On 11 February 2017 at 12:43, Takeshi Yamamuro <li...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> Have you checked this?
>>> https://issues.apache.org/jira/browse/SPARK-12735
>>>
>>> // maropu
>>>
>>> On Sat, Feb 11, 2017 at 9:34 PM, Md. Rezaul Karim <
>>> rezaul.karim@insight-centre.org> wrote:
>>>
>>>> Dear Spark Users,
>>>>
>>>> I was wondering why the EC2 script is missing in Spark release
>>>> 2.0.0.~2.1.0? Is there any specific reason for that?
>>>>
>>>> Please note that I have chosen the package type: Pre-built for Hadoop
>>>> 2.7 and later for Spark 2.1.0 for example. Am I doing something wrong?
>>>>
>>>>
>>>>
>>>> Regards,
>>>> _________________________________
>>>> *Md. Rezaul Karim*, BSc, MSc
>>>> PhD Researcher, INSIGHT Centre for Data Analytics
>>>> National University of Ireland, Galway
>>>> IDA Business Park, Dangan, Galway, Ireland
>>>> Web: http://www.reza-analytics.eu/index.html
>>>> <http://139.59.184.114/index.html>
>>>>
>>>
>>>
>>>
>>> --
>>> ---
>>> Takeshi Yamamuro
>>>
>>
>>
>
>
> --
> ---
> Takeshi Yamamuro
>

Re: EC2 script is missing in Spark 2.0.0~2.1.0

Posted by Takeshi Yamamuro <li...@gmail.com>.
Moved to https://github.com/amplab/spark-ec2.
Yea, I think the script just was moved there, so you can use it in the same
way.

On Sat, Feb 11, 2017 at 9:59 PM, Md. Rezaul Karim <
rezaul.karim@insight-centre.org> wrote:

> Hi Takeshi,
>
> Now  I understand that spark-ec2 script was moved to AMPLab. How could I
> use that one i.e. new location/URL, please? Alternatively, can I use the
> same script provided with prior Spark releases?
>
> Regards,
> _________________________________
> *Md. Rezaul Karim*, BSc, MSc
> PhD Researcher, INSIGHT Centre for Data Analytics
> National University of Ireland, Galway
> IDA Business Park, Dangan, Galway, Ireland
> Web: http://www.reza-analytics.eu/index.html
> <http://139.59.184.114/index.html>
>
> On 11 February 2017 at 12:43, Takeshi Yamamuro <li...@gmail.com>
> wrote:
>
>> Hi,
>>
>> Have you checked this?
>> https://issues.apache.org/jira/browse/SPARK-12735
>>
>> // maropu
>>
>> On Sat, Feb 11, 2017 at 9:34 PM, Md. Rezaul Karim <
>> rezaul.karim@insight-centre.org> wrote:
>>
>>> Dear Spark Users,
>>>
>>> I was wondering why the EC2 script is missing in Spark release
>>> 2.0.0.~2.1.0? Is there any specific reason for that?
>>>
>>> Please note that I have chosen the package type: Pre-built for Hadoop
>>> 2.7 and later for Spark 2.1.0 for example. Am I doing something wrong?
>>>
>>>
>>>
>>> Regards,
>>> _________________________________
>>> *Md. Rezaul Karim*, BSc, MSc
>>> PhD Researcher, INSIGHT Centre for Data Analytics
>>> National University of Ireland, Galway
>>> IDA Business Park, Dangan, Galway, Ireland
>>> Web: http://www.reza-analytics.eu/index.html
>>> <http://139.59.184.114/index.html>
>>>
>>
>>
>>
>> --
>> ---
>> Takeshi Yamamuro
>>
>
>


-- 
---
Takeshi Yamamuro

Re: EC2 script is missing in Spark 2.0.0~2.1.0

Posted by "Md. Rezaul Karim" <re...@insight-centre.org>.
Hi Takeshi,

Now  I understand that spark-ec2 script was moved to AMPLab. How could I
use that one i.e. new location/URL, please? Alternatively, can I use the
same script provided with prior Spark releases?

Regards,
_________________________________
*Md. Rezaul Karim*, BSc, MSc
PhD Researcher, INSIGHT Centre for Data Analytics
National University of Ireland, Galway
IDA Business Park, Dangan, Galway, Ireland
Web: http://www.reza-analytics.eu/index.html
<http://139.59.184.114/index.html>

On 11 February 2017 at 12:43, Takeshi Yamamuro <li...@gmail.com>
wrote:

> Hi,
>
> Have you checked this?
> https://issues.apache.org/jira/browse/SPARK-12735
>
> // maropu
>
> On Sat, Feb 11, 2017 at 9:34 PM, Md. Rezaul Karim <
> rezaul.karim@insight-centre.org> wrote:
>
>> Dear Spark Users,
>>
>> I was wondering why the EC2 script is missing in Spark release
>> 2.0.0.~2.1.0? Is there any specific reason for that?
>>
>> Please note that I have chosen the package type: Pre-built for Hadoop 2.7
>> and later for Spark 2.1.0 for example. Am I doing something wrong?
>>
>>
>>
>> Regards,
>> _________________________________
>> *Md. Rezaul Karim*, BSc, MSc
>> PhD Researcher, INSIGHT Centre for Data Analytics
>> National University of Ireland, Galway
>> IDA Business Park, Dangan, Galway, Ireland
>> Web: http://www.reza-analytics.eu/index.html
>> <http://139.59.184.114/index.html>
>>
>
>
>
> --
> ---
> Takeshi Yamamuro
>

Re: EC2 script is missing in Spark 2.0.0~2.1.0

Posted by Takeshi Yamamuro <li...@gmail.com>.
Hi,

Have you checked this?
https://issues.apache.org/jira/browse/SPARK-12735

// maropu

On Sat, Feb 11, 2017 at 9:34 PM, Md. Rezaul Karim <
rezaul.karim@insight-centre.org> wrote:

> Dear Spark Users,
>
> I was wondering why the EC2 script is missing in Spark release
> 2.0.0.~2.1.0? Is there any specific reason for that?
>
> Please note that I have chosen the package type: Pre-built for Hadoop 2.7
> and later for Spark 2.1.0 for example. Am I doing something wrong?
>
>
>
> Regards,
> _________________________________
> *Md. Rezaul Karim*, BSc, MSc
> PhD Researcher, INSIGHT Centre for Data Analytics
> National University of Ireland, Galway
> IDA Business Park, Dangan, Galway, Ireland
> Web: http://www.reza-analytics.eu/index.html
> <http://139.59.184.114/index.html>
>



-- 
---
Takeshi Yamamuro