You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Nick Chammas <ni...@gmail.com> on 2014/06/18 22:37:46 UTC
Spark is now available via Homebrew
OS X / Homebrew users,
It looks like you can now download Spark simply by doing:
brew install apache-spark
I’m new to Homebrew, so I’m not too sure how people are intended to use
this. I’m guessing this would just be a convenient way to get the latest
release onto your workstation, and from there use spark-ec2 to launch
clusters.
Anyway, just a cool thing to point out.
Nick
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-is-now-available-via-Homebrew-tp7856.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Spark is now available via Homebrew
Posted by Nicholas Chammas <ni...@gmail.com>.
Agreed, it would be better if Apache controlled or managed this directly.
I think making such a change is just a matter of opening a new issue
<https://github.com/Homebrew/homebrew/issues/new> on the Homebrew issue
tracker. I believe that's how Spark made it in there in the first place--it
was just a user contribution.
Nick
On Wed, Jun 18, 2014 at 4:57 PM, Matei Zaharia <ma...@gmail.com>
wrote:
> Interesting, does anyone know the people over there who set it up? It
> would be good if Apache itself could publish packages there, though I’m not
> sure what’s involved. Since Spark just depends on Java and Python it should
> be easy for us to update.
>
> Matei
>
> On Jun 18, 2014, at 1:37 PM, Nick Chammas <ni...@gmail.com>
> wrote:
>
> OS X / Homebrew users,
>
> It looks like you can now download Spark simply by doing:
>
> brew install apache-spark
>
> I’m new to Homebrew, so I’m not too sure how people are intended to use
> this. I’m guessing this would just be a convenient way to get the latest
> release onto your workstation, and from there use spark-ec2 to launch
> clusters.
>
> Anyway, just a cool thing to point out.
>
> Nick
>
>
> ------------------------------
> View this message in context: Spark is now available via Homebrew
> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-is-now-available-via-Homebrew-tp7856.html>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>
>
>
Re: Spark is now available via Homebrew
Posted by Nicholas Chammas <ni...@gmail.com>.
>From the user perspective, I don't think it's a big deal either way. It
looks like contributors to Homebrew are pretty on top of keeping things
updated.
For the users, Apache managing this would mostly mean a) a shorter period
of time from release to brew availability, and b) the brew installation
method is now "official".
Offering b) to users does indeed require a commitment from the dev team, so
that definitely should be weighed carefully.
Nick
On Wed, Jun 18, 2014 at 5:44 PM, Andrew Ash <an...@andrewash.com> wrote:
> What's the advantage of Apache maintaining the brew installer vs users?
>
> Apache handling it means more work on this dev team, but probably a better
> experience for brew users. Just wanted to weigh pros/cons before
> committing to support this installation method.
>
> Andrew
>
>
> On Wed, Jun 18, 2014 at 5:29 PM, Nicholas Chammas <
> nicholas.chammas@gmail.com> wrote:
>
>> Matei,
>>
>> You might want to comment on that issue Sherl linked to, or perhaps this
>> one <https://github.com/Homebrew/homebrew/issues/30228>, to ask about
>> how Apache can manage this going forward. I know that mikemcquaid
>> <https://github.com/mikemcquaid> is very active on the Homebrew repo and
>> is one of the maintainers.
>>
>> Nick
>>
>>
>> On Wed, Jun 18, 2014 at 5:17 PM, Sheryl John <sh...@gmail.com> wrote:
>>
>>> Cool.
>>> Looked at the Pull Requests, the upgrade to 1.0.0 was just merged
>>> yesterday. https://github.com/Homebrew/homebrew/pull/30231
>>>
>>>
>>> https://github.com/Homebrew/homebrew/blob/master/Library/Formula/apache-spark.rb
>>>
>>>
>>> On Wed, Jun 18, 2014 at 1:57 PM, Matei Zaharia <ma...@gmail.com>
>>> wrote:
>>>
>>>> Interesting, does anyone know the people over there who set it up? It
>>>> would be good if Apache itself could publish packages there, though I’m not
>>>> sure what’s involved. Since Spark just depends on Java and Python it should
>>>> be easy for us to update.
>>>>
>>>> Matei
>>>>
>>>> On Jun 18, 2014, at 1:37 PM, Nick Chammas <ni...@gmail.com>
>>>> wrote:
>>>>
>>>> OS X / Homebrew users,
>>>>
>>>> It looks like you can now download Spark simply by doing:
>>>>
>>>> brew install apache-spark
>>>>
>>>> I’m new to Homebrew, so I’m not too sure how people are intended to use
>>>> this. I’m guessing this would just be a convenient way to get the latest
>>>> release onto your workstation, and from there use spark-ec2 to launch
>>>> clusters.
>>>>
>>>> Anyway, just a cool thing to point out.
>>>>
>>>> Nick
>>>>
>>>> ------------------------------
>>>> View this message in context: Spark is now available via Homebrew
>>>> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-is-now-available-via-Homebrew-tp7856.html>
>>>> Sent from the Apache Spark User List mailing list archive
>>>> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> -Sheryl
>>>
>>
>>
>
Re: Spark is now available via Homebrew
Posted by Andrew Ash <an...@andrewash.com>.
What's the advantage of Apache maintaining the brew installer vs users?
Apache handling it means more work on this dev team, but probably a better
experience for brew users. Just wanted to weigh pros/cons before
committing to support this installation method.
Andrew
On Wed, Jun 18, 2014 at 5:29 PM, Nicholas Chammas <
nicholas.chammas@gmail.com> wrote:
> Matei,
>
> You might want to comment on that issue Sherl linked to, or perhaps this
> one <https://github.com/Homebrew/homebrew/issues/30228>, to ask about how
> Apache can manage this going forward. I know that mikemcquaid
> <https://github.com/mikemcquaid> is very active on the Homebrew repo and
> is one of the maintainers.
>
> Nick
>
>
> On Wed, Jun 18, 2014 at 5:17 PM, Sheryl John <sh...@gmail.com> wrote:
>
>> Cool.
>> Looked at the Pull Requests, the upgrade to 1.0.0 was just merged
>> yesterday. https://github.com/Homebrew/homebrew/pull/30231
>>
>>
>> https://github.com/Homebrew/homebrew/blob/master/Library/Formula/apache-spark.rb
>>
>>
>> On Wed, Jun 18, 2014 at 1:57 PM, Matei Zaharia <ma...@gmail.com>
>> wrote:
>>
>>> Interesting, does anyone know the people over there who set it up? It
>>> would be good if Apache itself could publish packages there, though I’m not
>>> sure what’s involved. Since Spark just depends on Java and Python it should
>>> be easy for us to update.
>>>
>>> Matei
>>>
>>> On Jun 18, 2014, at 1:37 PM, Nick Chammas <ni...@gmail.com>
>>> wrote:
>>>
>>> OS X / Homebrew users,
>>>
>>> It looks like you can now download Spark simply by doing:
>>>
>>> brew install apache-spark
>>>
>>> I’m new to Homebrew, so I’m not too sure how people are intended to use
>>> this. I’m guessing this would just be a convenient way to get the latest
>>> release onto your workstation, and from there use spark-ec2 to launch
>>> clusters.
>>>
>>> Anyway, just a cool thing to point out.
>>>
>>> Nick
>>>
>>> ------------------------------
>>> View this message in context: Spark is now available via Homebrew
>>> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-is-now-available-via-Homebrew-tp7856.html>
>>> Sent from the Apache Spark User List mailing list archive
>>> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>>>
>>>
>>>
>>
>>
>> --
>> -Sheryl
>>
>
>
Re: Spark is now available via Homebrew
Posted by Nicholas Chammas <ni...@gmail.com>.
Matei,
You might want to comment on that issue Sherl linked to, or perhaps this one
<https://github.com/Homebrew/homebrew/issues/30228>, to ask about how
Apache can manage this going forward. I know that mikemcquaid
<https://github.com/mikemcquaid> is very active on the Homebrew repo and is
one of the maintainers.
Nick
On Wed, Jun 18, 2014 at 5:17 PM, Sheryl John <sh...@gmail.com> wrote:
> Cool.
> Looked at the Pull Requests, the upgrade to 1.0.0 was just merged
> yesterday. https://github.com/Homebrew/homebrew/pull/30231
>
>
> https://github.com/Homebrew/homebrew/blob/master/Library/Formula/apache-spark.rb
>
>
> On Wed, Jun 18, 2014 at 1:57 PM, Matei Zaharia <ma...@gmail.com>
> wrote:
>
>> Interesting, does anyone know the people over there who set it up? It
>> would be good if Apache itself could publish packages there, though I’m not
>> sure what’s involved. Since Spark just depends on Java and Python it should
>> be easy for us to update.
>>
>> Matei
>>
>> On Jun 18, 2014, at 1:37 PM, Nick Chammas <ni...@gmail.com>
>> wrote:
>>
>> OS X / Homebrew users,
>>
>> It looks like you can now download Spark simply by doing:
>>
>> brew install apache-spark
>>
>> I’m new to Homebrew, so I’m not too sure how people are intended to use
>> this. I’m guessing this would just be a convenient way to get the latest
>> release onto your workstation, and from there use spark-ec2 to launch
>> clusters.
>>
>> Anyway, just a cool thing to point out.
>>
>> Nick
>>
>> ------------------------------
>> View this message in context: Spark is now available via Homebrew
>> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-is-now-available-via-Homebrew-tp7856.html>
>> Sent from the Apache Spark User List mailing list archive
>> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>>
>>
>>
>
>
> --
> -Sheryl
>
Re: Spark is now available via Homebrew
Posted by Sheryl John <sh...@gmail.com>.
Cool.
Looked at the Pull Requests, the upgrade to 1.0.0 was just merged
yesterday. https://github.com/Homebrew/homebrew/pull/30231
https://github.com/Homebrew/homebrew/blob/master/Library/Formula/apache-spark.rb
On Wed, Jun 18, 2014 at 1:57 PM, Matei Zaharia <ma...@gmail.com>
wrote:
> Interesting, does anyone know the people over there who set it up? It
> would be good if Apache itself could publish packages there, though I'm not
> sure what's involved. Since Spark just depends on Java and Python it should
> be easy for us to update.
>
> Matei
>
> On Jun 18, 2014, at 1:37 PM, Nick Chammas <ni...@gmail.com>
> wrote:
>
> OS X / Homebrew users,
>
> It looks like you can now download Spark simply by doing:
>
> brew install apache-spark
>
> I'm new to Homebrew, so I'm not too sure how people are intended to use
> this. I'm guessing this would just be a convenient way to get the latest
> release onto your workstation, and from there use spark-ec2 to launch
> clusters.
>
> Anyway, just a cool thing to point out.
>
> Nick
>
> ------------------------------
> View this message in context: Spark is now available via Homebrew
> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-is-now-available-via-Homebrew-tp7856.html>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>
>
>
--
-Sheryl
Re: Spark is now available via Homebrew
Posted by Matei Zaharia <ma...@gmail.com>.
Interesting, does anyone know the people over there who set it up? It would be good if Apache itself could publish packages there, though I’m not sure what’s involved. Since Spark just depends on Java and Python it should be easy for us to update.
Matei
On Jun 18, 2014, at 1:37 PM, Nick Chammas <ni...@gmail.com> wrote:
> OS X / Homebrew users,
>
> It looks like you can now download Spark simply by doing:
>
> brew install apache-spark
> I’m new to Homebrew, so I’m not too sure how people are intended to use this. I’m guessing this would just be a convenient way to get the latest release onto your workstation, and from there use spark-ec2 to launch clusters.
>
> Anyway, just a cool thing to point out.
>
> Nick
>
>
>
> View this message in context: Spark is now available via Homebrew
> Sent from the Apache Spark User List mailing list archive at Nabble.com.