You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Holden Karau <ho...@pigscanfly.ca> on 2022/11/30 22:34:57 UTC
Syndicate Apache Spark Twitter to Mastodon?
Do we want to start syndicating Apache Spark Twitter to a Mastodon
instance. It seems like a lot of software dev folks are moving over there
and it would be good to reach our users where they are.
Any objections / concerns? Any thoughts on which server we should pick if
we do this?
--
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau
Re: Syndicate Apache Spark Twitter to Mastodon?
Posted by Maciej <ms...@gmail.com>.
Thanks for proposing this Holden.
On 12/1/22 17:09, Holden Karau wrote:
> The main negatives that I can think of is an additional account for the
> PMC to maintain so if we as a community don’t have many people on
> Mastodon yet it might not be worth it.Would need probably about ~20
> minutes of setup work to make the sync (probably most of it is finding
> someone with the Twitter credentials to enable to sync). The other
> tricky one is picking a server (there is no default ASF server that I
> know of).
Airflow uses fosstodon (@airflow@fosstodon.org) but that's the only ASF
project on Mastodon I'm aware of. It might be a good starting point for
us as well, and it is not hard to permanently move an account to a new
server in the future.
It might be worthwhile to reach out to the ASF and see if there is
enough interest and some resources to spare to set up a dedicated instance.
>
> On Thu, Dec 1, 2022 at 8:03 AM Russell Spitzer
> <russell.spitzer@gmail.com <ma...@gmail.com>> wrote:
>
> Since this is just syndication I don't think arguments on the
> benefits of Twitter vs Mastodon are that important, it's really just
> what are the costs of additionally posting to Mastodon. I'm assuming
> those costs are basically 0 since this can be done by a bot? So I
> don't think there is any strong reason not to do so.
>
>
>> On Nov 30, 2022, at 5:51 PM, Dmitry <frostball@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> My personal opinion, one of the most features of Twiiter that it
>> is not federated and is good platform for annonces and so on. So
>> it means "it would be good to reach our users where they are"
>> means stay in twitter(most companies who use Spark/Databricks are
>> in Twitter)
>> For Federated features, I think Slack would be a better platform,
>> a lot of Apache Big data projects have slack for federated features
>>
>> чт, 1 дек. 2022 г., 02:33 Holden Karau <holden@pigscanfly.ca
>> <ma...@pigscanfly.ca>>:
>>
>> I agree that there is probably a majority still on twitter,
>> but it would be a syndication (e.g. we'd keep both).
>>
>> As to the # of devs it's hard to say since:
>> 1) It's a federated service
>> 2) Figuring out if an account is a dev or not is hard
>>
>> But, for example,
>>
>> There seems to be roughly an aggregate 6 million users (
>> https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time <https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time> ), which seems to be about only ~1% of Twitters size.
>>
>> Nova's (large K8s focused I believe) has ~29k, tech.lgbt has
>> ~6k, The BSD mastodon has ~1k ( https://bsd.network/about
>> <https://bsd.network/about> )
>>
>> It's hard to say, but I've noticed a larger number of my tech
>> affiliated friends moving to Mastodon (personally I now do both).
>>
>> On Wed, Nov 30, 2022 at 3:17 PM Dmitry <frostball@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> Hello,
>> Does any long-term statistics about number of developers
>> who moved to mastodon and activity use exists?
>>
>> I believe the most devs are still using Twitter.
>>
>>
>> чт, 1 дек. 2022 г., 01:35 Holden Karau
>> <holden@pigscanfly.ca <ma...@pigscanfly.ca>>:
>>
>> Do we want to start syndicating Apache Spark Twitter
>> to a Mastodon instance. It seems like a lot of
>> software dev folks are moving over there and it would
>> be good to reach our users where they are.
>>
>> Any objections / concerns? Any thoughts on which
>> server we should pick if we do this?
>> --
>> Twitter: https://twitter.com/holdenkarau
>> <https://twitter.com/holdenkarau>
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams:
>> https://www.youtube.com/user/holdenkarau
>> <https://www.youtube.com/user/holdenkarau>
>>
>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> <https://twitter.com/holdenkarau>
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>> <https://www.youtube.com/user/holdenkarau>
>>
>
> --
> Twitter: https://twitter.com/holdenkarau <https://twitter.com/holdenkarau>
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
> <https://www.youtube.com/user/holdenkarau>
--
Best regards,
Maciej Szymkiewicz
Web: https://zero323.net
PGP: A30CEF0C31A501EC
Re: Syndicate Apache Spark Twitter to Mastodon?
Posted by Holden Karau <ho...@pigscanfly.ca>.
The main negatives that I can think of is an additional account for the PMC
to maintain so if we as a community don’t have many people on Mastodon yet
it might not be worth it. Would need probably about ~20 minutes of setup
work to make the sync (probably most of it is finding someone with the
Twitter credentials to enable to sync). The other tricky one is picking a
server (there is no default ASF server that I know of).
On Thu, Dec 1, 2022 at 8:03 AM Russell Spitzer <ru...@gmail.com>
wrote:
> Since this is just syndication I don't think arguments on the benefits of
> Twitter vs Mastodon are that important, it's really just what are the costs
> of additionally posting to Mastodon. I'm assuming those costs are basically
> 0 since this can be done by a bot? So I don't think there is any strong
> reason not to do so.
>
>
> On Nov 30, 2022, at 5:51 PM, Dmitry <fr...@gmail.com> wrote:
>
> My personal opinion, one of the most features of Twiiter that it is not
> federated and is good platform for annonces and so on. So it means "it
> would be good to reach our users where they are" means stay in twitter(most
> companies who use Spark/Databricks are in Twitter)
> For Federated features, I think Slack would be a better platform, a lot
> of Apache Big data projects have slack for federated features
>
> чт, 1 дек. 2022 г., 02:33 Holden Karau <ho...@pigscanfly.ca>:
>
>> I agree that there is probably a majority still on twitter, but it would
>> be a syndication (e.g. we'd keep both).
>>
>> As to the # of devs it's hard to say since:
>> 1) It's a federated service
>> 2) Figuring out if an account is a dev or not is hard
>>
>> But, for example,
>>
>> There seems to be roughly an aggregate 6 million users (
>> https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time
>> ), which seems to be about only ~1% of Twitters size.
>>
>> Nova's (large K8s focused I believe) has ~29k, tech.lgbt has ~6k, The BSD
>> mastodon has ~1k ( https://bsd.network/about )
>>
>> It's hard to say, but I've noticed a larger number of my tech affiliated
>> friends moving to Mastodon (personally I now do both).
>>
>> On Wed, Nov 30, 2022 at 3:17 PM Dmitry <fr...@gmail.com> wrote:
>>
>>> Hello,
>>> Does any long-term statistics about number of developers who moved to
>>> mastodon and activity use exists?
>>>
>>> I believe the most devs are still using Twitter.
>>>
>>>
>>> чт, 1 дек. 2022 г., 01:35 Holden Karau <ho...@pigscanfly.ca>:
>>>
>>>> Do we want to start syndicating Apache Spark Twitter to a Mastodon
>>>> instance. It seems like a lot of software dev folks are moving over there
>>>> and it would be good to reach our users where they are.
>>>>
>>>> Any objections / concerns? Any thoughts on which server we should pick
>>>> if we do this?
>>>> --
>>>> Twitter: https://twitter.com/holdenkarau
>>>> Books (Learning Spark, High Performance Spark, etc.):
>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>>
>>>
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
> --
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau
Re: Syndicate Apache Spark Twitter to Mastodon?
Posted by Russell Spitzer <ru...@gmail.com>.
Since this is just syndication I don't think arguments on the benefits of Twitter vs Mastodon are that important, it's really just what are the costs of additionally posting to Mastodon. I'm assuming those costs are basically 0 since this can be done by a bot? So I don't think there is any strong reason not to do so.
> On Nov 30, 2022, at 5:51 PM, Dmitry <fr...@gmail.com> wrote:
>
> My personal opinion, one of the most features of Twiiter that it is not federated and is good platform for annonces and so on. So it means "it would be good to reach our users where they are" means stay in twitter(most companies who use Spark/Databricks are in Twitter)
> For Federated features, I think Slack would be a better platform, a lot of Apache Big data projects have slack for federated features
>
> чт, 1 дек. 2022 г., 02:33 Holden Karau <holden@pigscanfly.ca <ma...@pigscanfly.ca>>:
> I agree that there is probably a majority still on twitter, but it would be a syndication (e.g. we'd keep both).
>
> As to the # of devs it's hard to say since:
> 1) It's a federated service
> 2) Figuring out if an account is a dev or not is hard
>
> But, for example,
>
> There seems to be roughly an aggregate 6 million users ( https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time <https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time> ), which seems to be about only ~1% of Twitters size.
>
> Nova's (large K8s focused I believe) has ~29k, tech.lgbt has ~6k, The BSD mastodon has ~1k ( https://bsd.network/about <https://bsd.network/about> )
>
> It's hard to say, but I've noticed a larger number of my tech affiliated friends moving to Mastodon (personally I now do both).
>
> On Wed, Nov 30, 2022 at 3:17 PM Dmitry <frostball@gmail.com <ma...@gmail.com>> wrote:
> Hello,
> Does any long-term statistics about number of developers who moved to mastodon and activity use exists?
>
> I believe the most devs are still using Twitter.
>
>
> чт, 1 дек. 2022 г., 01:35 Holden Karau <holden@pigscanfly.ca <ma...@pigscanfly.ca>>:
> Do we want to start syndicating Apache Spark Twitter to a Mastodon instance. It seems like a lot of software dev folks are moving over there and it would be good to reach our users where they are.
>
> Any objections / concerns? Any thoughts on which server we should pick if we do this?
> --
> Twitter: https://twitter.com/holdenkarau <https://twitter.com/holdenkarau>
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau <https://www.youtube.com/user/holdenkarau>
>
> --
> Twitter: https://twitter.com/holdenkarau <https://twitter.com/holdenkarau>
> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau <https://www.youtube.com/user/holdenkarau>
Re: Syndicate Apache Spark Twitter to Mastodon?
Posted by Dmitry <fr...@gmail.com>.
My personal opinion, one of the most features of Twiiter that it is not
federated and is good platform for annonces and so on. So it means "it
would be good to reach our users where they are" means stay in twitter(most
companies who use Spark/Databricks are in Twitter)
For Federated features, I think Slack would be a better platform, a lot of
Apache Big data projects have slack for federated features
чт, 1 дек. 2022 г., 02:33 Holden Karau <ho...@pigscanfly.ca>:
> I agree that there is probably a majority still on twitter, but it would
> be a syndication (e.g. we'd keep both).
>
> As to the # of devs it's hard to say since:
> 1) It's a federated service
> 2) Figuring out if an account is a dev or not is hard
>
> But, for example,
>
> There seems to be roughly an aggregate 6 million users (
> https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time ),
> which seems to be about only ~1% of Twitters size.
>
> Nova's (large K8s focused I believe) has ~29k, tech.lgbt has ~6k, The BSD
> mastodon has ~1k ( https://bsd.network/about )
>
> It's hard to say, but I've noticed a larger number of my tech affiliated
> friends moving to Mastodon (personally I now do both).
>
> On Wed, Nov 30, 2022 at 3:17 PM Dmitry <fr...@gmail.com> wrote:
>
>> Hello,
>> Does any long-term statistics about number of developers who moved to
>> mastodon and activity use exists?
>>
>> I believe the most devs are still using Twitter.
>>
>>
>> чт, 1 дек. 2022 г., 01:35 Holden Karau <ho...@pigscanfly.ca>:
>>
>>> Do we want to start syndicating Apache Spark Twitter to a Mastodon
>>> instance. It seems like a lot of software dev folks are moving over there
>>> and it would be good to reach our users where they are.
>>>
>>> Any objections / concerns? Any thoughts on which server we should pick
>>> if we do this?
>>> --
>>> Twitter: https://twitter.com/holdenkarau
>>> Books (Learning Spark, High Performance Spark, etc.):
>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>>
>>
>
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>
Re: Syndicate Apache Spark Twitter to Mastodon?
Posted by Holden Karau <ho...@pigscanfly.ca>.
I agree that there is probably a majority still on twitter, but it would be
a syndication (e.g. we'd keep both).
As to the # of devs it's hard to say since:
1) It's a federated service
2) Figuring out if an account is a dev or not is hard
But, for example,
There seems to be roughly an aggregate 6 million users (
https://observablehq.com/@simonw/mastodon-users-and-statuses-over-time ),
which seems to be about only ~1% of Twitters size.
Nova's (large K8s focused I believe) has ~29k, tech.lgbt has ~6k, The BSD
mastodon has ~1k ( https://bsd.network/about )
It's hard to say, but I've noticed a larger number of my tech affiliated
friends moving to Mastodon (personally I now do both).
On Wed, Nov 30, 2022 at 3:17 PM Dmitry <fr...@gmail.com> wrote:
> Hello,
> Does any long-term statistics about number of developers who moved to
> mastodon and activity use exists?
>
> I believe the most devs are still using Twitter.
>
>
> чт, 1 дек. 2022 г., 01:35 Holden Karau <ho...@pigscanfly.ca>:
>
>> Do we want to start syndicating Apache Spark Twitter to a Mastodon
>> instance. It seems like a lot of software dev folks are moving over there
>> and it would be good to reach our users where they are.
>>
>> Any objections / concerns? Any thoughts on which server we should pick if
>> we do this?
>> --
>> Twitter: https://twitter.com/holdenkarau
>> Books (Learning Spark, High Performance Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
--
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau
Re: Syndicate Apache Spark Twitter to Mastodon?
Posted by Dmitry <fr...@gmail.com>.
Hello,
Does any long-term statistics about number of developers who moved to
mastodon and activity use exists?
I believe the most devs are still using Twitter.
чт, 1 дек. 2022 г., 01:35 Holden Karau <ho...@pigscanfly.ca>:
> Do we want to start syndicating Apache Spark Twitter to a Mastodon
> instance. It seems like a lot of software dev folks are moving over there
> and it would be good to reach our users where they are.
>
> Any objections / concerns? Any thoughts on which server we should pick if
> we do this?
> --
> Twitter: https://twitter.com/holdenkarau
> Books (Learning Spark, High Performance Spark, etc.):
> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>