Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?

[Russell Jurney <ru...@gmail.com>]

There is an implementation for Spark 3, but GraphFrames isn't released
often enough to match every point version. It supports Spark 3.4. Try it -
it will probably work.
https://spark-packages.org/package/graphframes/graphframes

Thanks,
Russell Jurney @rjurney <http://twitter.com/rjurney>
russell.jurney@gmail.com LI <http://linkedin.com/in/russelljurney> FB
<http://facebook.com/jurney> datasyndrome.com Book a time on Calendly
<https://calendly.com/rjurney_personal/30min>


On Fri, Jan 12, 2024 at 7:55 AM Boileau, Brad
<br...@fcc-fac.ca.invalid> wrote:

> Hello,
>
>
>
> I was hoping to use a distribution of GraphFrames for AWS Glue 4 which has
> spark 3.3, but there is no found distribution for Spark 3.3 at this
> location:
>
>
>
> https://spark-packages.org/package/graphframes/graphframes
>
>
>
> Do you have any advice on the best compatible version to use for Spark 3.3?
>
>
>
> Sincerely,
>
>
>
> *Brad Boileau*
>
> *Senior Product Architect** / **Architecte produit sénior*
> *Farm Credit Canada | Financement agricole Canada*
> 1820 Hamilton Street / 1820, rue Hamilton
>
> Regina SK  S4P 2B8
>
> Tel/Tél. : 306-359, C/M: 306-737-8900
>
> fcc.ca <https://www.fcc-fac.ca/en.html> / fac.ca
> <https://www.fcc-fac.ca/fr.html>
>
> FCC social media <https://www.fcc-fac.ca/en/about-fcc/social-media.html> /
>  Médias sociaux FAC
> <https://www.fcc-fac.ca/fr/a-propos-de-FAC/social-media.html>
>
>
>
> *[image: 2QA=]*
>
>
>
> *This email, including attachments, is confidential. You may not share
> this email with any third party.* If you are not the intended recipient,
> any redistribution or copying of this email is prohibited. If you have
> received this email in error or cannot comply with these restrictions,
> please delete or destroy it entirely and immediately without making a copy
> and notify us by return email.
>
> *Ce courriel (y compris toutes les pièces jointes qu’il comporte) est
> confidentiel. Vous ne pouvez pas partager ce courriel avec des tiers.* Si
> vous n’êtes pas le destinataire prévu, toute divulgation, reproduction,
> copie ou distribution de ce courriel est strictement interdite. Si vous
> avez reçu ce courriel par erreur ou ne pouvez pas respecter ces
> restrictions, merci de le supprimer ou de le détruire complètement et
> immédiatement, sans le dupliquer, et de nous aviser par retour de courriel.
>
> Unsubscribe from FCC marketing-related messages.
> <fccunsubscribe@fcc.ca?Subject=Unsubscribe+from+FCC+marketing-related+messages&Body=Please+unsubscribe+me+from+all+FCC+Marketing+messages+including:%0A%0A+·+FCC+Knowledge+Newsletter%0A+·+FCC+Events%0A+·+AgExpert%0A+I+understand+that+I+will+still+receive+messages+related+to+business+transactions.>
> (Customers will still receive messages related to business transactions.)
>
> Se désabonner pour ne plus recevoir de messages liés au marketing de la
> part de FAC.
> <FACenligne@fac.ca?Subject=Se+désabonner+de+la+liste+d’envoi+de+messages+électroniques+de+FAC&Body=Je+me+désabonne+de+tout+message+de+marketing+de+FAC,+y+compris+:%0A%0A+·+L'infolettre+de+Savoir+FAC%0A+·+Événements+de+FAC%0A+·+AgExpert%0A+Je+comprends+que+je+continuerai+de+recevoir+des+messages+concernant+mes+transactions.>
> (Les clients continueront de recevoir des messages concernant leurs
> transactions.)
>

Re: [External] Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?

[Ofir Manor <om...@speedata.io>]

Just to add - the latest version is 0.8.3, it seems to support 3.3:
"Support Spark 3.3 / Scala 2.12 , Spark 3.4 / Scala 2.12 and Scala 2.13, Spark 3.5 / Scala 2.12 and Scala 2.13"
Releases · graphframes/graphframes (github.com)<https://github.com/graphframes/graphframes/releases>
   Ofir
________________________________
From: Russell Jurney <ru...@gmail.com>
Sent: Friday, March 15, 2024 11:43 PM
To: brad.boileau@fcc-fac.ca.invalid <br...@fcc-fac.ca.invalid>
Cc: user@spark.apache.org <us...@spark.apache.org>
Subject: [External] Re: [GraphFrames Spark Package]: Why is there not a distribution for Spark 3.3?

There is an implementation for Spark 3, but GraphFrames isn't released often enough to match every point version. It supports Spark 3.4. Try it - it will probably work. https://spark-packages.org/package/graphframes/graphframes

Thanks,
Russell Jurney @rjurney<http://twitter.com/rjurney> russell.jurney@gmail.com<ma...@gmail.com> LI<http://linkedin.com/in/russelljurney> FB<http://facebook.com/jurney> datasyndrome.com<http://datasyndrome.com> Book a time on Calendly<https://calendly.com/rjurney_personal/30min>


On Fri, Jan 12, 2024 at 7:55 AM Boileau, Brad <br...@fcc-fac.ca.invalid> wrote:

Hello,



I was hoping to use a distribution of GraphFrames for AWS Glue 4 which has spark 3.3, but there is no found distribution for Spark 3.3 at this location:



https://spark-packages.org/package/graphframes/graphframes



Do you have any advice on the best compatible version to use for Spark 3.3?



Sincerely,



Brad Boileau

Senior Product Architect / Architecte produit sénior
Farm Credit Canada | Financement agricole Canada
1820 Hamilton Street / 1820, rue Hamilton

Regina SK  S4P 2B8

Tel/Tél. : 306-359, C/M: 306-737-8900

fcc.ca<https://www.fcc-fac.ca/en.html> / fac.ca<https://www.fcc-fac.ca/fr.html>

FCC social media<https://www.fcc-fac.ca/en/about-fcc/social-media.html> / Médias sociaux FAC<https://www.fcc-fac.ca/fr/a-propos-de-FAC/social-media.html>



[2QA=]



This email, including attachments, is confidential. You may not share this email with any third party. If you are not the intended recipient, any redistribution or copying of this email is prohibited. If you have received this email in error or cannot comply with these restrictions, please delete or destroy it entirely and immediately without making a copy and notify us by return email.

Ce courriel (y compris toutes les pièces jointes qu’il comporte) est confidentiel. Vous ne pouvez pas partager ce courriel avec des tiers. Si vous n’êtes pas le destinataire prévu, toute divulgation, reproduction, copie ou distribution de ce courriel est strictement interdite. Si vous avez reçu ce courriel par erreur ou ne pouvez pas respecter ces restrictions, merci de le supprimer ou de le détruire complètement et immédiatement, sans le dupliquer, et de nous aviser par retour de courriel.


Unsubscribe from FCC marketing-related messages.<mailto:fccunsubscribe@fcc.ca?Subject=Unsubscribe+from+FCC+marketing-related+messages&Body=Please+unsubscribe+me+from+all+FCC+Marketing+messages+including:%0A%0A+·+FCC+Knowledge+Newsletter%0A+·+FCC+Events%0A+·+AgExpert%0A+I+understand+that+I+will+still+receive+messages+related+to+business+transactions.> (Customers will still receive messages related to business transactions.)

Se désabonner pour ne plus recevoir de messages liés au marketing de la part de FAC.<mailto:FACenligne@fac.ca?Subject=Se+désabonner+de+la+liste+d’envoi+de+messages+électroniques+de+FAC&Body=Je+me+désabonne+de+tout+message+de+marketing+de+FAC,+y+compris+:%0A%0A+·+L'infolettre+de+Savoir+FAC%0A+·+Événements+de+FAC%0A+·+AgExpert%0A+Je+comprends+que+je+continuerai+de+recevoir+des+messages+concernant+mes+transactions.> (Les clients continueront de recevoir des messages concernant leurs transactions.)