You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by "Heyde, Andreas" <an...@dzbank.de> on 2022/01/19 12:14:03 UTC
Issue: Spring-Boot vs. Apache Spark Dependencies
After sending mail to Matei and yesterday subscribing user@spark.apache.org<ma...@spark.apache.org>
I cannot see my problem in
issues@spark.apache.org, past month - Apache Mail Archives<mailto:issues@spark.apache.org,%20past%20month%20-%20Apache%20Mail%20Archives>
Is there something wrong or where I have to write my issue new or send a change request
Regards
/Andreas
Von: Heyde, Andreas
Gesendet: Dienstag, 18. Januar 2022 08:23
An: 'user-subscribe@spark.apache.org' <us...@spark.apache.org>
Betreff: Spring-Boot vs. Apache Spark Dependencies
Hi Andreas,
I think it shouldn’t be hard to update it, but please just email the mailing list (https://spark.apache.org/community.html) or open an issue on JIRA to get the developers who work on that part of the code to look at it. I don’t think there will be major incompatibilities between those two versions. It may also be possible to configure your project’s build to use Janino 3.1 and still link against Spark (overriding its version) by packaging Janino 3.1 with your Spark job.
Matei
On Jan 17, 2022, at 12:17 AM, Heyde, Andreas <an...@dzbank.de>> wrote:
Hi Matei,
I hope to have found a good contact person with you.
We are using one of the latest spring-boot versions (2.5.5) with latest spark 2.13.
These spring framework has a hard dependency to janino 3.1.6.
Spark is using 3.0.16.
It was difficult to see. (Step by Step adding dependencies to a dummy project)
Some articles on the Internet discussing bypasses the problem.
Is there a reason, why you using such a older version?!
Is there a way to add your janino dependency only to logback or using the newest version of janino or specifying a version range [3.0.0,)
Regards
/Andreas
Mit freundlichen Grüßen/Kind regards
Andreas Heyde
DZ BANK AG
IT
Entwicklung Bewertung
F/ITEB
Platz der Republik
60325 Frankfurt am Main
Postanschrift
60265 Frankfurt am Main
T +49 69 7447 3403
F +49 69 7447 3477
mailto:andreas.heyde@dzbank.de
___________________________________________________________________
DZ BANK AG
Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
Platz der Republik, 60325 Frankfurt am Main
Deutschland/Germany
https://www.dzbank.de
mailto:mail@dzbank.de, T +49 69 7447 01, F +49 69 7447 1685
https://twitter.com/dzbank
Vorstand/Board of Directors: Uwe Fröhlich (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer), Uwe Berghaus,
Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth, Thomas Ullrich
Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning Deneke-Jöhrens
Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am Main
Handelsregister/Register of Companies: HRB 45651.
___________________________________________________________________
Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens weiterverarbeitet.
Weitere Informationen zum Datenschutz finden Sie unter https://www.dzbank.de/datenschutzhinweise
The personal data collected by this e-mail communication
will be processed exclusively for this purpose or to process your request.
Further information with regards to your rights under data protection law can be found on
our website at https://www.dzbank.com/dataprotection
Re: Issue: Spring-Boot vs. Apache Spark Dependencies
Posted by Sean Owen <sr...@gmail.com>.
The usual answer is to shade dependencies like this in your application, so
that both can coexist.
On Wed, Jan 19, 2022 at 8:42 AM Heyde, Andreas <an...@dzbank.de>
wrote:
> I had only one wish, that someone can have a look at this issue/topic.
>
> The problem is, that janino 3.0.16 and 3.1.4 has a complete other
> package/file structure, and so they are incompatible.
>
> The problem is, that was not done I a major version change, it’s a minor
> change.
>
>
>
> So I don’t know, which version to use.
>
> The newer one from Spring-boot the older one from spark.
>
>
>
> I have to exclude one of theme explicitly, but I am not the expert, what
> the best idea is.
>
>
>
> With "mvn dependency:tree" you see that the managed version is
> overwritten, but not the package, from which this come.
>
> So I mentioned, in the internet there are lot of articles discussing bypasses the problem.
>
>
>
>
>
> These is the spark version I am using.
>
> <dependency>
>
>
> <groupId>org.apache.spark</groupId>
>
>
> <artifactId>spark-sql_2.13</artifactId>
>
>
> <version>3.2.0</version>
>
>
> <exclusions>
>
>
> <!-- We want only and exactly Spark's janino version , we see a dependency
> with spring-boot -->
>
>
> <!-- customize these dependecy in all sub modules -->
>
>
> <exclusion>
>
>
> <groupId>org.codehaus.janino</groupId>
>
>
> <artifactId>commons-compiler</artifactId>
>
>
> </exclusion>
>
>
> <exclusion>
>
>
> <groupId>org.codehaus.janino</groupId>
>
>
> <artifactId>janino</artifactId>
>
>
> </exclusion>
>
>
> </exclusions>
>
> </dependency>
>
>
>
> Regards
>
>
>
> *Von:* Sean Owen <sr...@gmail.com>
> *Gesendet:* Mittwoch, 19. Januar 2022 14:25
> *An:* Heyde, Andreas <an...@dzbank.de>
> *Cc:* user@spark.apache.org
> *Betreff:* Re: Issue: Spring-Boot vs. Apache Spark Dependencies
>
>
>
> I did not see your message in the moderation queue, not sure why. Indeed
> you should send to user@, not to individuals. Your message is here now.
>
> Do you mean Spark 3.2.0? yes it is on Janino 3.0.16. You can use things
> like "mvn dependency:tree" on the project build to see dependencies, by the
> way.
>
>
>
> That does not seem too old, but there are newer versions. Janino is
> intended as an internal dependency for Spark, and I suppose there has not
> yet been a reason to update it.
>
> You are welcome to open a pull request that tries to update to the latest
> version, to see if it works.
>
> You didn't say what the problem is though.
>
>
>
>
>
> On Wed, Jan 19, 2022 at 6:14 AM Heyde, Andreas <an...@dzbank.de>
> wrote:
>
> After sending mail to Matei and yesterday subscribing
> user@spark.apache.org
>
> I cannot see my problem in
>
> issues@spark.apache.org, past month - Apache Mail Archives
>
>
>
>
>
> Is there something wrong or where I have to write my issue new or send a
> change request
>
> Regards
>
> /Andreas
>
> *Von:* Heyde, Andreas
> *Gesendet:* Dienstag, 18. Januar 2022 08:23
> *An:* 'user-subscribe@spark.apache.org' <us...@spark.apache.org>
> *Betreff:* Spring-Boot vs. Apache Spark Dependencies
>
>
>
>
>
> Hi Andreas,
>
>
>
> I think it shouldn’t be hard to update it, but please just email the
> mailing list (https://spark.apache.org/community.html) or open an issue
> on JIRA to get the developers who work on that part of the code to look at
> it. I don’t think there will be major incompatibilities between those two
> versions. It may also be possible to configure your project’s build to use
> Janino 3.1 and still link against Spark (overriding its version) by
> packaging Janino 3.1 with your Spark job.
>
>
>
> Matei
>
>
>
> On Jan 17, 2022, at 12:17 AM, Heyde, Andreas <an...@dzbank.de>
> wrote:
>
>
>
> Hi Matei,
>
> I hope to have found a good contact person with you.
>
> We are using one of the latest spring-boot versions (2.5.5) with latest
> spark 2.13.
>
>
>
> These spring framework has a hard dependency to janino 3.1.6.
>
> Spark is using 3.0.16.
>
> It was difficult to see. (Step by Step adding dependencies to a dummy
> project)
>
> Some articles on the Internet discussing bypasses the problem.
>
>
>
> Is there a reason, why you using such a older version?!
>
> Is there a way to add your janino dependency only to logback or using the newest version of janino or specifying a version range [3.0.0,)
>
>
>
>
>
> Regards
>
> /Andreas
>
>
>
>
>
>
>
> Mit freundlichen Grüßen/Kind regards
>
> Andreas Heyde
>
> *DZ BANK AG*
> IT
> Entwicklung Bewertung
> F/ITEB
> Platz der Republik
> 60325 Frankfurt am Main
> Postanschrift
> 60265 Frankfurt am Main
>
> T +49 69 7447 3403
> F +49 69 7447 3477
> mailto:andreas.heyde@dzbank.de <an...@dzbank.de>
>
>
>
>
>
> *DZ BANK AG*
> Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
> Platz der Republik, 60325 Frankfurt am Main
> Deutschland / Germany
>
> https://www.dzbank.de
> mailto:mail@dzbank.de <ma...@dzbank.de>, T +49 69 7447 01, F +49 69 7447
> 1685
>
> https://twitter.com/dzbank <https://www.twitter.com/dzbank>
>
> Vorstand/Board of Directors: Uwe Fröhlich
> (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
> Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
> Uwe Berghaus,
> Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth,
> Thomas Ullrich
>
> Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning
> Deneke-Jöhrens
> Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am
> Main
> Handelsregister/Register of Companies: HRB 45651.
>
> ___________________________________________________________________
>
> Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
> werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens
> weiterverarbeitet.
> Weitere Informationen zum Datenschutz finden Sie unter
> https://www.dzbank.de/datenschutzhinweise
>
> The personal data collected by this e-mail communication
> will be processed exclusively for this purpose or to process your request.
> Further information with regards to your rights under data protection law
> can be found on
> our website at https://www.dzbank.com/dataprotection
>
>
>
> *DZ BANK AG*
> Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
> Platz der Republik, 60325 Frankfurt am Main
> Deutschland / Germany
>
> https://www.dzbank.de
> mailto:mail@dzbank.de <ma...@dzbank.de>, T +49 69 7447 01, F +49 69 7447
> 1685
>
> https://twitter.com/dzbank <https://www.twitter.com/dzbank>
>
> Vorstand/Board of Directors: Uwe Fröhlich
> (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
> Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
> Uwe Berghaus,
> Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth,
> Thomas Ullrich
>
> Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning
> Deneke-Jöhrens
> Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am
> Main
> Handelsregister/Register of Companies: HRB 45651.
>
> ___________________________________________________________________
>
> Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
> werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens
> weiterverarbeitet.
> Weitere Informationen zum Datenschutz finden Sie unter
> https://www.dzbank.de/datenschutzhinweise
>
> The personal data collected by this e-mail communication
> will be processed exclusively for this purpose or to process your request.
> Further information with regards to your rights under data protection law
> can be found on
> our website at https://www.dzbank.com/dataprotection
>
AW: Issue: Spring-Boot vs. Apache Spark Dependencies
Posted by "Heyde, Andreas" <an...@dzbank.de>.
I had only one wish, that someone can have a look at this issue/topic.
The problem is, that janino 3.0.16 and 3.1.4 has a complete other package/file structure, and so they are incompatible.
The problem is, that was not done I a major version change, it’s a minor change.
So I don’t know, which version to use.
The newer one from Spring-boot the older one from spark.
I have to exclude one of theme explicitly, but I am not the expert, what the best idea is.
With "mvn dependency:tree" you see that the managed version is overwritten, but not the package, from which this come.
So I mentioned, in the internet there are lot of articles discussing bypasses the problem.
These is the spark version I am using.
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-sql_2.13</artifactId>
<version>3.2.0</version>
<exclusions>
<!-- We want only and exactly Spark's janino version , we see a dependency with spring-boot -->
<!-- customize these dependecy in all sub modules -->
<exclusion>
<groupId>org.codehaus.janino</groupId>
<artifactId>commons-compiler</artifactId>
</exclusion>
<exclusion>
<groupId>org.codehaus.janino</groupId>
<artifactId>janino</artifactId>
</exclusion>
</exclusions>
</dependency>
Regards
Von: Sean Owen <sr...@gmail.com>
Gesendet: Mittwoch, 19. Januar 2022 14:25
An: Heyde, Andreas <an...@dzbank.de>
Cc: user@spark.apache.org
Betreff: Re: Issue: Spring-Boot vs. Apache Spark Dependencies
I did not see your message in the moderation queue, not sure why. Indeed you should send to user@, not to individuals. Your message is here now.
Do you mean Spark 3.2.0? yes it is on Janino 3.0.16. You can use things like "mvn dependency:tree" on the project build to see dependencies, by the way.
That does not seem too old, but there are newer versions. Janino is intended as an internal dependency for Spark, and I suppose there has not yet been a reason to update it.
You are welcome to open a pull request that tries to update to the latest version, to see if it works.
You didn't say what the problem is though.
On Wed, Jan 19, 2022 at 6:14 AM Heyde, Andreas <an...@dzbank.de>> wrote:
After sending mail to Matei and yesterday subscribing user@spark.apache.org<ma...@spark.apache.org>
I cannot see my problem in
issues@spark.apache.org, past month - Apache Mail Archives<mailto:issues@spark.apache.org,%20past%20month%20-%20Apache%20Mail%20Archives>
Is there something wrong or where I have to write my issue new or send a change request
Regards
/Andreas
Von: Heyde, Andreas
Gesendet: Dienstag, 18. Januar 2022 08:23
An: 'user-subscribe@spark.apache.org<ma...@spark.apache.org>' <us...@spark.apache.org>>
Betreff: Spring-Boot vs. Apache Spark Dependencies
Hi Andreas,
I think it shouldn’t be hard to update it, but please just email the mailing list (https://spark.apache.org/community.html) or open an issue on JIRA to get the developers who work on that part of the code to look at it. I don’t think there will be major incompatibilities between those two versions. It may also be possible to configure your project’s build to use Janino 3.1 and still link against Spark (overriding its version) by packaging Janino 3.1 with your Spark job.
Matei
On Jan 17, 2022, at 12:17 AM, Heyde, Andreas <an...@dzbank.de>> wrote:
Hi Matei,
I hope to have found a good contact person with you.
We are using one of the latest spring-boot versions (2.5.5) with latest spark 2.13.
These spring framework has a hard dependency to janino 3.1.6.
Spark is using 3.0.16.
It was difficult to see. (Step by Step adding dependencies to a dummy project)
Some articles on the Internet discussing bypasses the problem.
Is there a reason, why you using such a older version?!
Is there a way to add your janino dependency only to logback or using the newest version of janino or specifying a version range [3.0.0,)
Regards
/Andreas
Mit freundlichen Grüßen/Kind regards
Andreas Heyde
DZ BANK AG
IT
Entwicklung Bewertung
F/ITEB
Platz der Republik
60325 Frankfurt am Main
Postanschrift
60265 Frankfurt am Main
T +49 69 7447 3403
F +49 69 7447 3477
mailto:andreas.heyde@dzbank.de
DZ BANK AG
Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
Platz der Republik, 60325 Frankfurt am Main
Deutschland / Germany
https://www.dzbank.de
mailto:mail@dzbank.de, T +49 69 7447 01, F +49 69 7447 1685
https://twitter.com/dzbank<https://www.twitter.com/dzbank>
Vorstand/Board of Directors: Uwe Fröhlich (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer), Uwe Berghaus,
Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth, Thomas Ullrich
Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning Deneke-Jöhrens
Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am Main
Handelsregister/Register of Companies: HRB 45651.
___________________________________________________________________
Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens weiterverarbeitet.
Weitere Informationen zum Datenschutz finden Sie unter https://www.dzbank.de/datenschutzhinweise
The personal data collected by this e-mail communication
will be processed exclusively for this purpose or to process your request.
Further information with regards to your rights under data protection law can be found on
our website at https://www.dzbank.com/dataprotection
___________________________________________________________________
DZ BANK AG
Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
Platz der Republik, 60325 Frankfurt am Main
Deutschland/Germany
https://www.dzbank.de
mailto:mail@dzbank.de, T +49 69 7447 01, F +49 69 7447 1685
https://twitter.com/dzbank
Vorstand/Board of Directors: Uwe Fröhlich (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer), Uwe Berghaus,
Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth, Thomas Ullrich
Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning Deneke-Jöhrens
Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am Main
Handelsregister/Register of Companies: HRB 45651.
___________________________________________________________________
Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens weiterverarbeitet.
Weitere Informationen zum Datenschutz finden Sie unter https://www.dzbank.de/datenschutzhinweise
The personal data collected by this e-mail communication
will be processed exclusively for this purpose or to process your request.
Further information with regards to your rights under data protection law can be found on
our website at https://www.dzbank.com/dataprotection
Re: Issue: Spring-Boot vs. Apache Spark Dependencies
Posted by Sean Owen <sr...@gmail.com>.
I did not see your message in the moderation queue, not sure why. Indeed
you should send to user@, not to individuals. Your message is here now.
Do you mean Spark 3.2.0? yes it is on Janino 3.0.16. You can use things
like "mvn dependency:tree" on the project build to see dependencies, by the
way.
That does not seem too old, but there are newer versions. Janino is
intended as an internal dependency for Spark, and I suppose there has not
yet been a reason to update it.
You are welcome to open a pull request that tries to update to the latest
version, to see if it works.
You didn't say what the problem is though.
On Wed, Jan 19, 2022 at 6:14 AM Heyde, Andreas <an...@dzbank.de>
wrote:
> After sending mail to Matei and yesterday subscribing
> user@spark.apache.org
>
> I cannot see my problem in
>
> issues@spark.apache.org, past month - Apache Mail Archives
>
>
>
>
>
> Is there something wrong or where I have to write my issue new or send a
> change request
>
> Regards
>
> /Andreas
>
> *Von:* Heyde, Andreas
> *Gesendet:* Dienstag, 18. Januar 2022 08:23
> *An:* 'user-subscribe@spark.apache.org' <us...@spark.apache.org>
> *Betreff:* Spring-Boot vs. Apache Spark Dependencies
>
>
>
>
>
> Hi Andreas,
>
>
>
> I think it shouldn’t be hard to update it, but please just email the
> mailing list (https://spark.apache.org/community.html) or open an issue
> on JIRA to get the developers who work on that part of the code to look at
> it. I don’t think there will be major incompatibilities between those two
> versions. It may also be possible to configure your project’s build to use
> Janino 3.1 and still link against Spark (overriding its version) by
> packaging Janino 3.1 with your Spark job.
>
>
>
> Matei
>
>
>
> On Jan 17, 2022, at 12:17 AM, Heyde, Andreas <an...@dzbank.de>
> wrote:
>
>
>
> Hi Matei,
>
> I hope to have found a good contact person with you.
>
> We are using one of the latest spring-boot versions (2.5.5) with latest
> spark 2.13.
>
>
>
> These spring framework has a hard dependency to janino 3.1.6.
>
> Spark is using 3.0.16.
>
> It was difficult to see. (Step by Step adding dependencies to a dummy
> project)
>
> Some articles on the Internet discussing bypasses the problem.
>
>
>
> Is there a reason, why you using such a older version?!
>
> Is there a way to add your janino dependency only to logback or using the newest version of janino or specifying a version range [3.0.0,)
>
>
>
>
>
> Regards
>
> /Andreas
>
>
>
>
>
>
>
> Mit freundlichen Grüßen/Kind regards
>
> Andreas Heyde
>
> *DZ BANK AG*
> IT
> Entwicklung Bewertung
> F/ITEB
> Platz der Republik
> 60325 Frankfurt am Main
> Postanschrift
> 60265 Frankfurt am Main
>
> T +49 69 7447 3403
> F +49 69 7447 3477
> mailto:andreas.heyde@dzbank.de <an...@dzbank.de>
>
>
>
>
>
> *DZ BANK AG*
> Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
> Platz der Republik, 60325 Frankfurt am Main
> Deutschland / Germany
>
> https://www.dzbank.de
> mailto:mail@dzbank.de <ma...@dzbank.de>, T +49 69 7447 01, F +49 69 7447
> 1685
>
> https://twitter.com/dzbank <https://www.twitter.com/dzbank>
>
> Vorstand/Board of Directors: Uwe Fröhlich
> (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
> Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
> Uwe Berghaus,
> Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth,
> Thomas Ullrich
>
> Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning
> Deneke-Jöhrens
> Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am
> Main
> Handelsregister/Register of Companies: HRB 45651.
>
> ___________________________________________________________________
>
> Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
> werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens
> weiterverarbeitet.
> Weitere Informationen zum Datenschutz finden Sie unter
> https://www.dzbank.de/datenschutzhinweise
>
> The personal data collected by this e-mail communication
> will be processed exclusively for this purpose or to process your request.
> Further information with regards to your rights under data protection law
> can be found on
> our website at https://www.dzbank.com/dataprotection
>
WG: Issue: Spring-Boot vs. Apache Spark Dependencies
Posted by "Heyde, Andreas" <an...@dzbank.de>.
see below, got mailing error.
Von: Heyde, Andreas <an...@dzbank.de>
Gesendet: Mittwoch, 19. Januar 2022 13:14
An: user@spark.apache.org; user-request@spark.apache.org
Betreff: Issue: Spring-Boot vs. Apache Spark Dependencies
After sending mail to Matei and yesterday subscribing user@spark.apache.org<ma...@spark.apache.org>
I cannot see my problem in
issues@spark.apache.org, past month - Apache Mail Archives<mailto:issues@spark.apache.org,%20past%20month%20-%20Apache%20Mail%20Archives>
Is there something wrong or where I have to write my issue new or send a change request
Regards
/Andreas
Von: Heyde, Andreas
Gesendet: Dienstag, 18. Januar 2022 08:23
An: 'user-subscribe@spark.apache.org' <us...@spark.apache.org>>
Betreff: Spring-Boot vs. Apache Spark Dependencies
Hi Andreas,
I think it shouldn’t be hard to update it, but please just email the mailing list (https://spark.apache.org/community.html) or open an issue on JIRA to get the developers who work on that part of the code to look at it. I don’t think there will be major incompatibilities between those two versions. It may also be possible to configure your project’s build to use Janino 3.1 and still link against Spark (overriding its version) by packaging Janino 3.1 with your Spark job.
Matei
On Jan 17, 2022, at 12:17 AM, Heyde, Andreas <an...@dzbank.de>> wrote:
Hi Matei,
I hope to have found a good contact person with you.
We are using one of the latest spring-boot versions (2.5.5) with latest spark 2.13.
These spring framework has a hard dependency to janino 3.1.6.
Spark is using 3.0.16.
It was difficult to see. (Step by Step adding dependencies to a dummy project)
Some articles on the Internet discussing bypasses the problem.
Is there a reason, why you using such a older version?!
Is there a way to add your janino dependency only to logback or using the newest version of janino or specifying a version range [3.0.0,)
Regards
/Andreas
Mit freundlichen Grüßen/Kind regards
Andreas Heyde
DZ BANK AG
IT
Entwicklung Bewertung
F/ITEB
Platz der Republik
60325 Frankfurt am Main
Postanschrift
60265 Frankfurt am Main
T +49 69 7447 3403
F +49 69 7447 3477
mailto:andreas.heyde@dzbank.de
DZ BANK AG
Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
Platz der Republik, 60325 Frankfurt am Main
Deutschland / Germany
https://www.dzbank.de
mailto:mail@dzbank.de, T +49 69 7447 01, F +49 69 7447 1685
https://twitter.com/dzbank<https://www.twitter.com/dzbank>
Vorstand/Board of Directors: Uwe Fröhlich (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer), Uwe Berghaus,
Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth, Thomas Ullrich
Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning Deneke-Jöhrens
Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am Main
Handelsregister/Register of Companies: HRB 45651.
___________________________________________________________________
Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens weiterverarbeitet.
Weitere Informationen zum Datenschutz finden Sie unter https://www.dzbank.de/datenschutzhinweise
The personal data collected by this e-mail communication
will be processed exclusively for this purpose or to process your request.
Further information with regards to your rights under data protection law can be found on
our website at https://www.dzbank.com/dataprotection
___________________________________________________________________
DZ BANK AG
Deutsche Zentral-Genossenschaftsbank, Frankfurt am Main
Platz der Republik, 60325 Frankfurt am Main
Deutschland/Germany
https://www.dzbank.de
mailto:mail@dzbank.de, T +49 69 7447 01, F +49 69 7447 1685
https://twitter.com/dzbank
Vorstand/Board of Directors: Uwe Fröhlich (Co-Vorstandsvorsitzender/Co-Chief Executive Officer),
Dr. Cornelius Riese (Co-Vorstandsvorsitzender/Co-Chief Executive Officer), Uwe Berghaus,
Dr. Christian Brauckmann, Ulrike Brouzi, Wolfgang Köhler, Michael Speth, Thomas Ullrich
Aufsichtsratsvorsitzender/Chairman of the Supervisory Board: Henning Deneke-Jöhrens
Sitz/Registered Office: Stadt Frankfurt am Main, Amtsgericht Frankfurt am Main
Handelsregister/Register of Companies: HRB 45651.
___________________________________________________________________
Die mit dieser E-Mail-Kommunikation erhobenen personenbezogenen Daten
werden ausschließlich zu diesem Zweck bzw. zur Bearbeitung Ihres Anliegens weiterverarbeitet.
Weitere Informationen zum Datenschutz finden Sie unter https://www.dzbank.de/datenschutzhinweise
The personal data collected by this e-mail communication
will be processed exclusively for this purpose or to process your request.
Further information with regards to your rights under data protection law can be found on
our website at https://www.dzbank.com/dataprotection