You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by "GuoPhilipse (via GitHub)" <gi...@apache.org> on 2023/02/05 09:04:24 UTC
[GitHub] [linkis] GuoPhilipse opened a new issue, #4144: [Feature][linkis-engineconn-plugins] support different spark version
GuoPhilipse opened a new issue, #4144:
URL: https://github.com/apache/linkis/issues/4144
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/linkis/issues) and found no similar feature requirement.
### Problem Description
Now we have spark 2.4.3, if we want to use spark3, linkis may not support directly. some code fit for spark2 but not for spark3, some code fit for spark3, not for spark2, we can improve it.
### Description
support spark2 and spark3, only profile will be specific while compile source code , no need to modify linkis source code
### Use case
spark2+hadoop2
``mvn install package``
spark2+hadoop3
``mvn install package -Pspark-2.4-hadoop-3.3 -Phadoop-3.3``
spark3+hadoop2
``mvn install package -Pspark-3.2``
spark3+ hadoop3
``mvn install package -Pspark-3.2 -Phadoop-3.3 ``
spark subversion can be specifc by -Dspark.version=xxx
for example :
``mvn install package -Pspark-3.2 -Phadoop-3.3 -Dspark.version=3.3.1``
### Solutions
_No response_
### Anything else
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] github-actions[bot] commented on issue #4144: [Feature][linkis-engineconn-plugins] support different spark version
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4144:
URL: https://github.com/apache/linkis/issues/4144#issuecomment-1417147943
## :blush: Welcome to the Apache Linkis community!!
We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context.
We will be here shortly.
If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
:point_right: [How to Participate in Project Contribution](https://linkis.apache.org/community/how-to-contribute).
### Community
|WeChat Assistant|WeChat Public Account|
|-|-|
|<img src="https://linkis.apache.org/Images/wedatasphere_contact_01.png" width="128"/>|<img src="https://linkis.apache.org/Images/gzh_01.png" width="128"/>|
### Mailing Lists
|Name|Description|Subscribe|Unsubscribe|Archive|
|:-----|:--------|:------|:-------|:-----|
| [dev@linkis.apache.org](mailto:dev@linkis.apache.org) | community activity information | [subscribe](mailto:dev-subscribe@linkis.apache.org) | [unsubscribe](mailto:dev-unsubscribe@linkis.apache.org) | [archive](http://mail-archives.apache.org/mod_mbox/linkis-dev) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] casionone closed issue #4144: [Feature][linkis-engineconn-plugins] support different spark version
Posted by "casionone (via GitHub)" <gi...@apache.org>.
casionone closed issue #4144: [Feature][linkis-engineconn-plugins] support different spark version
URL: https://github.com/apache/linkis/issues/4144
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org