You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by GitBox <gi...@apache.org> on 2022/07/04 11:52:19 UTC
[GitHub] [incubator-linkis] zengxiangqi1031 opened a new issue, #2408: [Bug] build failed when build with spark3.2.1
zengxiangqi1031 opened a new issue, #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408
### Search before asking
- [X] I searched the [issues](https://github.com/apache/incubator-linkis/issues) and found no similar issues.
### Linkis Component
linkis-cg-engineConnplugin
### What happened + What you expected to happen
1. **the bug is**: Linkis could not be builded with spark3.2.1,but success with spark3.0.0
2. **expected behavior** : linkis can be builded successfully with spark3.2+
3. **more information is available here**:
:
### Relevent platform
centos7.6
### Reproduction script
just modified incubator-linkis/linkis-engineconn-plugins/engineconn-plugins/spark/pom.xml :
scala.binary.version -> 2.12.15
spark.version -> 3.2.1
and then run ：mvn clean install
### Anything else
none
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] zengxiangqi1031 commented on issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
zengxiangqi1031 commented on issue #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408#issuecomment-1173843030
> see #2186
yeah, i have seen this , but i found no more difference in SparkSQLHistoryParser.scala. Would you like to tell me,thanks a lot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] jackxu2011 commented on issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
jackxu2011 commented on issue #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408#issuecomment-1173807627
see #2186
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] jackxu2011 commented on issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
jackxu2011 commented on issue #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408#issuecomment-1173876243
change the c.child to c.plan, the spark3.2.1 rename the field's name from child to plan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] ruY9527 commented on issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
ruY9527 commented on issue #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408#issuecomment-1173769510
Hello, is it convenient to tell what version or branch is used by linkis?
You can enter linkis-engineplugin-spark and execute mvn clean install to see if there are specific detailed errors.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] zengxiangqi1031 closed issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
zengxiangqi1031 closed issue #2408: [Bug] build failed when build with spark3.2.1
URL: https://github.com/apache/incubator-linkis/issues/2408
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] zengxiangqi1031 commented on issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
zengxiangqi1031 commented on issue #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408#issuecomment-1173837047
> Hello, is it convenient to tell what version or branch is used by linkis? You can enter linkis-engineplugin-spark and execute mvn clean install to see if there are specific detailed errors.
version is : 1.1.3
for more detailed errors please see the screenshot below:
**here is my solution:**
In linkis's SparkSQLHistoryParser.scala , change c.child to c.plan,it could be built successfully , because **views.scala** in spark3.2.1 use plan instead of child.
the solution still has problem: it just compatiable with higher spark version,like spark3.2+
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] zengxiangqi1031 commented on issue #2408: [Bug] build failed when build with spark3.2.1
Posted by GitBox <gi...@apache.org>.
zengxiangqi1031 commented on issue #2408:
URL: https://github.com/apache/incubator-linkis/issues/2408#issuecomment-1173842208
> see #2186
yeah, i have seen this , but i found no more difference in SparkSQLHistoryParser.scala. Would you like to tell me,thanks a lot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org