You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by HyukjinKwon <gi...@git.apache.org> on 2018/12/05 08:53:15 UTC
[GitHub] zeppelin pull request #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/zeppelin/pull/3253
[ZEPPELIN-3551] Upgrade Scala to 2.11.12
### What is this PR for?
This is just to update scala to 2.11.12 which to be consistent with spark (SPARK-24418).
This PR takes over and closes #3033
There was a minor conflict which my PR (https://github.com/apache/zeppelin/pull/3206) introduced. That change is compatible with both Scala 2.11.8 and 2.11.12 so we don't need to change it anymore.
### What type of PR is it?
[Improvement]
### Todos
* [ ] - None
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3551
### How should this be tested?
- CI pass
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/zeppelin scala-2.11.12
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/3253.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3253
----
commit 7d00314f8ec48556f75fe9877dcbee0d6e7ce2fe
Author: Jeff Zhang <zj...@...>
Date: 2018-06-19T07:32:27Z
ZEPPELIN-3551. Upgrade Scala to 2.11.12
----
---
[GitHub] zeppelin pull request #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
Posted by HyukjinKwon <gi...@git.apache.org>.
GitHub user HyukjinKwon reopened a pull request:
https://github.com/apache/zeppelin/pull/3253
[ZEPPELIN-3551] Upgrade Scala to 2.11.12
### What is this PR for?
This is just to update scala to 2.11.12 which to be consistent with spark (SPARK-24418).
This PR takes over and closes #3033
There was a minor conflict which my PR (https://github.com/apache/zeppelin/pull/3206) introduced. That change is compatible with both Scala 2.11.8 and 2.11.12 so we don't need to change it anymore.
### What type of PR is it?
[Improvement]
### Todos
* [ ] - None
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3551
### How should this be tested?
- CI pass
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HyukjinKwon/zeppelin scala-2.11.12
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/3253.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3253
----
commit 7d00314f8ec48556f75fe9877dcbee0d6e7ce2fe
Author: Jeff Zhang <zj...@...>
Date: 2018-06-19T07:32:27Z
ZEPPELIN-3551. Upgrade Scala to 2.11.12
----
---
[GitHub] zeppelin issue #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/zeppelin/pull/3253
Spark 2.4 support was added at https://github.com/apache/zeppelin/pull/3206, which exactly addresses the issue you faced. This will be available in new release of Zeppelin.
---
[GitHub] zeppelin issue #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
Posted by GezimSejdiu <gi...@git.apache.org>.
Github user GezimSejdiu commented on the issue:
https://github.com/apache/zeppelin/pull/3253
Many thanks for your response!
As of now, I will downgrade the Spark version and looking forward to the new release of Zeppelin.
Best regards,
---
[GitHub] zeppelin issue #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
Posted by GezimSejdiu <gi...@git.apache.org>.
Github user GezimSejdiu commented on the issue:
https://github.com/apache/zeppelin/pull/3253
Hi @HyukjinKwon ,
any news about this PR? Does it support Spark 2.4.0 (Scala 2.11.x) interpreter already? I just created a new branch which builds a [customized zeppelin docker](https://github.com/big-data-europe/docker-zeppelin/tree/0.0.1-zeppelin-0.8.0-hadoop-2.8.0-spark-2.4.0) based on [BDE spark docker](https://github.com/big-data-europe/docker-spark) and while testing it on [SANSA](https://github.com/SANSA-Stack) via [SANSA-Notebooks](https://github.com/SANSA-Stack/SANSA-Notebooks), found out that it does not work with Spark 2.4.0 :(. (see the stack trace below) :
```shell
java.lang.NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala$tools$nsc$interpreter$ILoop$$loopPostInit()
at java.lang.Class.getMethod(Class.java:1786)
at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.callMethod(BaseSparkScalaInterpreter.scala:268)
at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.callMethod(BaseSparkScalaInterpreter.scala:262)
at org.apache.zeppelin.spark.SparkScala211Interpreter.open(SparkScala211Interpreter.scala:84)
at org.apache.zeppelin.spark.NewSparkInterpreter.open(NewSparkInterpreter.java:102)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:62)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
```
Is there a plan to have that support soon on the new release? or we have to downgrade and use Spark 2.3.x instead ?
Looking forward to hearing from you.
Best regards,
---
[GitHub] zeppelin issue #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/zeppelin/pull/3253
I'm not aware of release plan in Zeppelin since I'm just one of contributors. For the current status, the Spark should be downgraded as far as I can tell.
---
[GitHub] zeppelin pull request #3253: [ZEPPELIN-3551] Upgrade Scala to 2.11.12
Posted by HyukjinKwon <gi...@git.apache.org>.
Github user HyukjinKwon closed the pull request at:
https://github.com/apache/zeppelin/pull/3253
---