You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by Leemoonsoo <gi...@git.apache.org> on 2015/07/04 03:01:31 UTC
[GitHub] incubator-zeppelin pull request: ZEPPELIN-145 Upgrade Flink versio...
GitHub user Leemoonsoo opened a pull request:
https://github.com/apache/incubator-zeppelin/pull/142
ZEPPELIN-145 Upgrade Flink version to 0.9.0
https://issues.apache.org/jira/browse/ZEPPELIN-145
Upgrade flink version to 0.9.0
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Leemoonsoo/incubator-zeppelin ZEPPELIN-145
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-zeppelin/pull/142.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #142
----
commit 5396b9bec9d414bff0a141a5c8e98b6719751ae1
Author: Lee moon soo <mo...@apache.org>
Date: 2015-07-04T00:59:00Z
Change code to use FlinkILoop that is introduced in 0.9.0
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: ZEPPELIN-145 Upgrade Flink versio...
Posted by stumped2 <gi...@git.apache.org>.
Github user stumped2 commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/142#issuecomment-120987456
Closing as per https://issues.apache.org/jira/browse/INFRA-9976
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: [WIP] ZEPPELIN-145 Upgrade Flink ...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/142#issuecomment-118447430
I have changed implementation to use FlinkILoop. but i'm getting an exception ..
```
val text = env.fromElements("To be, or not to be")
val counts = text.flatMap { _.toLowerCase.split("\\W+") }.
map { (_, 1) }.
groupBy(0).
sum(1)
val wc = counts.collect
--------------------------------------------------------------------------------------------------------
text: org.apache.flink.api.scala.DataSet[String] = org.apache.flink.api.scala.DataSet@63d817c0
counts: org.apache.flink.api.scala.AggregateDataSet[(String, Int)] = org.apache.flink.api.scala.AggregateDataSet@7fcca542
java.lang.IllegalAccessError: tried to access field org.apache.flink.api.java.RemoteEnvironment.host from class org.apache.flink.api.java.ScalaShellRemoteEnvironment
at org.apache.flink.api.java.ScalaShellRemoteEnvironment.execute(ScalaShellRemoteEnvironment.java:65)
at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:798)
at org.apache.flink.api.scala.ExecutionEnvironment.execute(ExecutionEnvironment.scala:582)
at org.apache.flink.api.scala.DataSet.collect(DataSet.scala:542)
at .<init>(<console>:21)
at .<clinit>(<console>)
at .<init>(<console>:7)
at .<clinit>(<console>)
at $print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:734)
at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:983)
at scala.tools.nsc.interpreter.IMain.loadAndRunReq$1(IMain.scala:573)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:604)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:568)
at org.apache.zeppelin.flink.FlinkInterpreter.interpret(FlinkInterpreter.java:251)
at org.apache.zeppelin.flink.FlinkInterpreter.interpret(FlinkInterpreter.java:230)
at org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:277)
at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:118)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: ZEPPELIN-145 Upgrade Flink versio...
Posted by stumped2 <gi...@git.apache.org>.
Github user stumped2 closed the pull request at:
https://github.com/apache/incubator-zeppelin/pull/142
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: [WIP] ZEPPELIN-145 Upgrade Flink ...
Posted by aljoscha <gi...@git.apache.org>.
Github user aljoscha commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/142#issuecomment-118804173
Hi,
did you also correctly update the Flink version in the cluster and everywhere else? This seems like a version mismatch, the field RemoteEnvironment.host was private in Flink before version 0.9.0 but now it is protected and should be accessible by ScalaShellRemoteEnvironment (which is a subclass of RemoteEnvironment).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-zeppelin pull request: [WIP] ZEPPELIN-145 Upgrade Flink ...
Posted by Leemoonsoo <gi...@git.apache.org>.
Github user Leemoonsoo commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/142#issuecomment-119757160
@aljoscha Thanks for the help. I think i made some mistake now it's working without error.
Ready to merge.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---