You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by miki haiat <mi...@gmail.com> on 2018/04/24 06:31:58 UTC
How to run flip-6 on mesos
HI,
Im trying to tun flip-6 on mesos but its not clear to me what is the
correct way to do it .
I run the session script and i can see that new framework has been created
in mesos but the task manager hasn't been created
running taskmanager-flip6.sh throw null pointer ...
what is the correct way to run flip-6 .
thanks,
miki
Re: How to run flip-6 on mesos
Posted by Gary Yao <ga...@data-artisans.com>.
Hi Miki,
We are currently working on resolving the last blocking issues for a second
Release Candidate. Afterwards it depends on how many new blocking issues
will be
found during the testing.
Best,
Gary
On Tue, Apr 24, 2018 at 9:42 AM, miki haiat <mi...@gmail.com> wrote:
> Its 1.4.2 ...
> Any approximate date for 1.5 release ?
>
> Thanks allot for your help .
>
>
>
> On Tue, Apr 24, 2018 at 10:39 AM, Gary Yao <ga...@data-artisans.com> wrote:
>
>> Hi Miki,
>>
>> The stacktrace you posted looks familiar [1]. We have fixed the issue in
>> Flink
>> 1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is
>> very
>> experimental, and I doubt that it is in a usable state. Since 1.5 is not
>> out
>> yet, you can either compile the release branch yourself, or use the RC1
>> binaries [2]. If you are already on 1.5, please open a ticket.
>>
>> Best,
>> Gary
>>
>> [1] https://issues.apache.org/jira/browse/FLINK-8176
>> [2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/
>>
>>
>> On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <mi...@gmail.com> wrote:
>>
>>> The problem is that the Web UI hasn't started at all
>>> Im using the sane config file that i used for none flip-6 is that ok ?
>>> Also i got this error in the logs .
>>>
>>>
>>> 2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>>> - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9
>>>> c6.
>>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>>> at org.apache.flink.util.Preconditions.checkState(Preconditions
>>>> .java:195)
>>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>>> at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>>> rJobs$3(Dispatcher.java:445)
>>>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39
>>>> )
>>>> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>>> exec(AbstractDispatcher.scala:415)
>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>>> ava:260)
>>>> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>>> kJoinPool.java:1339)
>>>> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>>> l.java:1979)
>>>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>>> orkerThread.java:107)
>>>> 2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>>> - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5a
>>>> c3.
>>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>>> at org.apache.flink.util.Preconditions.checkState(Preconditions
>>>> .java:195)
>>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>>> at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>>> rJobs$3(Dispatcher.java:445)
>>>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39
>>>> )
>>>> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>>> exec(AbstractDispatcher.scala:415)
>>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>>> ava:260)
>>>> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>>> kJoinPool.java:1339)
>>>> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>>> l.java:1979)
>>>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>>> orkerThread.java:107)
>>>
>>>
>>>
>>> On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <ga...@data-artisans.com>
>>> wrote:
>>>
>>>> Hi Miki,
>>>>
>>>> IIRC the port on which the Web UI is listening is not allocated
>>>> dynamically when
>>>> deploying on Mesos, and should be 8081 by default (you can override the
>>>> default
>>>> by setting rest.port in flink-conf.yaml). If you can find out the
>>>> hostname/IP of
>>>> the JobManager, you can submit as usual via the Web UI. Alternatively
>>>> you can
>>>> use the CLI, e.g.,
>>>>
>>>> bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>>>>
>>>> where 6123 is the jobmanager.rpc.port.
>>>>
>>>> Let me know if any of these work for you
>>>>
>>>> Best,
>>>> Gary
>>>>
>>>>
>>>> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <mi...@gmail.com> wrote:
>>>>
>>>>> NO :) ...
>>>>> I usually using the web UI .
>>>>> Can you refer me to some example how to submit a job ?
>>>>> Using REST ? to which port ?
>>>>>
>>>>> thanks,
>>>>>
>>>>> miki
>>>>>
>>>>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <ga...@data-artisans.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Miki,
>>>>>>
>>>>>> Did you try to submit a job? With the introduction of FLIP-6,
>>>>>> resources are
>>>>>> allocated dynamically.
>>>>>>
>>>>>> Best,
>>>>>> Gary
>>>>>>
>>>>>>
>>>>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>>
>>>>>>> HI,
>>>>>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>>>>>> correct way to do it .
>>>>>>>
>>>>>>> I run the session script and i can see that new framework has been
>>>>>>> created in mesos but the task manager hasn't been created
>>>>>>> running taskmanager-flip6.sh throw null pointer ...
>>>>>>>
>>>>>>> what is the correct way to run flip-6 .
>>>>>>>
>>>>>>>
>>>>>>> thanks,
>>>>>>>
>>>>>>> miki
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: How to run flip-6 on mesos
Posted by miki haiat <mi...@gmail.com>.
Its 1.4.2 ...
Any approximate date for 1.5 release ?
Thanks allot for your help .
On Tue, Apr 24, 2018 at 10:39 AM, Gary Yao <ga...@data-artisans.com> wrote:
> Hi Miki,
>
> The stacktrace you posted looks familiar [1]. We have fixed the issue in
> Flink
> 1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is
> very
> experimental, and I doubt that it is in a usable state. Since 1.5 is not
> out
> yet, you can either compile the release branch yourself, or use the RC1
> binaries [2]. If you are already on 1.5, please open a ticket.
>
> Best,
> Gary
>
> [1] https://issues.apache.org/jira/browse/FLINK-8176
> [2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/
>
>
> On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <mi...@gmail.com> wrote:
>
>> The problem is that the Web UI hasn't started at all
>> Im using the sane config file that i used for none flip-6 is that ok ?
>> Also i got this error in the logs .
>>
>>
>> 2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>> - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9
>>> c6.
>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>> at org.apache.flink.util.Preconditions.checkState(Preconditions
>>> .java:195)
>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>> at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>> rJobs$3(Dispatcher.java:445)
>>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>>> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>> exec(AbstractDispatcher.scala:415)
>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>> ava:260)
>>> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>> kJoinPool.java:1339)
>>> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>> l.java:1979)
>>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>> orkerThread.java:107)
>>> 2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>>> - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5a
>>> c3.
>>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>>> at org.apache.flink.util.Preconditions.checkState(Preconditions
>>> .java:195)
>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>>> at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>>> rJobs$3(Dispatcher.java:445)
>>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>>> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>>> exec(AbstractDispatcher.scala:415)
>>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.j
>>> ava:260)
>>> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(For
>>> kJoinPool.java:1339)
>>> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>>> l.java:1979)
>>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>>> orkerThread.java:107)
>>
>>
>>
>> On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <ga...@data-artisans.com>
>> wrote:
>>
>>> Hi Miki,
>>>
>>> IIRC the port on which the Web UI is listening is not allocated
>>> dynamically when
>>> deploying on Mesos, and should be 8081 by default (you can override the
>>> default
>>> by setting rest.port in flink-conf.yaml). If you can find out the
>>> hostname/IP of
>>> the JobManager, you can submit as usual via the Web UI. Alternatively
>>> you can
>>> use the CLI, e.g.,
>>>
>>> bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>>>
>>> where 6123 is the jobmanager.rpc.port.
>>>
>>> Let me know if any of these work for you
>>>
>>> Best,
>>> Gary
>>>
>>>
>>> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <mi...@gmail.com> wrote:
>>>
>>>> NO :) ...
>>>> I usually using the web UI .
>>>> Can you refer me to some example how to submit a job ?
>>>> Using REST ? to which port ?
>>>>
>>>> thanks,
>>>>
>>>> miki
>>>>
>>>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <ga...@data-artisans.com>
>>>> wrote:
>>>>
>>>>> Hi Miki,
>>>>>
>>>>> Did you try to submit a job? With the introduction of FLIP-6,
>>>>> resources are
>>>>> allocated dynamically.
>>>>>
>>>>> Best,
>>>>> Gary
>>>>>
>>>>>
>>>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>>
>>>>>> HI,
>>>>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>>>>> correct way to do it .
>>>>>>
>>>>>> I run the session script and i can see that new framework has been
>>>>>> created in mesos but the task manager hasn't been created
>>>>>> running taskmanager-flip6.sh throw null pointer ...
>>>>>>
>>>>>> what is the correct way to run flip-6 .
>>>>>>
>>>>>>
>>>>>> thanks,
>>>>>>
>>>>>> miki
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: How to run flip-6 on mesos
Posted by Gary Yao <ga...@data-artisans.com>.
Hi Miki,
The stacktrace you posted looks familiar [1]. We have fixed the issue in
Flink
1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is
very
experimental, and I doubt that it is in a usable state. Since 1.5 is not out
yet, you can either compile the release branch yourself, or use the RC1
binaries [2]. If you are already on 1.5, please open a ticket.
Best,
Gary
[1] https://issues.apache.org/jira/browse/FLINK-8176
[2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/
On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <mi...@gmail.com> wrote:
> The problem is that the Web UI hasn't started at all
> Im using the sane config file that i used for none flip-6 is that ok ?
> Also i got this error in the logs .
>
>
> 2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>> - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9
>> c6.
>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>> at org.apache.flink.util.Preconditions.checkState(Preconditions
>> .java:195)
>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>> at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>> rJobs$3(Dispatcher.java:445)
>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>> exec(AbstractDispatcher.scala:415)
>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.
>> java:260)
>> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(
>> ForkJoinPool.java:1339)
>> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>> l.java:1979)
>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>> orkerThread.java:107)
>> 2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher
>> - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5a
>> c3.
>> java.lang.IllegalStateException: Not running. Forgot to call start()?
>> at org.apache.flink.util.Preconditions.checkState(Preconditions
>> .java:195)
>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
>> at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGra
>> phStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
>> at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recove
>> rJobs$3(Dispatcher.java:445)
>> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
>> at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.
>> exec(AbstractDispatcher.scala:415)
>> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.
>> java:260)
>> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(
>> ForkJoinPool.java:1339)
>> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPoo
>> l.java:1979)
>> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinW
>> orkerThread.java:107)
>
>
>
> On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <ga...@data-artisans.com> wrote:
>
>> Hi Miki,
>>
>> IIRC the port on which the Web UI is listening is not allocated
>> dynamically when
>> deploying on Mesos, and should be 8081 by default (you can override the
>> default
>> by setting rest.port in flink-conf.yaml). If you can find out the
>> hostname/IP of
>> the JobManager, you can submit as usual via the Web UI. Alternatively you
>> can
>> use the CLI, e.g.,
>>
>> bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>>
>> where 6123 is the jobmanager.rpc.port.
>>
>> Let me know if any of these work for you
>>
>> Best,
>> Gary
>>
>>
>> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <mi...@gmail.com> wrote:
>>
>>> NO :) ...
>>> I usually using the web UI .
>>> Can you refer me to some example how to submit a job ?
>>> Using REST ? to which port ?
>>>
>>> thanks,
>>>
>>> miki
>>>
>>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <ga...@data-artisans.com>
>>> wrote:
>>>
>>>> Hi Miki,
>>>>
>>>> Did you try to submit a job? With the introduction of FLIP-6, resources
>>>> are
>>>> allocated dynamically.
>>>>
>>>> Best,
>>>> Gary
>>>>
>>>>
>>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com> wrote:
>>>>
>>>>>
>>>>> HI,
>>>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>>>> correct way to do it .
>>>>>
>>>>> I run the session script and i can see that new framework has been
>>>>> created in mesos but the task manager hasn't been created
>>>>> running taskmanager-flip6.sh throw null pointer ...
>>>>>
>>>>> what is the correct way to run flip-6 .
>>>>>
>>>>>
>>>>> thanks,
>>>>>
>>>>> miki
>>>>>
>>>>
>>>>
>>>
>>
>
Re: How to run flip-6 on mesos
Posted by miki haiat <mi...@gmail.com>.
The problem is that the Web UI hasn't started at all
Im using the sane config file that i used for none flip-6 is that ok ?
Also i got this error in the logs .
2018-04-24 10:16:05,466 ERROR
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Could not
> recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9c6.
> java.lang.IllegalStateException: Not running. Forgot to call start()?
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
> at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
> at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
> at
> org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
> at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
> at
> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> 2018-04-24 10:16:05,469 ERROR
> org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Could not
> recover the job graph for 700f37540fe95787510dfa2bc0cc5ac3.
> java.lang.IllegalStateException: Not running. Forgot to call start()?
> at
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
> at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
> at
> org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
> at
> org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
> at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
> at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
> at
> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <ga...@data-artisans.com> wrote:
> Hi Miki,
>
> IIRC the port on which the Web UI is listening is not allocated
> dynamically when
> deploying on Mesos, and should be 8081 by default (you can override the
> default
> by setting rest.port in flink-conf.yaml). If you can find out the
> hostname/IP of
> the JobManager, you can submit as usual via the Web UI. Alternatively you
> can
> use the CLI, e.g.,
>
> bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
>
> where 6123 is the jobmanager.rpc.port.
>
> Let me know if any of these work for you
>
> Best,
> Gary
>
>
> On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <mi...@gmail.com> wrote:
>
>> NO :) ...
>> I usually using the web UI .
>> Can you refer me to some example how to submit a job ?
>> Using REST ? to which port ?
>>
>> thanks,
>>
>> miki
>>
>> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <ga...@data-artisans.com> wrote:
>>
>>> Hi Miki,
>>>
>>> Did you try to submit a job? With the introduction of FLIP-6, resources
>>> are
>>> allocated dynamically.
>>>
>>> Best,
>>> Gary
>>>
>>>
>>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com> wrote:
>>>
>>>>
>>>> HI,
>>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>>> correct way to do it .
>>>>
>>>> I run the session script and i can see that new framework has been
>>>> created in mesos but the task manager hasn't been created
>>>> running taskmanager-flip6.sh throw null pointer ...
>>>>
>>>> what is the correct way to run flip-6 .
>>>>
>>>>
>>>> thanks,
>>>>
>>>> miki
>>>>
>>>
>>>
>>
>
Re: How to run flip-6 on mesos
Posted by Gary Yao <ga...@data-artisans.com>.
Hi Miki,
IIRC the port on which the Web UI is listening is not allocated dynamically
when
deploying on Mesos, and should be 8081 by default (you can override the
default
by setting rest.port in flink-conf.yaml). If you can find out the
hostname/IP of
the JobManager, you can submit as usual via the Web UI. Alternatively you
can
use the CLI, e.g.,
bin/flink run -m hostname:6123 examples/streaming/WordCount.jar
where 6123 is the jobmanager.rpc.port.
Let me know if any of these work for you
Best,
Gary
On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <mi...@gmail.com> wrote:
> NO :) ...
> I usually using the web UI .
> Can you refer me to some example how to submit a job ?
> Using REST ? to which port ?
>
> thanks,
>
> miki
>
> On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <ga...@data-artisans.com> wrote:
>
>> Hi Miki,
>>
>> Did you try to submit a job? With the introduction of FLIP-6, resources
>> are
>> allocated dynamically.
>>
>> Best,
>> Gary
>>
>>
>> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com> wrote:
>>
>>>
>>> HI,
>>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>>> correct way to do it .
>>>
>>> I run the session script and i can see that new framework has been
>>> created in mesos but the task manager hasn't been created
>>> running taskmanager-flip6.sh throw null pointer ...
>>>
>>> what is the correct way to run flip-6 .
>>>
>>>
>>> thanks,
>>>
>>> miki
>>>
>>
>>
>
Re: How to run flip-6 on mesos
Posted by miki haiat <mi...@gmail.com>.
NO :) ...
I usually using the web UI .
Can you refer me to some example how to submit a job ?
Using REST ? to which port ?
thanks,
miki
On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <ga...@data-artisans.com> wrote:
> Hi Miki,
>
> Did you try to submit a job? With the introduction of FLIP-6, resources are
> allocated dynamically.
>
> Best,
> Gary
>
>
> On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com> wrote:
>
>>
>> HI,
>> Im trying to tun flip-6 on mesos but its not clear to me what is the
>> correct way to do it .
>>
>> I run the session script and i can see that new framework has been
>> created in mesos but the task manager hasn't been created
>> running taskmanager-flip6.sh throw null pointer ...
>>
>> what is the correct way to run flip-6 .
>>
>>
>> thanks,
>>
>> miki
>>
>
>
Re: How to run flip-6 on mesos
Posted by Gary Yao <ga...@data-artisans.com>.
Hi Miki,
Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.
Best,
Gary
On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <mi...@gmail.com> wrote:
>
> HI,
> Im trying to tun flip-6 on mesos but its not clear to me what is the
> correct way to do it .
>
> I run the session script and i can see that new framework has been
> created in mesos but the task manager hasn't been created
> running taskmanager-flip6.sh throw null pointer ...
>
> what is the correct way to run flip-6 .
>
>
> thanks,
>
> miki
>