You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by st...@orange.com on 2020/02/13 10:02:34 UTC
End of completion for z.runParagraph
Hello all,
Id like to trigger many paragraphs execution from an angular one. If I
launch many spark ones, they are executed one after each other, but if I mix
spark and angular ones, angular ones are triggered even if spark ones are
not finished yet. I guess this comes from the asynchronous behavior of
javascript. So, is there any way to catch the end of a paragraph execution
in order to be able to trigger the next one?
Thanks,
Stéphane
Re: End of completion for z.runParagraph
Posted by Jeff Zhang <zj...@gmail.com>.
That's right, run paragraph synchronously api is better.
<st...@orange.com> 于2020年2月14日周五 下午6:51写道：
> Thanks Jeff, it works fine J
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* Friday, February 14, 2020 09:59
> *To:* users
> *Subject:* Re: End of completion for z.runParagraph
>
>
>
> One workaround I can think of is using the rest api to get the paragraph
> status.
>
>
> http://zeppelin.apache.org/docs/0.8.2/usage/rest_api/notebook.html#get-the-status-of-a-single-paragraph
>
>
>
>
>
> <st...@orange.com> 于2020年2月14日周五 下午4:34写道：
>
> Hello Jeff,
>
>
>
> So does this mean that there is no solution?
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* Friday, February 14, 2020 09:33
> *To:* users
> *Subject:* Re: End of completion for z.runParagraph
>
>
>
> z.run is non-blocking call, it would just trigger the paragraph execution.
>
> The reason why you see spark paragraphs running one after one is because
> of spark interpreter use FIFOScheduler
>
>
>
> <st...@orange.com> 于2020年2月13日周四 下午6:20写道：
>
> Hello Jeff,
>
>
>
> Thanks for your answer. Here is what I want to do:
>
>
>
> <div id="runAll"></div>
>
>
>
> <script type="application/javascript">
>
> var element = $('#runAll');
>
> var scope =
> angular.element(element.parent('.ng-scope')).scope().compiledScope;
>
> var z = scope.z;
>
> scope.refresh = function () {
>
>
>
> z.runParagraph('20200120-072110_977046884'); // è Load data from
> Spark (spark parapgraph)
>
> z.runParagraph('20200120-073038_1367909362'); // è Compute
> additional dataframes (spark paragraph)
>
> z.runParagraph('20200127-143445_1471220750'); // è Launch
> advanced visualization with angular / Vega (angular paragraph)
>
> }
>
> </script>
>
> <form class="form-inline">
>
> <div class="form-group">
>
>
>
> <button type="submit" class="btn btn-primary"
> ng-click="refresh()">
>
> Refresh global paragraphs
>
> </button>
>
>
>
> I’ve tried to add a “z.run” at the end of a Spark paragraph, but it
> doesn’t work, I have a “permission Denied” in my logs, it seems to come
> from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have
> this issue whe I try to run a spark paragraph from an angular paragraph.
>
>
>
> Of course, the global idea is to have a single button which woul refresh
> all the paragrpah in the right order
>
>
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* Thursday, February 13, 2020 11:11
> *To:* users
> *Subject:* Re: End of completion for z.runParagraph
>
>
>
> Because each interpreter has its own scheduler. They are in different
> schedulers. BTW, do you mind to share your note so that people can
> understand your question easier ?
>
>
>
> <st...@orange.com> 于2020年2月13日周四 下午6:02写道：
>
> Hello all,
>
>
>
> I’d like to trigger many paragraphs execution from an angular one. If I
> launch many spark ones, they are executed one after each other, but if I
> mix spark and angular ones, angular ones are triggered even if spark ones
> are not finished yet. I guess this comes from the asynchronous behavior of
> javascript. So, is there any way to catch the end of a paragraph execution
> in order to be able to trigger the next one?
>
>
>
> Thanks,
>
>
>
> Stéphane
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
RE: End of completion for z.runParagraph
Posted by st...@orange.com.
Thanks Jeff, it works fine J
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Friday, February 14, 2020 09:59
To: users
Subject: Re: End of completion for z.runParagraph
One workaround I can think of is using the rest api to get the paragraph status.
http://zeppelin.apache.org/docs/0.8.2/usage/rest_api/notebook.html#get-the-status-of-a-single-paragraph
<st...@orange.com> 于2020年2月14日周五 下午4:34写道：
Hello Jeff,
So does this mean that there is no solution?
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Friday, February 14, 2020 09:33
To: users
Subject: Re: End of completion for z.runParagraph
z.run is non-blocking call, it would just trigger the paragraph execution.
The reason why you see spark paragraphs running one after one is because of spark interpreter use FIFOScheduler
<st...@orange.com> 于2020年2月13日周四 下午6:20写道：
Hello Jeff,
Thanks for your answer. Here is what I want to do:
<div id="runAll"></div>
<script type="application/javascript">
var element = $('#runAll');
var scope = angular.element(element.parent('.ng-scope')).scope().compiledScope;
var z = scope.z;
scope.refresh = function () {
z.runParagraph('20200120-072110_977046884'); // è Load data from Spark (spark parapgraph)
z.runParagraph('20200120-073038_1367909362'); // è Compute additional dataframes (spark paragraph)
z.runParagraph('20200127-143445_1471220750'); // è Launch advanced visualization with angular / Vega (angular paragraph)
}
</script>
<form class="form-inline">
<div class="form-group">
<button type="submit" class="btn btn-primary" ng-click="refresh()">
Refresh global paragraphs
</button>
I’ve tried to add a “z.run” at the end of a Spark paragraph, but it doesn’t work, I have a “permission Denied” in my logs, it seems to come from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have this issue whe I try to run a spark paragraph from an angular paragraph.
Of course, the global idea is to have a single button which woul refresh all the paragrpah in the right order
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Thursday, February 13, 2020 11:11
To: users
Subject: Re: End of completion for z.runParagraph
Because each interpreter has its own scheduler. They are in different schedulers. BTW, do you mind to share your note so that people can understand your question easier ?
<st...@orange.com> 于2020年2月13日周四 下午6:02写道：
Hello all,
I’d like to trigger many paragraphs execution from an angular one. If I launch many spark ones, they are executed one after each other, but if I mix spark and angular ones, angular ones are triggered even if spark ones are not finished yet. I guess this comes from the asynchronous behavior of javascript. So, is there any way to catch the end of a paragraph execution in order to be able to trigger the next one?
Thanks,
Stéphane
--
Best Regards
Jeff Zhang
--
Best Regards
Jeff Zhang
--
Best Regards
Jeff Zhang
RE: End of completion for z.runParagraph
Posted by st...@orange.com.
Or maybe run a paragraph synchronously: http://zeppelin.apache.org/docs/0.8.2/usage/rest_api/notebook.html#run-a-paragraph-synchronously ?
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Friday, February 14, 2020 09:59
To: users
Subject: Re: End of completion for z.runParagraph
One workaround I can think of is using the rest api to get the paragraph status.
http://zeppelin.apache.org/docs/0.8.2/usage/rest_api/notebook.html#get-the-status-of-a-single-paragraph
<st...@orange.com> 于2020年2月14日周五 下午4:34写道：
Hello Jeff,
So does this mean that there is no solution?
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Friday, February 14, 2020 09:33
To: users
Subject: Re: End of completion for z.runParagraph
z.run is non-blocking call, it would just trigger the paragraph execution.
The reason why you see spark paragraphs running one after one is because of spark interpreter use FIFOScheduler
<st...@orange.com> 于2020年2月13日周四 下午6:20写道：
Hello Jeff,
Thanks for your answer. Here is what I want to do:
<div id="runAll"></div>
<script type="application/javascript">
var element = $('#runAll');
var scope = angular.element(element.parent('.ng-scope')).scope().compiledScope;
var z = scope.z;
scope.refresh = function () {
z.runParagraph('20200120-072110_977046884'); // è Load data from Spark (spark parapgraph)
z.runParagraph('20200120-073038_1367909362'); // è Compute additional dataframes (spark paragraph)
z.runParagraph('20200127-143445_1471220750'); // è Launch advanced visualization with angular / Vega (angular paragraph)
}
</script>
<form class="form-inline">
<div class="form-group">
<button type="submit" class="btn btn-primary" ng-click="refresh()">
Refresh global paragraphs
</button>
I’ve tried to add a “z.run” at the end of a Spark paragraph, but it doesn’t work, I have a “permission Denied” in my logs, it seems to come from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have this issue whe I try to run a spark paragraph from an angular paragraph.
Of course, the global idea is to have a single button which woul refresh all the paragrpah in the right order
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Thursday, February 13, 2020 11:11
To: users
Subject: Re: End of completion for z.runParagraph
Because each interpreter has its own scheduler. They are in different schedulers. BTW, do you mind to share your note so that people can understand your question easier ?
<st...@orange.com> 于2020年2月13日周四 下午6:02写道：
Hello all,
I’d like to trigger many paragraphs execution from an angular one. If I launch many spark ones, they are executed one after each other, but if I mix spark and angular ones, angular ones are triggered even if spark ones are not finished yet. I guess this comes from the asynchronous behavior of javascript. So, is there any way to catch the end of a paragraph execution in order to be able to trigger the next one?
Thanks,
Stéphane
--
Best Regards
Jeff Zhang
--
Best Regards
Jeff Zhang
--
Best Regards
Jeff Zhang
Re: End of completion for z.runParagraph
Posted by Jeff Zhang <zj...@gmail.com>.
One workaround I can think of is using the rest api to get the paragraph
status.
http://zeppelin.apache.org/docs/0.8.2/usage/rest_api/notebook.html#get-the-status-of-a-single-paragraph
<st...@orange.com> 于2020年2月14日周五 下午4:34写道：
> Hello Jeff,
>
>
>
> So does this mean that there is no solution?
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* Friday, February 14, 2020 09:33
> *To:* users
> *Subject:* Re: End of completion for z.runParagraph
>
>
>
> z.run is non-blocking call, it would just trigger the paragraph execution.
>
> The reason why you see spark paragraphs running one after one is because
> of spark interpreter use FIFOScheduler
>
>
>
> <st...@orange.com> 于2020年2月13日周四 下午6:20写道：
>
> Hello Jeff,
>
>
>
> Thanks for your answer. Here is what I want to do:
>
>
>
> <div id="runAll"></div>
>
>
>
> <script type="application/javascript">
>
> var element = $('#runAll');
>
> var scope =
> angular.element(element.parent('.ng-scope')).scope().compiledScope;
>
> var z = scope.z;
>
> scope.refresh = function () {
>
>
>
> z.runParagraph('20200120-072110_977046884'); // è Load data from
> Spark (spark parapgraph)
>
> z.runParagraph('20200120-073038_1367909362'); // è Compute
> additional dataframes (spark paragraph)
>
> z.runParagraph('20200127-143445_1471220750'); // è Launch
> advanced visualization with angular / Vega (angular paragraph)
>
> }
>
> </script>
>
> <form class="form-inline">
>
> <div class="form-group">
>
>
>
> <button type="submit" class="btn btn-primary"
> ng-click="refresh()">
>
> Refresh global paragraphs
>
> </button>
>
>
>
> I’ve tried to add a “z.run” at the end of a Spark paragraph, but it
> doesn’t work, I have a “permission Denied” in my logs, it seems to come
> from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have
> this issue whe I try to run a spark paragraph from an angular paragraph.
>
>
>
> Of course, the global idea is to have a single button which woul refresh
> all the paragrpah in the right order
>
>
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* Thursday, February 13, 2020 11:11
> *To:* users
> *Subject:* Re: End of completion for z.runParagraph
>
>
>
> Because each interpreter has its own scheduler. They are in different
> schedulers. BTW, do you mind to share your note so that people can
> understand your question easier ?
>
>
>
> <st...@orange.com> 于2020年2月13日周四 下午6:02写道：
>
> Hello all,
>
>
>
> I’d like to trigger many paragraphs execution from an angular one. If I
> launch many spark ones, they are executed one after each other, but if I
> mix spark and angular ones, angular ones are triggered even if spark ones
> are not finished yet. I guess this comes from the asynchronous behavior of
> javascript. So, is there any way to catch the end of a paragraph execution
> in order to be able to trigger the next one?
>
>
>
> Thanks,
>
>
>
> Stéphane
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
RE: End of completion for z.runParagraph
Posted by st...@orange.com.
Hello Jeff,
So does this mean that there is no solution?
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Friday, February 14, 2020 09:33
To: users
Subject: Re: End of completion for z.runParagraph
z.run is non-blocking call, it would just trigger the paragraph execution.
The reason why you see spark paragraphs running one after one is because of spark interpreter use FIFOScheduler
<st...@orange.com> 于2020年2月13日周四 下午6:20写道：
Hello Jeff,
Thanks for your answer. Here is what I want to do:
<div id="runAll"></div>
<script type="application/javascript">
var element = $('#runAll');
var scope = angular.element(element.parent('.ng-scope')).scope().compiledScope;
var z = scope.z;
scope.refresh = function () {
z.runParagraph('20200120-072110_977046884'); // è Load data from Spark (spark parapgraph)
z.runParagraph('20200120-073038_1367909362'); // è Compute additional dataframes (spark paragraph)
z.runParagraph('20200127-143445_1471220750'); // è Launch advanced visualization with angular / Vega (angular paragraph)
}
</script>
<form class="form-inline">
<div class="form-group">
<button type="submit" class="btn btn-primary" ng-click="refresh()">
Refresh global paragraphs
</button>
I’ve tried to add a “z.run” at the end of a Spark paragraph, but it doesn’t work, I have a “permission Denied” in my logs, it seems to come from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have this issue whe I try to run a spark paragraph from an angular paragraph.
Of course, the global idea is to have a single button which woul refresh all the paragrpah in the right order
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Thursday, February 13, 2020 11:11
To: users
Subject: Re: End of completion for z.runParagraph
Because each interpreter has its own scheduler. They are in different schedulers. BTW, do you mind to share your note so that people can understand your question easier ?
<st...@orange.com> 于2020年2月13日周四 下午6:02写道：
Hello all,
I’d like to trigger many paragraphs execution from an angular one. If I launch many spark ones, they are executed one after each other, but if I mix spark and angular ones, angular ones are triggered even if spark ones are not finished yet. I guess this comes from the asynchronous behavior of javascript. So, is there any way to catch the end of a paragraph execution in order to be able to trigger the next one?
Thanks,
Stéphane
--
Best Regards
Jeff Zhang
--
Best Regards
Jeff Zhang
Re: End of completion for z.runParagraph
Posted by Jeff Zhang <zj...@gmail.com>.
z.run is non-blocking call, it would just trigger the paragraph execution.
The reason why you see spark paragraphs running one after one is because of
spark interpreter use FIFOScheduler
<st...@orange.com> 于2020年2月13日周四 下午6:20写道：
> Hello Jeff,
>
>
>
> Thanks for your answer. Here is what I want to do:
>
>
>
> <div id="runAll"></div>
>
>
>
> <script type="application/javascript">
>
> var element = $('#runAll');
>
> var scope =
> angular.element(element.parent('.ng-scope')).scope().compiledScope;
>
> var z = scope.z;
>
> scope.refresh = function () {
>
>
>
> z.runParagraph('20200120-072110_977046884'); // è Load data from
> Spark (spark parapgraph)
>
> z.runParagraph('20200120-073038_1367909362'); // è Compute
> additional dataframes (spark paragraph)
>
> z.runParagraph('20200127-143445_1471220750'); // è Launch
> advanced visualization with angular / Vega (angular paragraph)
>
> }
>
> </script>
>
> <form class="form-inline">
>
> <div class="form-group">
>
>
>
> <button type="submit" class="btn btn-primary"
> ng-click="refresh()">
>
> Refresh global paragraphs
>
> </button>
>
>
>
> I’ve tried to add a “z.run” at the end of a Spark paragraph, but it
> doesn’t work, I have a “permission Denied” in my logs, it seems to come
> from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have
> this issue whe I try to run a spark paragraph from an angular paragraph.
>
>
>
> Of course, the global idea is to have a single button which woul refresh
> all the paragrpah in the right order
>
>
>
>
>
> *From:* Jeff Zhang [mailto:zjffdu@gmail.com]
> *Sent:* Thursday, February 13, 2020 11:11
> *To:* users
> *Subject:* Re: End of completion for z.runParagraph
>
>
>
> Because each interpreter has its own scheduler. They are in different
> schedulers. BTW, do you mind to share your note so that people can
> understand your question easier ?
>
>
>
> <st...@orange.com> 于2020年2月13日周四 下午6:02写道：
>
> Hello all,
>
>
>
> I’d like to trigger many paragraphs execution from an angular one. If I
> launch many spark ones, they are executed one after each other, but if I
> mix spark and angular ones, angular ones are triggered even if spark ones
> are not finished yet. I guess this comes from the asynchronous behavior of
> javascript. So, is there any way to catch the end of a paragraph execution
> in order to be able to trigger the next one?
>
>
>
> Thanks,
>
>
>
> Stéphane
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
RE: End of completion for z.runParagraph
Posted by st...@orange.com.
Hello Jeff,
Thanks for your answer. Here is what I want to do:
<div id="runAll"></div>
<script type="application/javascript">
var element = $('#runAll');
var scope = angular.element(element.parent('.ng-scope')).scope().compiledScope;
var z = scope.z;
scope.refresh = function () {
z.runParagraph('20200120-072110_977046884'); // è Load data from Spark (spark parapgraph)
z.runParagraph('20200120-073038_1367909362'); // è Compute additional dataframes (spark paragraph)
z.runParagraph('20200127-143445_1471220750'); // è Launch advanced visualization with angular / Vega (angular paragraph)
}
</script>
<form class="form-inline">
<div class="form-group">
<button type="submit" class="btn btn-primary" ng-click="refresh()">
Refresh global paragraphs
</button>
I’ve tried to add a “z.run” at the end of a Spark paragraph, but it doesn’t work, I have a “permission Denied” in my logs, it seems to come from the fact that I have Kerberos enabled. Quite suprisingly, I don’t have this issue whe I try to run a spark paragraph from an angular paragraph.
Of course, the global idea is to have a single button which woul refresh all the paragrpah in the right order
From: Jeff Zhang [mailto:zjffdu@gmail.com]
Sent: Thursday, February 13, 2020 11:11
To: users
Subject: Re: End of completion for z.runParagraph
Because each interpreter has its own scheduler. They are in different schedulers. BTW, do you mind to share your note so that people can understand your question easier ?
<st...@orange.com> 于2020年2月13日周四 下午6:02写道：
Hello all,
I’d like to trigger many paragraphs execution from an angular one. If I launch many spark ones, they are executed one after each other, but if I mix spark and angular ones, angular ones are triggered even if spark ones are not finished yet. I guess this comes from the asynchronous behavior of javascript. So, is there any way to catch the end of a paragraph execution in order to be able to trigger the next one?
Thanks,
Stéphane
--
Best Regards
Jeff Zhang
Re: End of completion for z.runParagraph
Posted by Jeff Zhang <zj...@gmail.com>.
Because each interpreter has its own scheduler. They are in different
schedulers. BTW, do you mind to share your note so that people can
understand your question easier ?
<st...@orange.com> 于2020年2月13日周四 下午6:02写道：
> Hello all,
>
>
>
> I’d like to trigger many paragraphs execution from an angular one. If I
> launch many spark ones, they are executed one after each other, but if I
> mix spark and angular ones, angular ones are triggered even if spark ones
> are not finished yet. I guess this comes from the asynchronous behavior of
> javascript. So, is there any way to catch the end of a paragraph execution
> in order to be able to trigger the next one?
>
>
>
> Thanks,
>
>
>
> Stéphane
>
--
Best Regards
Jeff Zhang
unsubscribe
Posted by "Batista, Mario (Nokia - PT/Amadora)" <ma...@nokia.com>.
"Management is doing things right; leadership is doing the right things."- Peter Drucker
Mário Batista
Service Owner
GS GSD CTO Deploy&PM PM NI FF AUT
Mobile:+351 93 997 2637
Upcoming absence:
-----Original Message-----
From: lee seiching <se...@gmail.com>
Sent: Friday, February 14, 2020 12:36 PM
To: users@zeppelin.apache.org
Subject: unsubscribe
<st...@orange.com> 於 2020年2月13日 週四 下午6:02寫道：
>
> Hello all,
>
>
>
> I’d like to trigger many paragraphs execution from an angular one. If I launch many spark ones, they are executed one after each other, but if I mix spark and angular ones, angular ones are triggered even if spark ones are not finished yet. I guess this comes from the asynchronous behavior of javascript. So, is there any way to catch the end of a paragraph execution in order to be able to trigger the next one?
>
>
>
> Thanks,
>
>
>
> Stéphane
unsubscribe
Posted by lee seiching <se...@gmail.com>.
<st...@orange.com> 於 2020年2月13日 週四 下午6:02寫道：
>
> Hello all,
>
>
>
> I’d like to trigger many paragraphs execution from an angular one. If I launch many spark ones, they are executed one after each other, but if I mix spark and angular ones, angular ones are triggered even if spark ones are not finished yet. I guess this comes from the asynchronous behavior of javascript. So, is there any way to catch the end of a paragraph execution in order to be able to trigger the next one?
>
>
>
> Thanks,
>
>
>
> Stéphane