You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by DuyHai Doan <do...@gmail.com> on 2016/07/06 14:19:57 UTC
Spark/Zeppelin/Cassandra talk
Hello Zeppelin fans
If you're living in the London area, I'll be giving a talk about using
Spark/Cassandra and Zeppelin to store, aggregate and visualize particle
accelerator metrics:
http://www.meetup.com/fr-FR/Spark-London/events/232355493/
Also if you know any event related to Zeppelin, please ping me so I can add
it to the community page here:
https://cwiki.apache.org/confluence/display/ZEPPELIN/Community
Regards
Duy Hai DOAN
Re: Spark/Zeppelin/Cassandra talk
Posted by Jongyoul Lee <jo...@gmail.com>.
I also can help you to expose metrics in production level. Make a JIRA
issue and let's talk about it.
On Fri, Jul 22, 2016 at 1:23 PM, Alexander Bezzubov <bz...@apache.org> wrote:
> Thanks for sharing the feedback, Duy Hai Doan!
>
> It could be great to have ZeppelinServer as well as all interpreters
> exposing their metrics with something like http://metrics.dropwizard.io
> and we could make default notebook after them periodically and visualize
> the results :)
>
> --
> Alex
>
>
> On Fri, Jul 22, 2016, 11:50 moon soo Lee <mo...@apache.org> wrote:
>
>> Cool.
>>
>> Exposing metrics through REST api and/or JMX sounds interesting!
>> And thanks for sharing slide and how the event was as well as feedbacks.
>>
>> moon
>>
>> On Fri, Jul 22, 2016 at 1:10 AM DuyHai Doan <do...@gmail.com> wrote:
>>
>>> Here are the slides for the talk last night at Spark London meetup :
>>> http://www.slideshare.net/doanduyhai/spark-zeppelincassandra-at-synchrotron-64253321
>>>
>>> There were > 80 people last night and a lot of question about Zeppelin.
>>>
>>> One recurrent remark about Zeppelin is that when running the server on a
>>> long run (several weeks) users are facing instability e.g. sometimes the
>>> server just hangs so they need to restart it.
>>>
>>> Possible improvements could be:
>>>
>>> 1) Expose REST API to return metrics about the state of ZeppelinServer
>>> and of each Interpreter
>>> 2) Expose JMX metrics about the state of ZeppelinServer and of each
>>> Interpreter. Although I prefer REST API, JMX is the de-facto standard for
>>> monitoring and there are a lot of existing monitoring tool that are
>>> designed for JMX
>>>
>>> When I have some bandwidth, I can push some PRs for those monitoring
>>> stuff
>>>
>>>
>>>
>>>
>>>
>>> On Wed, Jul 6, 2016 at 4:49 PM, moon soo Lee <mo...@apache.org> wrote:
>>>
>>>> Thanks for sharing great event.
>>>>
>>>>
>>>> On Wed, Jul 6, 2016 at 7:20 AM DuyHai Doan <do...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hello Zeppelin fans
>>>>>
>>>>> If you're living in the London area, I'll be giving a talk about
>>>>> using Spark/Cassandra and Zeppelin to store, aggregate and visualize
>>>>> particle accelerator metrics:
>>>>>
>>>>> http://www.meetup.com/fr-FR/Spark-London/events/232355493/
>>>>>
>>>>> Also if you know any event related to Zeppelin, please ping me so I
>>>>> can add it to the community page here:
>>>>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Community
>>>>>
>>>>> Regards
>>>>>
>>>>> Duy Hai DOAN
>>>>>
>>>>
>>>
--
이종열, Jongyoul Lee, 李宗烈
http://madeng.net
Re: Spark/Zeppelin/Cassandra talk
Posted by Alexander Bezzubov <bz...@apache.org>.
Thanks for sharing the feedback, Duy Hai Doan!
It could be great to have ZeppelinServer as well as all interpreters
exposing their metrics with something like http://metrics.dropwizard.io and
we could make default notebook after them periodically and visualize the
results :)
--
Alex
On Fri, Jul 22, 2016, 11:50 moon soo Lee <mo...@apache.org> wrote:
> Cool.
>
> Exposing metrics through REST api and/or JMX sounds interesting!
> And thanks for sharing slide and how the event was as well as feedbacks.
>
> moon
>
> On Fri, Jul 22, 2016 at 1:10 AM DuyHai Doan <do...@gmail.com> wrote:
>
>> Here are the slides for the talk last night at Spark London meetup :
>> http://www.slideshare.net/doanduyhai/spark-zeppelincassandra-at-synchrotron-64253321
>>
>> There were > 80 people last night and a lot of question about Zeppelin.
>>
>> One recurrent remark about Zeppelin is that when running the server on a
>> long run (several weeks) users are facing instability e.g. sometimes the
>> server just hangs so they need to restart it.
>>
>> Possible improvements could be:
>>
>> 1) Expose REST API to return metrics about the state of ZeppelinServer
>> and of each Interpreter
>> 2) Expose JMX metrics about the state of ZeppelinServer and of each
>> Interpreter. Although I prefer REST API, JMX is the de-facto standard for
>> monitoring and there are a lot of existing monitoring tool that are
>> designed for JMX
>>
>> When I have some bandwidth, I can push some PRs for those monitoring stuff
>>
>>
>>
>>
>>
>> On Wed, Jul 6, 2016 at 4:49 PM, moon soo Lee <mo...@apache.org> wrote:
>>
>>> Thanks for sharing great event.
>>>
>>>
>>> On Wed, Jul 6, 2016 at 7:20 AM DuyHai Doan <do...@gmail.com> wrote:
>>>
>>>> Hello Zeppelin fans
>>>>
>>>> If you're living in the London area, I'll be giving a talk about using
>>>> Spark/Cassandra and Zeppelin to store, aggregate and visualize particle
>>>> accelerator metrics:
>>>>
>>>> http://www.meetup.com/fr-FR/Spark-London/events/232355493/
>>>>
>>>> Also if you know any event related to Zeppelin, please ping me so I can
>>>> add it to the community page here:
>>>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Community
>>>>
>>>> Regards
>>>>
>>>> Duy Hai DOAN
>>>>
>>>
>>
Re: Spark/Zeppelin/Cassandra talk
Posted by moon soo Lee <mo...@apache.org>.
Cool.
Exposing metrics through REST api and/or JMX sounds interesting!
And thanks for sharing slide and how the event was as well as feedbacks.
moon
On Fri, Jul 22, 2016 at 1:10 AM DuyHai Doan <do...@gmail.com> wrote:
> Here are the slides for the talk last night at Spark London meetup :
> http://www.slideshare.net/doanduyhai/spark-zeppelincassandra-at-synchrotron-64253321
>
> There were > 80 people last night and a lot of question about Zeppelin.
>
> One recurrent remark about Zeppelin is that when running the server on a
> long run (several weeks) users are facing instability e.g. sometimes the
> server just hangs so they need to restart it.
>
> Possible improvements could be:
>
> 1) Expose REST API to return metrics about the state of ZeppelinServer and
> of each Interpreter
> 2) Expose JMX metrics about the state of ZeppelinServer and of each
> Interpreter. Although I prefer REST API, JMX is the de-facto standard for
> monitoring and there are a lot of existing monitoring tool that are
> designed for JMX
>
> When I have some bandwidth, I can push some PRs for those monitoring stuff
>
>
>
>
>
> On Wed, Jul 6, 2016 at 4:49 PM, moon soo Lee <mo...@apache.org> wrote:
>
>> Thanks for sharing great event.
>>
>>
>> On Wed, Jul 6, 2016 at 7:20 AM DuyHai Doan <do...@gmail.com> wrote:
>>
>>> Hello Zeppelin fans
>>>
>>> If you're living in the London area, I'll be giving a talk about using
>>> Spark/Cassandra and Zeppelin to store, aggregate and visualize particle
>>> accelerator metrics:
>>>
>>> http://www.meetup.com/fr-FR/Spark-London/events/232355493/
>>>
>>> Also if you know any event related to Zeppelin, please ping me so I can
>>> add it to the community page here:
>>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Community
>>>
>>> Regards
>>>
>>> Duy Hai DOAN
>>>
>>
>
Re: Spark/Zeppelin/Cassandra talk
Posted by DuyHai Doan <do...@gmail.com>.
Here are the slides for the talk last night at Spark London meetup :
http://www.slideshare.net/doanduyhai/spark-zeppelincassandra-at-synchrotron-64253321
There were > 80 people last night and a lot of question about Zeppelin.
One recurrent remark about Zeppelin is that when running the server on a
long run (several weeks) users are facing instability e.g. sometimes the
server just hangs so they need to restart it.
Possible improvements could be:
1) Expose REST API to return metrics about the state of ZeppelinServer and
of each Interpreter
2) Expose JMX metrics about the state of ZeppelinServer and of each
Interpreter. Although I prefer REST API, JMX is the de-facto standard for
monitoring and there are a lot of existing monitoring tool that are
designed for JMX
When I have some bandwidth, I can push some PRs for those monitoring stuff
On Wed, Jul 6, 2016 at 4:49 PM, moon soo Lee <mo...@apache.org> wrote:
> Thanks for sharing great event.
>
>
> On Wed, Jul 6, 2016 at 7:20 AM DuyHai Doan <do...@gmail.com> wrote:
>
>> Hello Zeppelin fans
>>
>> If you're living in the London area, I'll be giving a talk about using
>> Spark/Cassandra and Zeppelin to store, aggregate and visualize particle
>> accelerator metrics:
>>
>> http://www.meetup.com/fr-FR/Spark-London/events/232355493/
>>
>> Also if you know any event related to Zeppelin, please ping me so I can
>> add it to the community page here:
>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Community
>>
>> Regards
>>
>> Duy Hai DOAN
>>
>
Re: Spark/Zeppelin/Cassandra talk
Posted by moon soo Lee <mo...@apache.org>.
Thanks for sharing great event.
On Wed, Jul 6, 2016 at 7:20 AM DuyHai Doan <do...@gmail.com> wrote:
> Hello Zeppelin fans
>
> If you're living in the London area, I'll be giving a talk about using
> Spark/Cassandra and Zeppelin to store, aggregate and visualize particle
> accelerator metrics:
>
> http://www.meetup.com/fr-FR/Spark-London/events/232355493/
>
> Also if you know any event related to Zeppelin, please ping me so I can
> add it to the community page here:
> https://cwiki.apache.org/confluence/display/ZEPPELIN/Community
>
> Regards
>
> Duy Hai DOAN
>