You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@livy.apache.org by Praveen Muthusamy <pr...@gmail.com> on 2018/05/03 13:20:25 UTC
Globally Unique/ User defined session Ids
Hi,
Is there support for sessionId to be GUID for batch usecase ? or can the
sessionId be made to be user-defined.
This will be useful for uniquely identifying sessions across restarts or
crashes. We are maintaining client side mappings to session Id and restart
/ HA scenarios will make this session Id irrelevant.
Found this Jira ticket https://issues.cloudera.org/browse/LIVY-367 , but no
further comments on it.
It would be good if there is an option to assign GUID for a session,
similar to Yarn AppId, which will be unique for certain extent.
Please suggest what is the best way to maintain sessionIds across restarts
or HA scenarios ?
Regards,
Praveen M
Re: Globally Unique/ User defined session Ids
Posted by Saisai Shao <sa...@gmail.com>.
I think we already supported single node HA for Livy by using incremented
session id? Can you please elaborate your scenario and advantages of using
GUID?
Thanks
Jerry
Alex Bozarth <aj...@us.ibm.com> 于2018年5月4日周五 上午4:13写道：
> This sounds similar to a previous email chain from a few months ago. I
> think your answer may be in there.
> https://lists.apache.org/thread.html/36c67f57fd3b1fcc9f99c8f894b23618703c1141b32f1dd2a6f7f183@%3Cuser.livy.apache.org%3E
>
>
> *Alex Bozarth*
> Software Engineer
> Center for Open-Source Data & AI Technologies
> ------------------------------
> *E-mail:* *ajbozart@us.ibm.com* <aj...@us.ibm.com>
> *GitHub: **github.com/ajbozarth* <https://github.com/ajbozarth>
>
>
> 505 Howard Street
> San Francisco, CA 94105
> United States
>
>
>
> [image: Inactive hide details for Praveen Muthusamy ---05/03/2018 06:21:00
> AM---Hi, Is there support for sessionId to be GUID for batch]Praveen
> Muthusamy ---05/03/2018 06:21:00 AM---Hi, Is there support for sessionId to
> be GUID for batch usecase ? or can the
>
> From: Praveen Muthusamy <pr...@gmail.com>
> To: user@livy.incubator.apache.org
> Date: 05/03/2018 06:21 AM
> Subject: Globally Unique/ User defined session Ids
> ------------------------------
>
>
>
> Hi,
>
> Is there support for sessionId to be GUID for batch usecase ? or can the
> sessionId be made to be user-defined.
>
> This will be useful for uniquely identifying sessions across restarts or
> crashes. We are maintaining client side mappings to session Id and restart
> / HA scenarios will make this session Id irrelevant.
>
> Found this Jira ticket *https://issues.cloudera.org/browse/LIVY-367*
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.cloudera.org_browse_LIVY-2D367&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=S1_S7Dymu4ZL6g7L21O78VQZ53vEnAyZ-cx37DPYDyo&m=Onn0e4C-5gH0jWfUH1XG46L-pvZJyMDBxSVS5WclJco&s=wuMUW6eBerWR8krUF4LSe8fnvBEeXOhbceSkcczasyk&e=>
> , but no further comments on it.
>
> It would be good if there is an option to assign GUID for a session,
> similar to Yarn AppId, which will be unique for certain extent.
>
> Please suggest what is the best way to maintain sessionIds across restarts
> or HA scenarios ?
>
> Regards,
> Praveen M
>
>
>
>
Re: Globally Unique/ User defined session Ids
Posted by Alex Bozarth <aj...@us.ibm.com>.
This sounds similar to a previous email chain from a few months ago. I
think your answer may be in there.
https://lists.apache.org/thread.html/36c67f57fd3b1fcc9f99c8f894b23618703c1141b32f1dd2a6f7f183@%3Cuser.livy.apache.org%3E
Alex Bozarth
Software Engineer
Center for Open-Source Data & AI Technologies
E-mail: ajbozart@us.ibm.com
GitHub: github.com/ajbozarth
505 Howard Street
San Francisco, CA 94105
United States
From: Praveen Muthusamy <pr...@gmail.com>
To: user@livy.incubator.apache.org
Date: 05/03/2018 06:21 AM
Subject: Globally Unique/ User defined session Ids
Hi,
Is there support for sessionId to be GUID for batch usecase ? or can the
sessionId be made to be user-defined.
This will be useful for uniquely identifying sessions across restarts or
crashes. We are maintaining client side mappings to session Id and
restart / HA scenarios will make this session Id irrelevant.
Found this Jira ticket https://issues.cloudera.org/browse/LIVY-367 , but no
further comments on it.
It would be good if there is an option to assign GUID for a session,
similar to Yarn AppId, which will be unique for certain extent.
Please suggest what is the best way to maintain sessionIds across restarts
or HA scenarios ?
Regards,
Praveen M