You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@livy.apache.org by "jianzhenwu (via GitHub)" <gi...@apache.org> on 2023/03/06 02:23:16 UTC

[GitHub] [incubator-livy] jianzhenwu opened a new pull request, #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

jianzhenwu opened a new pull request, #390:
URL: https://github.com/apache/incubator-livy/pull/390

   … to Livy thrift server.
   
   ## What changes were proposed in this pull request?
   
   (Please fill in changes proposed in this fix)
   Add `DescLivySessionOperation` to support fetching sessionId, applicationId, sessionState, sessionLogs from Livy thrift service.
   Solve the bug that the thrift api gets stuck when creating an interactive session fails.
   
   (Include a link to the associated JIRA and make sure to add a link to this pr on the JIRA as well)
   https://issues.apache.org/jira/browse/LIVY-971
   
   ## How was this patch tested?
   
   (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
   (If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
   integration tests
   
   Please review https://livy.incubator.apache.org/community/ before opening a pull request.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-livy] jianzhenwu closed pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

Posted by "jianzhenwu (via GitHub)" <gi...@apache.org>.
jianzhenwu closed pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.
URL: https://github.com/apache/incubator-livy/pull/390


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-livy] mgaido91 commented on pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

Posted by "mgaido91 (via GitHub)" <gi...@apache.org>.
mgaido91 commented on PR #390:
URL: https://github.com/apache/incubator-livy/pull/390#issuecomment-1453446638

   I think this information is available on the Livy web application. I do not know any SQL engine that allows for a similar command, and we try to follow SQL standard. I think we should use the web app for monitoring the status, so if there is something missing there, I would recommend improving that rather than adding a new (unusual) SQL command.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-livy] jianzhenwu commented on pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

Posted by "jianzhenwu (via GitHub)" <gi...@apache.org>.
jianzhenwu commented on PR #390:
URL: https://github.com/apache/incubator-livy/pull/390#issuecomment-1455332530

   > I think this information is available on the Livy web application. I do not know any SQL engine that allows for a similar command, and we try to follow SQL standard. I think we should use the web app for monitoring the status, so if there is something missing there, I would recommend improving that rather than adding a new (unusual) SQL command.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-livy] mgaido91 commented on pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

Posted by "mgaido91 (via GitHub)" <gi...@apache.org>.
mgaido91 commented on PR #390:
URL: https://github.com/apache/incubator-livy/pull/390#issuecomment-1479901961

   I think in general also in Spark the SQL interface is kept as conform as possible to the ANSI SQL standard and monitoring information is provided through the web API. If there are similar commands in other SQL engines, we can maybe do something similar. But I'd avoid creating something specific to Livy that nobody expects so nobody uses.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-livy] jianzhenwu commented on pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

Posted by "jianzhenwu (via GitHub)" <gi...@apache.org>.
jianzhenwu commented on PR #390:
URL: https://github.com/apache/incubator-livy/pull/390#issuecomment-1455334640

   hi @mgaido91 thanks for your response. I think this feature has the following two usage scenarios. 
   1. When other platforms use JDBC to integrate with Livy, they need to save the session ID and application ID.
   2. When the connection creation fails, it may be that the spark session failed to start. At this time, they need to check the reason why the spark session failed to start.
   What do you think?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-livy] jianzhenwu commented on pull request #390: [LIVY-971] Support to get session variables when using JDBC to connect to Livy thrift server.

Posted by "jianzhenwu (via GitHub)" <gi...@apache.org>.
jianzhenwu commented on PR #390:
URL: https://github.com/apache/incubator-livy/pull/390#issuecomment-1480491947

   I agree with your points. Thank you for sharing your insights.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@livy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org