[jira] [Created] (LIVY-806) Where does livy retreives spark job logs from?

["Shivam Kapoor (Jira)" <ji...@apache.org>]

Shivam Kapoor created LIVY-806:
----------------------------------

             Summary: Where does livy retreives spark job logs from?
                 Key: LIVY-806
                 URL: https://issues.apache.org/jira/browse/LIVY-806
             Project: Livy
          Issue Type: Question
            Reporter: Shivam Kapoor


We know that we can retrieve spark job logs via following livy rest api

 curl -X GET "http://localhost:8998/batches/1/log"

 

Excuse me if these question seem silly. But I am very new to this ecosystem, so kindly bear with me. I have following questions
 # This is a great option but where can I find these logs on the livy server or spark server for the purpose of debugging? I couldn't find any logs being written under _livy/logs_ or _spark/logs_. Neither does the document says much about the same. 
 # What happens to those logs when we delete the batch?
 # Would you mind guiding me anything about debugging jobs when livy is involved

Thanks. Would appreciate any response!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)