You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Trupti Dhavle (JIRA)" <ji...@apache.org> on 2016/05/26 17:09:13 UTC

[jira] [Updated] (FALCON-1986) logFile retrieved when getting process instance status should be a link that points to logs

     [ https://issues.apache.org/jira/browse/FALCON-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Trupti Dhavle updated FALCON-1986:
----------------------------------
    Description: 
We are noticing that the value for logFile paramter is no longer a link to the logs. Instead it is just a paramter that gives coordinatorname@<action#>. [~peeyushb] mentioned there were changes around rerun that caused this. However I think the paramter should point to a link that opens the logs for the said action (workflow) instead of just a value thats not even a link
Output from the command-

{noformat}
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Url: http://<falcon hsost>:15000/api/instance/status/process/A33ffd6c8-9faffb55/?colo=*&user.name=<user> (BaseRequest:175)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Method: GET (BaseRequest:176)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>@EXAMPLE.COM&t=kerberos&e=1464086384175&s=MtvIvDD9VCEzY46XWCCm7aidfAY=" (BaseRequest:179)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:207)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
2016-05-24 05:05:32,914 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ The web service response is:
{
  "status": "SUCCEEDED",
  "message": "default/STATUS\n",
  "requestId": "default/169893801@qtp-2139788441-269 - 46588c7f-5cb8-4d3f-b857-d8e75cc701e4\n",
  "instances": [
    {
      "instance": "2010-01-02T01:20Z",
      "status": "RUNNING",
      "logFile": "0001137-160524002538450-oozie-oozi-C@5",
      "cluster": "A33ffd6c8-9b45ca54",
      "startTime": "2016-05-24T05:05:26Z",
      "runId": 0,
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464049196692_0477/"
        }
      ]
    },

{noformat}

Prior releases it was returning as below-
{noformat}
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Url: http://<host>:15000/api/instance/status/process/A33ffd6c8-a013497d/?colo=*&user.name=<user> (BaseRequest:168)
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Method: GET (BaseRequest:169)
2016-05-24 00:47:53,330 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>&t=simple&e=1464076857535&s=Pq4pdhzr9EM1+HoEqvjsRTNZ9qg=" (BaseRequest:172)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:201)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:203)
2016-05-24 00:47:54,439 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ The web service response is:
{
    {
      "instance": "2010-01-02T01:05Z",
      "status": "RUNNING",
      "logFile": "http://<host>:11000/oozie?job\u003d0000604-160524223237302-oozie-oozi-W",
      "cluster": "A33ffd6c8-4482f810",
      "startTime": "2016-05-25T02:03:34Z",
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464116437313_0250/"
        }
      ]
    },
{noformat}

  was:
We are noticing that the value for logFile paramter is no longer a link to the logs. Instead it is just a paramter that gives coordinatorname@<action#>. [~peeyushb] mentioned there were changes around rerun that caused this. However I think the paramter should point to a link that opens the logs for the said action (workflow) instead of just a value thats not even a link
Output from the command-

{noformat}
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Url: http://<falcon hsost>:15000/api/instance/status/process/A33ffd6c8-9faffb55/?colo=*&user.name=<user> (BaseRequest:175)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Method: GET (BaseRequest:176)
2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>@EXAMPLE.COM&t=kerberos&e=1464086384175&s=MtvIvDD9VCEzY46XWCCm7aidfAY=" (BaseRequest:179)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:207)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
2016-05-24 05:05:32,914 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ The web service response is:
{
  "status": "SUCCEEDED",
  "message": "default/STATUS\n",
  "requestId": "default/169893801@qtp-2139788441-269 - 46588c7f-5cb8-4d3f-b857-d8e75cc701e4\n",
  "instances": [
    {
      "instance": "2010-01-02T01:20Z",
      "status": "RUNNING",
      "logFile": "0001137-160524002538450-oozie-oozi-C@5",
      "cluster": "A33ffd6c8-9b45ca54",
      "startTime": "2016-05-24T05:05:26Z",
      "runId": 0,
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464049196692_0477/"
        }
      ]
    },

{noformat}

Prior releases it was returning as below-
{noformat}
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Url: http://<host>:15000/api/instance/status/process/A33ffd6c8-a013497d/?colo=*&user.name=<user> (BaseRequest:168)
2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Method: GET (BaseRequest:169)
2016-05-24 00:47:53,330 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>&t=simple&e=1464076857535&s=Pq4pdhzr9EM1+HoEqvjsRTNZ9qg=" (BaseRequest:172)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:201)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:203)
2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:203)
2016-05-24 00:47:54,439 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ The web service response is:
{
    {
      "instance": "2010-01-02T01:05Z",
      "status": "RUNNING",
      "logFile": "http://os-r6-hnphvs-falcon-1-13.openstacklocal:11000/oozie?job\u003d0000604-160524223237302-oozie-oozi-W",
      "cluster": "A33ffd6c8-4482f810",
      "startTime": "2016-05-25T02:03:34Z",
      "details": "",
      "actions": [
        {
          "action": "aggregator",
          "status": "RUNNING",
          "logFile": "http://<host>:8088/proxy/application_1464116437313_0250/"
        }
      ]
    },
{noformat}


> logFile retrieved when getting process instance status should be a link that points to logs
> -------------------------------------------------------------------------------------------
>
>                 Key: FALCON-1986
>                 URL: https://issues.apache.org/jira/browse/FALCON-1986
>             Project: Falcon
>          Issue Type: Bug
>          Components: process
>    Affects Versions: 0.9
>            Reporter: Trupti Dhavle
>
> We are noticing that the value for logFile paramter is no longer a link to the logs. Instead it is just a paramter that gives coordinatorname@<action#>. [~peeyushb] mentioned there were changes around rerun that caused this. However I think the paramter should point to a link that opens the logs for the said action (workflow) instead of just a value thats not even a link
> Output from the command-
> {noformat}
> 2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Url: http://<falcon hsost>:15000/api/instance/status/process/A33ffd6c8-9faffb55/?colo=*&user.name=<user> (BaseRequest:175)
> 2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Method: GET (BaseRequest:176)
> 2016-05-24 05:05:32,474 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>@EXAMPLE.COM&t=kerberos&e=1464086384175&s=MtvIvDD9VCEzY46XWCCm7aidfAY=" (BaseRequest:179)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:207)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:209)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:209)
> 2016-05-24 05:05:32,913 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:209)
> 2016-05-24 05:05:32,914 INFO  - [pool-48-thread-1:testProcessInstanceStatusWoParams] ~ The web service response is:
> {
>   "status": "SUCCEEDED",
>   "message": "default/STATUS\n",
>   "requestId": "default/169893801@qtp-2139788441-269 - 46588c7f-5cb8-4d3f-b857-d8e75cc701e4\n",
>   "instances": [
>     {
>       "instance": "2010-01-02T01:20Z",
>       "status": "RUNNING",
>       "logFile": "0001137-160524002538450-oozie-oozi-C@5",
>       "cluster": "A33ffd6c8-9b45ca54",
>       "startTime": "2016-05-24T05:05:26Z",
>       "runId": 0,
>       "details": "",
>       "actions": [
>         {
>           "action": "aggregator",
>           "status": "RUNNING",
>           "logFile": "http://<host>:8088/proxy/application_1464049196692_0477/"
>         }
>       ]
>     },
> {noformat}
> Prior releases it was returning as below-
> {noformat}
> 2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Url: http://<host>:15000/api/instance/status/process/A33ffd6c8-a013497d/?colo=*&user.name=<user> (BaseRequest:168)
> 2016-05-24 00:47:53,329 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Method: GET (BaseRequest:169)
> 2016-05-24 00:47:53,330 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Request Header: Name=Cookie Value=hadoop.auth="u=<user>&p=<user>&t=simple&e=1464076857535&s=Pq4pdhzr9EM1+HoEqvjsRTNZ9qg=" (BaseRequest:172)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Status: HTTP/1.1 200 OK (BaseRequest:201)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Content-Type Value=application/json (BaseRequest:203)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Transfer-Encoding Value=chunked (BaseRequest:203)
> 2016-05-24 00:47:54,438 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ Response Header: Name=Server Value=Jetty(6.1.26.hwx) (BaseRequest:203)
> 2016-05-24 00:47:54,439 INFO  - [pool-41-thread-1:testProcessInstanceStatusWoParams] ~ The web service response is:
> {
>     {
>       "instance": "2010-01-02T01:05Z",
>       "status": "RUNNING",
>       "logFile": "http://<host>:11000/oozie?job\u003d0000604-160524223237302-oozie-oozi-W",
>       "cluster": "A33ffd6c8-4482f810",
>       "startTime": "2016-05-25T02:03:34Z",
>       "details": "",
>       "actions": [
>         {
>           "action": "aggregator",
>           "status": "RUNNING",
>           "logFile": "http://<host>:8088/proxy/application_1464116437313_0250/"
>         }
>       ]
>     },
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)