You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Adam Kramer (JIRA)" <ji...@apache.org> on 2009/01/28 03:11:02 UTC

[jira] Created: (HIVE-254) Tracker page should provide a link to the "next step"

Tracker page should provide a link to the "next step"
-----------------------------------------------------

                 Key: HIVE-254
                 URL: https://issues.apache.org/jira/browse/HIVE-254
             Project: Hadoop Hive
          Issue Type: Wish
          Components: Web UI
            Reporter: Adam Kramer


This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701960#action_12701960 ] 

Edward Capriolo commented on HIVE-254:
--------------------------------------

Ashish,

The test cases are running in local mode, as a result the running job produces no TASK_HADOOP_ID and there is nothing to link to. So in local mode I do not think I can produce a test case for the function.

{noformat}
09/04/22 19:56:38 INFO exec.ExecDriver: Job running in-process (local Hadoop)
09/04/22 19:56:38 INFO mapred.FileInputFormat: Total input paths to process : 1
{noformat}


> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>         Attachments: click_through.png, hive-254.diff
>
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699516#action_12699516 ] 

Edward Capriolo commented on HIVE-254:
--------------------------------------

The hive history page has been added. I can make the page hyperlink to the job tracker.

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashish Thusoo updated HIVE-254:
-------------------------------

       Resolution: Fixed
    Fix Version/s: 0.4.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

committed. Thanks Edward!!

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>             Fix For: 0.4.0
>
>         Attachments: click_through.png, hive-254.diff
>
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12702861#action_12702861 ] 

Ashish Thusoo commented on HIVE-254:
------------------------------------

I suppose we can add a test case for this once the MiniMR cluster work that is being done by Namit gets done as then you would get the TASK_HADOOP_ID. Can you open a JIRA for the tests that depends on

https://issues.apache.org/jira/browse/HIVE-204

Otherwise, 

+1 from my side. Will run the tests and commit once the test runs are good.


> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>         Attachments: click_through.png, hive-254.diff
>
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo updated HIVE-254:
---------------------------------

    Status: Patch Available  (was: Open)

This patch allows hot links from the history page to the hadoop job tracker. I also corrected the hive-default which was loaded the war from hive.war hive-hwi.war.

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo updated HIVE-254:
---------------------------------

    Attachment: click_through.png

screen shot of session_history. Notice how any task with the key TASK_HADOOP_ID is supplemented with a hyperlink to the Hadoop Job Tracker.

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>         Attachments: click_through.png, hive-254.diff
>
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701764#action_12701764 ] 

Ashish Thusoo commented on HIVE-254:
------------------------------------

Adam,

I don't think that this will get into hadoop core as they probably don't want to put in hive specific code into hadoop. Having said that Edwards fix does solve this in the Hive web interface..

Edward, 

Changes look good. Is it possible to add a test case to test the new function.

Thanks,
Ashish

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>         Attachments: click_through.png, hive-254.diff
>
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo reassigned HIVE-254:
------------------------------------

    Assignee: Edward Capriolo

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-254) Tracker page should provide a link to the "next step"

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Edward Capriolo updated HIVE-254:
---------------------------------

    Attachment: hive-254.diff

Fixed conf. Added a link from hive-history to job-tracker.

> Tracker page should provide a link to the "next step"
> -----------------------------------------------------
>
>                 Key: HIVE-254
>                 URL: https://issues.apache.org/jira/browse/HIVE-254
>             Project: Hadoop Hive
>          Issue Type: Wish
>          Components: Web UI
>            Reporter: Adam Kramer
>            Assignee: Edward Capriolo
>         Attachments: hive-254.diff
>
>
> This may belong in Hadoop Core, or maybe more about Hive integration with Hadoop, but many queries these days take multiple steps or mapreduce phases. It would be lovely if a "finished" mapreduce from a Hive query that has several steps could provide a link to the tracker page for the next mapreduce step.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.