You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2009/12/11 19:54:18 UTC

[jira] Created: (HIVE-981) dump tracking url containing all jobs for the query

dump tracking url containing all jobs for the query
---------------------------------------------------

                 Key: HIVE-981
                 URL: https://issues.apache.org/jira/browse/HIVE-981
             Project: Hadoop Hive
          Issue Type: Improvement
          Components: Query Processor
            Reporter: Namit Jain
            Assignee: Paul Yang
             Fix For: 0.5.0


After https://issues.apache.org/jira/browse/HIVE-549, it is possible to run multiple map-reduce tasks in parallel for the same query.
It can become confusing for the user to track all the jobs running concurrently.
So, along with tracking url, it would be good to dump the query tracking url also, which will contain comma-separated names for all the urls.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HIVE-981) dump tracking url containing all jobs for the query

Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Paul Yang reassigned HIVE-981:
------------------------------

    Assignee: Ning Zhang  (was: Paul Yang)

> dump tracking url containing all jobs for the query
> ---------------------------------------------------
>
>                 Key: HIVE-981
>                 URL: https://issues.apache.org/jira/browse/HIVE-981
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Ning Zhang
>             Fix For: 0.5.0
>
>
> After https://issues.apache.org/jira/browse/HIVE-549, it is possible to run multiple map-reduce tasks in parallel for the same query.
> It can become confusing for the user to track all the jobs running concurrently.
> So, along with tracking url, it would be good to dump the query tracking url also, which will contain comma-separated names for all the urls.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HIVE-981) dump tracking url containing all jobs for the query

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang resolved HIVE-981.
-----------------------------

    Resolution: Won't Fix

not fixable in current architecture as stated in the previous comment. 

> dump tracking url containing all jobs for the query
> ---------------------------------------------------
>
>                 Key: HIVE-981
>                 URL: https://issues.apache.org/jira/browse/HIVE-981
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Ning Zhang
>             Fix For: 0.5.0
>
>
> After https://issues.apache.org/jira/browse/HIVE-549, it is possible to run multiple map-reduce tasks in parallel for the same query.
> It can become confusing for the user to track all the jobs running concurrently.
> So, along with tracking url, it would be good to dump the query tracking url also, which will contain comma-separated names for all the urls.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-981) dump tracking url containing all jobs for the query

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793437#action_12793437 ] 

Namit Jain commented on HIVE-981:
---------------------------------

It would be better to dump the url as it becomes available and keep appending more tasks to it.

> dump tracking url containing all jobs for the query
> ---------------------------------------------------
>
>                 Key: HIVE-981
>                 URL: https://issues.apache.org/jira/browse/HIVE-981
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Ning Zhang
>             Fix For: 0.5.0
>
>
> After https://issues.apache.org/jira/browse/HIVE-549, it is possible to run multiple map-reduce tasks in parallel for the same query.
> It can become confusing for the user to track all the jobs running concurrently.
> So, along with tracking url, it would be good to dump the query tracking url also, which will contain comma-separated names for all the urls.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-981) dump tracking url containing all jobs for the query

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793432#action_12793432 ] 

Ning Zhang commented on HIVE-981:
---------------------------------

I guess the tracking URL is available only after the task is started? If so should we dump the list of URLs at the end of the JOB? 

> dump tracking url containing all jobs for the query
> ---------------------------------------------------
>
>                 Key: HIVE-981
>                 URL: https://issues.apache.org/jira/browse/HIVE-981
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Ning Zhang
>             Fix For: 0.5.0
>
>
> After https://issues.apache.org/jira/browse/HIVE-549, it is possible to run multiple map-reduce tasks in parallel for the same query.
> It can become confusing for the user to track all the jobs running concurrently.
> So, along with tracking url, it would be good to dump the query tracking url also, which will contain comma-separated names for all the urls.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-981) dump tracking url containing all jobs for the query

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12795644#action_12795644 ] 

Ning Zhang commented on HIVE-981:
---------------------------------

This seems difficult if not impossible. The reason is that the tracking URL is generated in ExecDriver and the parallel tasks are generated in Driver. Driver calls ExecDriver by shell command line. So it is difficult to pass the URL back from ExecDriver to Driver.  

> dump tracking url containing all jobs for the query
> ---------------------------------------------------
>
>                 Key: HIVE-981
>                 URL: https://issues.apache.org/jira/browse/HIVE-981
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Ning Zhang
>             Fix For: 0.5.0
>
>
> After https://issues.apache.org/jira/browse/HIVE-549, it is possible to run multiple map-reduce tasks in parallel for the same query.
> It can become confusing for the user to track all the jobs running concurrently.
> So, along with tracking url, it would be good to dump the query tracking url also, which will contain comma-separated names for all the urls.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.