You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ashish Thusoo (JIRA)" <ji...@apache.org> on 2010/05/17 21:16:42 UTC
[jira] Created: (HIVE-1347) Create Pre Task hooks for Hive
Create Pre Task hooks for Hive
------------------------------
Key: HIVE-1347
URL: https://issues.apache.org/jira/browse/HIVE-1347
Project: Hadoop Hive
Issue Type: New Feature
Components: Query Processor
Reporter: Ashish Thusoo
Assignee: Ashish Thusoo
Create pre task hooks for hive which can modify configuration parameters or task plans. This is very useful for implementing a number of different execution policies such as
1. Sending jobs that work on small data sets to a different cluster.
2. Sending jobs that work on archived data sets to a different cluster.
etc.
More details on the actual interfaces will follow soon.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1347) Create Pre Task hooks for Hive
Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Thusoo updated HIVE-1347:
--------------------------------
Attachment: HIVE-1347.patch
A prelimnary patch for this. Take a look at the PreTask.java interface to look at the hook interface.
> Create Pre Task hooks for Hive
> ------------------------------
>
> Key: HIVE-1347
> URL: https://issues.apache.org/jira/browse/HIVE-1347
> Project: Hadoop Hive
> Issue Type: New Feature
> Components: Query Processor
> Reporter: Ashish Thusoo
> Assignee: Ashish Thusoo
> Attachments: HIVE-1347.patch
>
>
> Create pre task hooks for hive which can modify configuration parameters or task plans. This is very useful for implementing a number of different execution policies such as
> 1. Sending jobs that work on small data sets to a different cluster.
> 2. Sending jobs that work on archived data sets to a different cluster.
> etc.
> More details on the actual interfaces will follow soon.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1347) Create Pre Task hooks for Hive
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868795#action_12868795 ]
Namit Jain commented on HIVE-1347:
----------------------------------
TaskRunner contains the SessionState which contains the HiveConf, from where the user info is obtained.
Since TaskRunner is being passed to the interface, you dont need to pass the user info explicitly
> Create Pre Task hooks for Hive
> ------------------------------
>
> Key: HIVE-1347
> URL: https://issues.apache.org/jira/browse/HIVE-1347
> Project: Hadoop Hive
> Issue Type: New Feature
> Components: Query Processor
> Reporter: Ashish Thusoo
> Assignee: Ashish Thusoo
> Attachments: HIVE-1347.patch
>
>
> Create pre task hooks for hive which can modify configuration parameters or task plans. This is very useful for implementing a number of different execution policies such as
> 1. Sending jobs that work on small data sets to a different cluster.
> 2. Sending jobs that work on archived data sets to a different cluster.
> etc.
> More details on the actual interfaces will follow soon.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.