You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org> on 2008/09/16 09:25:44 UTC

[jira] Created: (HADOOP-4183) select * to console issues in Hive

select * to console issues in Hive
----------------------------------

                 Key: HADOOP-4183
                 URL: https://issues.apache.org/jira/browse/HADOOP-4183
             Project: Hadoop Core
          Issue Type: Bug
          Components: contrib/hive
            Reporter: Joydeep Sen Sarma


the biggest problem is that select * is assuming that the output is a regular text file. it can't read out from compressed text files. (which is what happens when we start using the output compression options).

the core issue is that select * is special code. and it should not be. it should go through the same 'fileinputformat' and serde code that any map-side task goes through.

the second issue is that a select * without any data transformations/filters goes through a map-reduce task unnecessarily. we need to fix this. this seems related to the limit N jira that ashish opened. (see hadoop-4086)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (HADOOP-4183) select * to console issues in Hive

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/HADOOP-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain resolved HADOOP-4183.
--------------------------------

       Resolution: Fixed
    Fix Version/s: 0.19.0

fixed as part of JIRA-4230

> select * to console issues in Hive
> ----------------------------------
>
>                 Key: HADOOP-4183
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4183
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hive
>            Reporter: Joydeep Sen Sarma
>             Fix For: 0.19.0
>
>
> the biggest problem is that select * is assuming that the output is a regular text file. it can't read out from compressed text files. (which is what happens when we start using the output compression options).
> the core issue is that select * is special code. and it should not be. it should go through the same 'fileinputformat' and serde code that any map-side task goes through.
> the second issue is that a select * without any data transformations/filters goes through a map-reduce task unnecessarily. we need to fix this. this seems related to the limit N jira that ashish opened. (see hadoop-4086)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.