You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Spencer Ho (JIRA)" <ji...@apache.org> on 2009/11/20 01:32:39 UTC

[jira] Created: (MAPREDUCE-1224) Calling "SELECT t.* from AS t" to get meta information is too expensive for big tables
Calling "SELECT t.* from <table> AS t" to get meta information is too expensive for big tables
----------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1224
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1224
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/sqoop
    Affects Versions: 0.20.1
         Environment: all platforms, generic jdbc driver
            Reporter: Spencer Ho


The SqlManager uses the query, "SELECT t.* from <table> AS t" to get table spec is too expensive for big tables, and it was called twice to generate column names and types.  For tables that are big enough to be map-reduced, this is too expensive to make sqoop useful.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.