You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2011/04/21 22:31:19 UTC

[Hadoop Wiki] Update of "Hive/Tutorial" by StevenWong

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "Hive/Tutorial" page has been changed by StevenWong.
The comment on this change is: Remove unnecessary verbiage from an example dynamic-partition insert query..
http://wiki.apache.org/hadoop/Hive/Tutorial?action=diff&rev1=34&rev2=35

--------------------------------------------------

      hive> set hive.exec.dynamic.partition.mode=nonstrict;
      hive> FROM page_view_stg pvs
            INSERT OVERWRITE TABLE page_view PARTITION(dt, country) 
-                  SELECT * FROM (
-                    SELECT pvs.viewTime, pvs.userid, pvs.page_url, pvs.referrer_url, null, null, pvs.ip, 
+                  SELECT pvs.viewTime, pvs.userid, pvs.page_url, pvs.referrer_url, null, null, pvs.ip, 
-                           from_unixtimestamp(pvs.viewTime, 'yyyy-MM-dd') ds, pvs.country 
+                         from_unixtimestamp(pvs.viewTime, 'yyyy-MM-dd') ds, pvs.country 
-                    DISTRIBUTE BY ds, country
+                  DISTRIBUTE BY ds, country;
-                    ) T;
- }}} This query will generate a MapReduce job rather than Map-only job. The inner-most SELECT-clause will be converted to a plan to the mappers and the output will be distributed to the reducers based on the value of (ds, country) pairs. The INSERT-clause will be converted to the plan in the reducer which writes to the dynamic partitions. 
+ }}} This query will generate a MapReduce job rather than Map-only job. The SELECT-clause will be converted to a plan to the mappers and the output will be distributed to the reducers based on the value of (ds, country) pairs. The INSERT-clause will be converted to the plan in the reducer which writes to the dynamic partitions. 
  
  == Inserting into local files ==
  In certain situations you would want to write the output into a local file so that you could load it into an excel spreadsheet. This can be accomplished with the following command: