You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "John Sichi (JIRA)" <ji...@apache.org> on 2010/08/18 22:31:21 UTC
[jira] Issue Comment Edited: (HIVE-1523) ql tests no longer work in
miniMR mode
[ https://issues.apache.org/jira/browse/HIVE-1523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900018#action_12900018 ]
John Sichi edited comment on HIVE-1523 at 8/18/10 4:30 PM:
-----------------------------------------------------------
+1. Last time I talked to Ning about this, my take was that we should be able to re-run any subset of tests in either mode (without needing test codegen for it), but for now we can just get things working again this way.
Some candidates for existing tests to add in to the minimr suite:
jsichi-mac:clientpositive jsichi$ grep reducer *.q
bucket1.q:set hive.exec.reducers.max = 200;
bucket2.q:set hive.exec.reducers.max = 1;
bucket3.q:set hive.exec.reducers.max = 1;
bucket4.q:set hive.exec.reducers.max = 1;
bucketmapjoin6.q:set hive.exec.reducers.max=1;
disable_merge_for_bucketing.q:set hive.exec.reducers.max = 1;
reduce_deduplicate.q:set hive.exec.reducers.max = 1;
sample10.q:set hive.exec.reducers.max=4;
smb_mapjoin_6.q:set hive.exec.reducers.max = 1;
smb_mapjoin_7.q:set hive.exec.reducers.max = 1;
smb_mapjoin_8.q:set hive.exec.reducers.max = 1;
smb_mapjoin_8.q:set hive.exec.reducers.max = 1;
udaf_percentile_approx.q:set hive.exec.reducers.max=4
was (Author: jvs):
+1. Last time I talked to Ning about this, my take was that we should be able to re-run any subset of tests in either mode (without needing test codegen for it), but for now we can just get things working again this way.
Some candidates for existing tests to adding to the minimr suite:
jsichi-mac:clientpositive jsichi$ grep reducer *.q
bucket1.q:set hive.exec.reducers.max = 200;
bucket2.q:set hive.exec.reducers.max = 1;
bucket3.q:set hive.exec.reducers.max = 1;
bucket4.q:set hive.exec.reducers.max = 1;
bucketmapjoin6.q:set hive.exec.reducers.max=1;
disable_merge_for_bucketing.q:set hive.exec.reducers.max = 1;
reduce_deduplicate.q:set hive.exec.reducers.max = 1;
sample10.q:set hive.exec.reducers.max=4;
smb_mapjoin_6.q:set hive.exec.reducers.max = 1;
smb_mapjoin_7.q:set hive.exec.reducers.max = 1;
smb_mapjoin_8.q:set hive.exec.reducers.max = 1;
smb_mapjoin_8.q:set hive.exec.reducers.max = 1;
udaf_percentile_approx.q:set hive.exec.reducers.max=4
> ql tests no longer work in miniMR mode
> --------------------------------------
>
> Key: HIVE-1523
> URL: https://issues.apache.org/jira/browse/HIVE-1523
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Attachments: hive-1523.1.patch
>
>
> as per title. here's the first exception i see:
> 2010-08-09 18:05:11,259 ERROR hive.log (MetaStoreUtils.java:logAndThrowMetaException(743)) - Got exception: java.io.FileNotFoun\
> dException File file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> 2010-08-09 18:05:11,259 ERROR hive.log (MetaStoreUtils.java:logAndThrowMetaException(746)) - java.io.FileNotFoundException: Fil\
> e file:/build/ql/test/data/warehouse/dest_j1 does not exist.
> at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
> at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
> at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:136)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:677)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.