You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "He Yongqiang (JIRA)" <ji...@apache.org> on 2009/05/12 07:21:45 UTC
[jira] Created: (HIVE-479) Change RCFileOutputFormat's generic
signatute to be
Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
----------------------------------------------------------------------------
Key: HIVE-479
URL: https://issues.apache.org/jira/browse/HIVE-479
Project: Hadoop Hive
Issue Type: Improvement
Reporter: He Yongqiang
In one test for hive-477, i found that the below command can not sucessfully pass:
{noformat}
$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
{noformat}
It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-479) Change RCFileOutputFormat's generic
signatute to be
Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Thusoo reassigned HIVE-479:
----------------------------------
Assignee: He Yongqiang
> Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
> ----------------------------------------------------------------------------
>
> Key: HIVE-479
> URL: https://issues.apache.org/jira/browse/HIVE-479
> Project: Hadoop Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: hive-479-2009-5-12.patch
>
>
> In one test for hive-477, i found that the below command can not sucessfully pass:
> $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
> It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-479) Change RCFileOutputFormat's generic
signatute to be
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-479:
------------------------------
Description:
In one test for hive-477, i found that the below command can not sucessfully pass:
$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
was:
In one test for hive-477, i found that the below command can not sucessfully pass:
{noformat}
$HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
{noformat}
It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
> Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
> ----------------------------------------------------------------------------
>
> Key: HIVE-479
> URL: https://issues.apache.org/jira/browse/HIVE-479
> Project: Hadoop Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
>
> In one test for hive-477, i found that the below command can not sucessfully pass:
> $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
> It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-479) Change RCFileOutputFormat's generic
signatute to be
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-479:
------------------------------
Status: Patch Available (was: Open)
> Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
> ----------------------------------------------------------------------------
>
> Key: HIVE-479
> URL: https://issues.apache.org/jira/browse/HIVE-479
> Project: Hadoop Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
> Attachments: hive-479-2009-5-12.patch
>
>
> In one test for hive-477, i found that the below command can not sucessfully pass:
> $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
> It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-479) Change RCFileOutputFormat's generic
signatute to be
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-479:
------------------------------
Attachment: hive-479-2009-5-12.patch
> Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
> ----------------------------------------------------------------------------
>
> Key: HIVE-479
> URL: https://issues.apache.org/jira/browse/HIVE-479
> Project: Hadoop Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
> Attachments: hive-479-2009-5-12.patch
>
>
> In one test for hive-477, i found that the below command can not sucessfully pass:
> $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
> It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-479) Change RCFileOutputFormat's generic
signatute to be
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao updated HIVE-479:
----------------------------
Resolution: Fixed
Fix Version/s: 0.4.0
Release Note: HIVE-479. Change RCFileOutputFormat's generic signatute. (Yongqiang He via zshao)
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed. Thanks Yongqiang.
> Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
> ----------------------------------------------------------------------------
>
> Key: HIVE-479
> URL: https://issues.apache.org/jira/browse/HIVE-479
> Project: Hadoop Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.4.0
>
> Attachments: hive-479-2009-5-12.patch
>
>
> In one test for hive-477, i found that the below command can not sucessfully pass:
> $HADOOP_HOME/bin/hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=. -jobconf hive.io.rcfile.column.number.conf=32 -jobconf mapred.output.compress=true -numReduceTasks 0
> It is caused by the assumption that RCFileOutputFormat thinks the key's class of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.