You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "MUFEED USMAN (JIRA)" <ji...@apache.org> on 2014/11/08 04:51:34 UTC
[jira] [Commented] (SQOOP-1289) Sqoop hbase-bulkload does not work
with composite key
[ https://issues.apache.org/jira/browse/SQOOP-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203198#comment-14203198 ]
MUFEED USMAN commented on SQOOP-1289:
-------------------------------------
I'm hitting the same without --hbase-bulkload option.
{code}
sqoop import -D mapred.child.java.opts='\-Djava.security.egd=file:/dev/../dev/urandom' \
--connect jdbc:oracle:thin:@ec2-54-170-201-103.eu-west-1.compute.amazonaws.com/mapr \
--username mapr -password xxxxxxxxx \
--query "SELECT * FROM hivetest WHERE id <=5 AND \$CONDITIONS" \
--split-by id \
--hbase-table '/tmp/t1' --column-family cf1
14/11/08 08:56:32 INFO mapred.JobClient: Task Id : attempt_201410291041_0004_m_000000_0, Status : FAILED on node mu-node-66
java.io.IOException: Could not insert row with null value for row-key column: id
at org.apache.sqoop.hbase.ToStringPutTransformer.getPutCommand(ToStringPutTransformer.java:146)
at org.apache.sqoop.hbase.HBasePutProcessor.accept(HBasePutProcessor.java:148)
at org.apache.sqoop.mapreduce.DelegatingOutputFormat$DelegatingRecordWriter.write(DelegatingOutputFormat.java:128)
at org.apache.sqoop.mapreduce.DelegatingOutputFormat$DelegatingRecordWriter.write(DelegatingOutputFormat.java:92)
at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:565)
at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
at org.apache.sqoop.mapreduce.HBaseImportMapper.map(HBaseImportMapper.java:38)
at org.apache.sqoop.mapreduce.HBaseImportMapper.map(HBaseImportMapper.java:31)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:681)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
{code}
> Sqoop hbase-bulkload does not work with composite key
> -----------------------------------------------------
>
> Key: SQOOP-1289
> URL: https://issues.apache.org/jira/browse/SQOOP-1289
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.5
> Reporter: hahakubile
> Labels: hbase-bulkload
> Fix For: 1.4.6
>
>
> when executing command below:
> ./sqoop import --connect jdbc:mysql://$MYSQL_SERVER/$DATABASE --driver com.mysql.jdbc.Driver --username $USER --password $PASSWORD --table $TABLE --hbase-table $HBASE_TABLE --column-family f --hbase-row-key id,proid --hbase-bulkload
>
> java.io.IOException: Could not insert row with null value for row-key column: id,proid
> at org.apache.sqoop.hbase.ToStringPutTransformer.getPutCommand(ToStringPutTransformer.java:146)
> at org.apache.sqoop.mapreduce.HBaseBulkImportMapper.map(HBaseBulkImportMapper.java:86)
> at org.apache.sqoop.mapreduce.HBaseBulkImportMapper.map(HBaseBulkImportMapper.java:44)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:648)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1278)
> at org.apache.hadoop.mapred.Child.main(Child.java:260)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)