You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Lu Zhen <yi...@gmail.com> on 2014/02/14 03:17:55 UTC

Sqoop --hbase-bulkload does not work with --query?

Hi, All,

Really --hbase-bulkload does not work with --query?

sqoop-import --connect jdbc:mysql://$MYSQL_SERVER/$DATABASE --driver
com.mysql.jdbc.Driver --username $USER --password $PASSWORD
--hbase-table user --hbase-row-key id --column-family data --query
"SELECT  CONCAT_WS('-', SUBSTR(MD5(a.company_id), 1, 5),
DATE_FORMAT(a.date_added, '%Y%m%d'), a.id) as rowkey, a.* FROM user a
WHERE \$CONDITIONS" --split-by id --hbase-bulkload


14/02/14 10:09:46 ERROR sqoop.Sqoop: Got exception running Sqoop:
java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:405)
        at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:129)
        at
org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:236)
        at
org.apache.sqoop.mapreduce.HBaseBulkImportJob.jobTeardown(HBaseBulkImportJob.java:124)
        at
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:263)
        at
org.apache.sqoop.manager.SqlManager.importQuery(SqlManager.java:671)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:415)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:240)

-- 
thanks
hahakubile