You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Andrejs Dubovskis (JIRA)" <ji...@apache.org> on 2014/09/22 17:34:34 UTC
[jira] [Updated] (SQOOP-1538) export using hcatalog using update
mode
[ https://issues.apache.org/jira/browse/SQOOP-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrejs Dubovskis updated SQOOP-1538:
-------------------------------------
Description:
Hi!
When executing sqoop export using HCatalog as source I got error in update mode. The same call with no HCatalog (point directly to HDFS path) runs with no problem.
sqoop parameters
{code}
sqoop export --update-key registrationDate,productionId --update-mode allowinsert --table stat_open_cases_daily --hcatalog-database exports --hcatalog-table open_cases_daily --columns casecount,productionid,registrationdate --batch --outdir /tmp
{code}
Exception
{code}
ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerExceptionjava.lang.NullPointerException
at org.apache.sqoop.mapreduce.ExportJobBase.getFileType(ExportJobBase.java:112)
at org.apache.sqoop.mapreduce.ExportJobBase.isSequenceFiles(ExportJobBase.java:103)
at org.apache.sqoop.mapreduce.ExportJobBase.inputIsSequenceFiles(ExportJobBase.java:465)
at org.apache.sqoop.mapreduce.JdbcUpdateExportJob.getMapperClass(JdbcUpdateExportJob.java:69)
at org.apache.sqoop.mapreduce.ExportJobBase.configureMapper(ExportJobBase.java:250)
at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:399)
at org.apache.sqoop.manager.MySQLManager.upsertTable(MySQLManager.java:136)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:74)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231)
at org.apache.sqoop.Sqoop.main(Sqoop.java:240)
{code}
was:
Hi!
When executing sqoop export using HCatalog as source I got error in update mode. The same call with no HCatalog (point directly to HDFS path) runs with no problem.
sqoop parameters
{code}
sqoop export --update-key registrationDate,productionId --update-mode
allowinsert --table stat_open_cases_daily --hcatalog-database exports --hcatalog-table open_cases_daily --columns casecount,productionid,registrationdate --mapreduce-job-name export-open_cases_daily --batch --outdir /tmp
{code}
Exception
{code}
ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerExceptionjava.lang.NullPointerException
at org.apache.sqoop.mapreduce.ExportJobBase.getFileType(ExportJobBase.java:112)
at org.apache.sqoop.mapreduce.ExportJobBase.isSequenceFiles(ExportJobBase.java:103)
at org.apache.sqoop.mapreduce.ExportJobBase.inputIsSequenceFiles(ExportJobBase.java:465)
at org.apache.sqoop.mapreduce.JdbcUpdateExportJob.getMapperClass(JdbcUpdateExportJob.java:69)
at org.apache.sqoop.mapreduce.ExportJobBase.configureMapper(ExportJobBase.java:250)
at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:399)
at org.apache.sqoop.manager.MySQLManager.upsertTable(MySQLManager.java:136)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:74)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231)
at org.apache.sqoop.Sqoop.main(Sqoop.java:240)
{code}
> export using hcatalog using update mode
> ---------------------------------------
>
> Key: SQOOP-1538
> URL: https://issues.apache.org/jira/browse/SQOOP-1538
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.4
> Environment: cdh5.1.2
> Reporter: Andrejs Dubovskis
> Priority: Minor
>
> Hi!
> When executing sqoop export using HCatalog as source I got error in update mode. The same call with no HCatalog (point directly to HDFS path) runs with no problem.
> sqoop parameters
> {code}
> sqoop export --update-key registrationDate,productionId --update-mode allowinsert --table stat_open_cases_daily --hcatalog-database exports --hcatalog-table open_cases_daily --columns casecount,productionid,registrationdate --batch --outdir /tmp
> {code}
> Exception
> {code}
> ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerExceptionjava.lang.NullPointerException
> at org.apache.sqoop.mapreduce.ExportJobBase.getFileType(ExportJobBase.java:112)
> at org.apache.sqoop.mapreduce.ExportJobBase.isSequenceFiles(ExportJobBase.java:103)
> at org.apache.sqoop.mapreduce.ExportJobBase.inputIsSequenceFiles(ExportJobBase.java:465)
> at org.apache.sqoop.mapreduce.JdbcUpdateExportJob.getMapperClass(JdbcUpdateExportJob.java:69)
> at org.apache.sqoop.mapreduce.ExportJobBase.configureMapper(ExportJobBase.java:250)
> at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:399)
> at org.apache.sqoop.manager.MySQLManager.upsertTable(MySQLManager.java:136)
> at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:74)
> at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:240)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)