You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Frédéric ESCANDELL (JIRA)" <ji...@apache.org> on 2018/06/26 17:38:00 UTC
[jira] [Updated] (SQOOP-3339) Netezza export doesn't work on ORC
tables
[ https://issues.apache.org/jira/browse/SQOOP-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Frédéric ESCANDELL updated SQOOP-3339:
--------------------------------------
Attachment: patch-file.patch
> Netezza export doesn't work on ORC tables
> -----------------------------------------
>
> Key: SQOOP-3339
> URL: https://issues.apache.org/jira/browse/SQOOP-3339
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.7
> Reporter: Frédéric ESCANDELL
> Priority: Blocker
> Attachments: patch-file.patch
>
>
> While executing sqoop export on a ORC table, the exception followed is launched :
>
> {code:java}
> Error: java.lang.ClassCastException: org.apache.hadoop.io.NullWritable cannot be cast to org.apache.hadoop.io.LongWritable
> at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableHCatExportMapper.map(NetezzaExternalTableHCatExportMapper.java:34)
> at org.apache.sqoop.mapreduce.db.netezza.NetezzaExternalTableExportMapper.run(NetezzaExternalTableExportMapper.java:233)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
> {code}
> If the exported is stored as TextFile, the mapper class receive LongWritable as key but if it's an ORC table, the mapper class receive NullWritable.
> The patch in attachment propose to modify the signature of map function :
>
> {code:java}
> public void map(LongWritable key, HCatRecord hcr, Context context){code}
>
> to
>
> {code:java}
> public void map(Object key, HCatRecord hcr, Context context){code}
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)