You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2013/04/14 01:40:15 UTC
[jira] [Commented] (SQOOP-844) Sqoop2: HdfsExportPartitioner is not
always respecting maximal number of partitions
[ https://issues.apache.org/jira/browse/SQOOP-844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13631214#comment-13631214 ]
Hudson commented on SQOOP-844:
------------------------------
Integrated in Sqoop2-hadoop100 #264 (See [https://builds.apache.org/job/Sqoop2-hadoop100/264/])
SQOOP-844: Sqoop2: HdfsExportPartitioner is not always respecting maximal number of partitions (Revision ae075f2e3769da9e43736a865f51eca96c8db61a)
Result = FAILURE
jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae075f2e3769da9e43736a865f51eca96c8db61a
Files :
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsExtract.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsExportPartitioner.java
> Sqoop2: HdfsExportPartitioner is not always respecting maximal number of partitions
> -----------------------------------------------------------------------------------
>
> Key: SQOOP-844
> URL: https://issues.apache.org/jira/browse/SQOOP-844
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.99.1
> Reporter: Jarek Jarcec Cecho
> Assignee: Vasanth kumar RJ
> Fix For: 1.99.2
>
> Attachments: SQOOP-844.patch
>
>
> It seems that HdfsExportPartitioner is not always respecting maximal number of partitions that should be created. I was able for example able to intercept following exception:
> {code}
> Stack trace: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0025:Retrieved invalid number of partitions from Partitioner - Got 11, max was 10
> at org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:79)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1014)
> at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1031)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira