You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/03/30 08:02:52 UTC
[jira] [Updated] (PIG-4480) Pig script failure on Tez with multiple
splits and order bys
[ https://issues.apache.org/jira/browse/PIG-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-4480:
------------------------------------
Attachment: PIG-4480-1.patch
Sample was not being collected in case of Split if the first record did not match condition as lastSample was being set to POStatus.STATUS_EOP and that was always returned as sample even if further records matched.
> Pig script failure on Tez with multiple splits and order bys
> ------------------------------------------------------------
>
> Key: PIG-4480
> URL: https://issues.apache.org/jira/browse/PIG-4480
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.15.0
>
> Attachments: PIG-4480-1.patch
>
>
> {code}
> Error: Failure while running task:java.lang.NullPointerException at java.util.Arrays.binarySearch(Arrays.java:1523) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.getPartition(WeightedRangePartitioner.java:82) at org.apache.pig.backend.hadoop.executionengine.tez.runtime.WeightedRangePartitionerTez.getPartition(WeightedRangePartitionerTez.java:46) at org.apache.pig.backend.hadoop.executionengine.tez.runtime.WeightedRangePartitionerTez.getPartition(WeightedRangePartitionerTez.java:35) at org.apache.tez.mapreduce.partition.MRPartitioner.getPartition(MRPartitioner.java:92) at org.apache.tez.runtime.library.common.sort.impl.dflt.DefaultSorter.write(DefaultSorter.java:185) at org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput$1.write(OrderedPartitionedKVOutput.java:127) at org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POIdentityInOutTez.getNextTuple(POIdentityInOutTez.java:150) at org.apache.pig.backend.hadoop.executionengine.tez.runtime.PigProcessor.runPipeline(PigProcessor.java:317) at org.apache.pig.backend.hadoop.executionengine.tez.runtime.PigProcessor.run(PigProcessor.java:196) at
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)