You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Kevin Jung <it...@samsung.com> on 2014/09/02 05:39:18 UTC

zip equal-length but unequally-partition

http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip
<http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip>  

Please check this url .
I got same problem in v1.0.1
In some cases, RDD losts several elements after zip so that a total count of
ZippedRDD is less than source RDD.
will 1.1 version of Spark fix it?



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/zip-equal-length-but-unequally-partition-tp13246.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: zip equal-length but unequally-partition

Posted by Kevin Jung <it...@samsung.com>.
I just created it.
Here's ticket.
https://issues.apache.org/jira/browse/SPARK-3364

Thanks,
Kevin



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/zip-equal-length-but-unequally-partition-tp13246p13330.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: zip equal-length but unequally-partition

Posted by Matthew Farrellee <ma...@redhat.com>.
On 09/01/2014 11:39 PM, Kevin Jung wrote:
> http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip
> <http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip>
>
> Please check this url .
> I got same problem in v1.0.1
> In some cases, RDD losts several elements after zip so that a total count of
> ZippedRDD is less than source RDD.
> will 1.1 version of Spark fix it?

will you file a jira for the issue?

if you do it can be verified and tracked as fixed / not fixed in future 
releases.

best,


matt


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org