You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Erik Erlandson (JIRA)" <ji...@apache.org> on 2014/06/28 07:05:24 UTC

[jira] [Commented] (SPARK-2315) drop, dropRight and dropWhile which take RDD input and return RDD

    [ https://issues.apache.org/jira/browse/SPARK-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14046725#comment-14046725 ] 

Erik Erlandson commented on SPARK-2315:
---------------------------------------

PR:  https://github.com/apache/spark/pull/1254


> drop, dropRight and dropWhile which take RDD input and return RDD
> -----------------------------------------------------------------
>
>                 Key: SPARK-2315
>                 URL: https://issues.apache.org/jira/browse/SPARK-2315
>             Project: Spark
>          Issue Type: New Feature
>          Components: Spark Core
>            Reporter: Erik Erlandson
>              Labels: features
>
> Last time I loaded in a text file, I found myself wanting to just skip the first element as it was a header.     I wrote candidate methods drop, dropRight and dropWhile to satisfy this kind of need:
> val txt = sc.textFile("text_with_header.txt")
> val data = txt.drop(1)



--
This message was sent by Atlassian JIRA
(v6.2#6252)