[jira] [Commented] (SPARK-12070) PySpark implementation of Slicing operator incorrect

["Abdeali Kothari (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15426048#comment-15426048 ] 

Abdeali Kothari commented on SPARK-12070:
-----------------------------------------

I notice that this has been set to Won't Fix and status Resolved. And the Github PR has been closed due to inactivity.
I need to do a slicing myself - what is the recommended way of doing this if the example mentioned is wrong ?

> PySpark implementation of Slicing operator incorrect
> ----------------------------------------------------
>
>                 Key: SPARK-12070
>                 URL: https://issues.apache.org/jira/browse/SPARK-12070
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark
>    Affects Versions: 1.5.2
>            Reporter: Jeff Zhang
>
> {code}
> aa=('Ofer', 1), ('Wei', 2)
> a = sqlContext.createDataFrame(aa)
> a.select(a._1[2:]).show()
> {code}
> Traceback (most recent call last):
>   File "<stdin>", line 1, in <module>
>   File "/Users/jzhang/github/spark/python/pyspark/sql/column.py", line 286, in substr
>     jc = self._jc.substr(startPos, length)
>   File "/Users/jzhang/github/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 813, in __call__
>   File "/Users/jzhang/github/spark/python/pyspark/sql/utils.py", line 45, in deco
>     return f(*a, **kw)
>   File "/Users/jzhang/github/spark/python/lib/py4j-0.9-src.zip/py4j/protocol.py", line 312, in get_return_value
> py4j.protocol.Py4JError: An error occurred while calling o37.substr. Trace:
> py4j.Py4JException: Method substr([class java.lang.Integer, class java.lang.Long]) does not exist
> 	at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:335)
> 	at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:344)
> 	at py4j.Gateway.invoke(Gateway.java:252)
> 	at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
> 	at py4j.commands.CallCommand.execute(CallCommand.java:79)
> 	at py4j.GatewayConnection.run(GatewayConnection.java:209)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org