You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by muhammet pakyürek <mp...@hotmail.com> on 2016/10/25 13:18:03 UTC

i get the error of Py4JJavaError: An error occurred while calling o177.showString while running code below

i used spark 2.0.1 and work pypsaprk.sql dataframe


lower = arguments["lower"]
                lower_udf = udf(lambda x: lower if x<lower else x, IntegerType())
                data.withColumn(col_name,lower_udf(col_name)).show()