You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by patcharee <Pa...@uni.no> on 2016/01/29 16:33:05 UTC

Pyspark filter not empty

Hi,

In pyspark how to filter if a column of dataframe is not empty?

I tried:

dfNotEmpty = df.filter(df['msg']!='')

It did not work.

Thanks,
Patcharee

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org