You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/22 20:32:00 UTC
[jira] [Updated] (SPARK-43239) Remove null_counts from info()
[ https://issues.apache.org/jira/browse/SPARK-43239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bjørn Jørgensen updated SPARK-43239:
------------------------------------
Description:
df.info() is broken now.
It prints
{code:java}
// Some comments here
public String getFoo()
{
return foo;
}
{code}
TypeError Traceback (most recent call last)
Cell In[12], line 1
----> 1 F05.info()
File /opt/spark/python/pyspark/pandas/frame.py:12167, in DataFrame.info(self, verbose, buf, max_cols, null_counts)
12163 count_func = self.count
12164 self.count = ( # type: ignore[assignment]
12165 lambda: count_func()._to_pandas() # type: ignore[assignment, misc, union-attr]
12166 )
> 12167 return pd.DataFrame.info(
12168 self, # type: ignore[arg-type]
12169 verbose=verbose,
12170 buf=buf,
12171 max_cols=max_cols,
12172 memory_usage=False,
12173 null_counts=null_counts,
12174 )
12175 finally:
12176 del self._data
TypeError: DataFrame.info() got an unexpected keyword argument 'null_counts'
was:
df.info() is broken now.
It prints
TypeError Traceback (most recent call last)
Cell In[12], line 1
----> 1 F05.info()
File /opt/spark/python/pyspark/pandas/frame.py:12167, in DataFrame.info(self, verbose, buf, max_cols, null_counts)
12163 count_func = self.count
12164 self.count = ( # type: ignore[assignment]
12165 lambda: count_func()._to_pandas() # type: ignore[assignment, misc, union-attr]
12166 )
> 12167 return pd.DataFrame.info(
12168 self, # type: ignore[arg-type]
12169 verbose=verbose,
12170 buf=buf,
12171 max_cols=max_cols,
12172 memory_usage=False,
12173 null_counts=null_counts,
12174 )
12175 finally:
12176 del self._data
TypeError: DataFrame.info() got an unexpected keyword argument 'null_counts'
> Remove null_counts from info()
> ------------------------------
>
> Key: SPARK-43239
> URL: https://issues.apache.org/jira/browse/SPARK-43239
> Project: Spark
> Issue Type: Bug
> Components: Pandas API on Spark
> Affects Versions: 3.4.0, 3.5.0
> Reporter: Bjørn Jørgensen
> Priority: Major
>
> df.info() is broken now.
> It prints
> {code:java}
> // Some comments here
> public String getFoo()
> {
> return foo;
> }
> {code}
> TypeError Traceback (most recent call last)
> Cell In[12], line 1
> ----> 1 F05.info()
> File /opt/spark/python/pyspark/pandas/frame.py:12167, in DataFrame.info(self, verbose, buf, max_cols, null_counts)
> 12163 count_func = self.count
> 12164 self.count = ( # type: ignore[assignment]
> 12165 lambda: count_func()._to_pandas() # type: ignore[assignment, misc, union-attr]
> 12166 )
> > 12167 return pd.DataFrame.info(
> 12168 self, # type: ignore[arg-type]
> 12169 verbose=verbose,
> 12170 buf=buf,
> 12171 max_cols=max_cols,
> 12172 memory_usage=False,
> 12173 null_counts=null_counts,
> 12174 )
> 12175 finally:
> 12176 del self._data
> TypeError: DataFrame.info() got an unexpected keyword argument 'null_counts'
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org