You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "kosiew (via GitHub)" <gi...@apache.org> on 2025/02/19 08:13:59 UTC
[PR] Add DataFrame fill_null [datafusion]
kosiew opened a new pull request, #14769:
URL: https://github.com/apache/datafusion/pull/14769
## Which issue does this PR close?
<!--
We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. For example `Closes #123` indicates that this PR will close issue #123.
-->
- Closes #14765.
## Rationale for this change
<!--
Why are you proposing this change? If this is already explained clearly in the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand your changes and offer better suggestions for fixes.
-->
The fill_null operation is a common requirement in data processing frameworks like PySpark, where users need to replace null values across multiple columns efficiently. Adding a fill_null function to DataFusion and datafusion-python provides a convenient way to perform this operation without requiring complex expressions such as coalesce or manual conditional statements.
This change improves usability and aligns DataFusion's feature set more closely with other popular data processing frameworks.
## What changes are included in this PR?
<!--
There is no need to duplicate the description in the issue here but it is sometimes worth providing a summary of the individual changes in this PR.
-->
Introduced a new fill_null function in DataFrame that replaces null values in selected columns or all columns if none are specified.
Ensured type safety by only allowing replacements that can be cast to the respective column's type.
Implemented a fallback mechanism where columns remain unchanged if the provided value cannot be cast to their type.
Added helper function find_columns to validate column existence.
Included comprehensive test cases for fill_null, verifying behavior for both single-column and all-column replacements.
## Are these changes tested?
<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code
If tests are not included in your PR, please explain why (for example, are they covered by existing tests)?
-->
Yes, the following test cases have been added:
test_fill_null: Verifies the ability to replace null values in specific columns with the provided values.
test_fill_null_all_columns: Ensures the function works correctly when no column list is provided, replacing nulls in all columns where casting is possible.
Tests confirm that invalid casts do not modify the original column values.
## Are there any user-facing changes?
<!--
If there are user-facing changes then we may require documentation to be updated before approving the PR.
-->
Yes, this PR introduces a new fill_null method for DataFrames, allowing users to efficiently replace null values in their datasets. This enhances usability and streamlines null handling within DataFusion.
<!--
If there are any breaking changes to public APIs, please add the `api change` label.
-->
There are no breaking changes to existing APIs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "Omega359 (via GitHub)" <gi...@apache.org>.
Omega359 commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2683448966
> > I did a quick check in the spark functions PR, I didn't see anything related to fill.
>
> hi @Omega359 are you referring to https://spark.apache.org/docs/3.5.4/api/java/org/apache/spark/sql/DataFrameNaFunctions.html ?
I should have been clearer, apologies. I was referring to the [datafusion-spark PR](https://github.com/apache/datafusion/pull/14392)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "Omega359 (via GitHub)" <gi...@apache.org>.
Omega359 commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2685553518
> @Omega359 do you think we can proceed with the PR?
Yes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1965693790
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
+ ) -> Result<DataFrame> {
+ let cols = match columns {
+ Some(names) => self.find_columns(&names)?,
+ None => self
+ .logical_plan()
+ .schema()
+ .fields()
+ .iter()
+ .map(|f| f.as_ref().clone())
+ .collect(),
+ };
+
+ // Create projections for each column
+ let projections = self
+ .logical_plan()
+ .schema()
+ .fields()
+ .iter()
+ .map(|field| {
+ if cols.contains(field) {
+ // Try to cast fill value to column type. If the cast fails, fallback to the original column.
+ match value.clone().cast_to(field.data_type()) {
+ Ok(fill_value) => Expr::Alias(Alias {
+ expr: Box::new(Expr::ScalarFunction(ScalarFunction {
+ func: coalesce(),
+ args: vec![col(field.name()), lit(fill_value)],
+ })),
+ relation: None,
+ name: field.name().to_string(),
+ }),
+ Err(_) => col(field.name()),
+ }
+ } else {
+ col(field.name())
+ }
+ })
+ .collect::<Vec<_>>();
+
+ self.clone().select(projections)
+ }
+
+ // Helper to find columns from names
+ fn find_columns(&self, names: &[String]) -> Result<Vec<Field>> {
+ let schema = self.logical_plan().schema();
+ names
+ .iter()
+ .map(|name| {
+ schema.field_with_name(None, name).cloned().map_err(|_| {
+ DataFusionError::Plan(format!("Column '{}' not found", name))
Review Comment:
```suggestion
plan_datafusion_err!("Column '{}' not found", name))
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2685536375
@Omega359 do you think we can proceed with the PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2674922087
> Thanks @kosiew looks great some minor comments
>
> I'm surprised though we dont have a documentation with DataFrame API
its documented in https://docs.rs/datafusion/latest/datafusion/dataframe/struct.DataFrame.html not in the code itself
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead merged PR #14769:
URL: https://github.com/apache/datafusion/pull/14769
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2683472594
> > > I did a quick check in the spark functions PR, I didn't see anything related to fill.
> >
> >
> > hi @Omega359 are you referring to https://spark.apache.org/docs/3.5.4/api/java/org/apache/spark/sql/DataFrameNaFunctions.html ?
>
> I should have been clearer, apologies. I was referring to the [datafusion-spark PR](https://github.com/apache/datafusion/pull/14392)
Oh I see, this function is for the DataFrame API rather than for SQL API builtin functions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "kosiew (via GitHub)" <gi...@apache.org>.
kosiew commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1968745726
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
Review Comment:
Fixed/
Thanks for spotting this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2683379630
> I did a quick check in the spark functions PR, I didn't see anything related to fill.
hi @Omega359 are you referring to https://spark.apache.org/docs/3.5.4/api/java/org/apache/spark/sql/DataFrameNaFunctions.html ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "kosiew (via GitHub)" <gi...@apache.org>.
kosiew commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1968745726
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
Review Comment:
Fixed.
Thanks for spotting this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "kosiew (via GitHub)" <gi...@apache.org>.
kosiew commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2680284864
> its documented in https://docs.rs/datafusion/latest/datafusion/dataframe/struct.DataFrame.html not in the code itself
I added fill_null example usage in dataframe/mod.rs for rustdoc to update https://docs.rs/datafusion/latest/datafusion/dataframe/struct.DataFrame.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1969975612
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
+ ) -> Result<DataFrame> {
+ let cols = match columns {
+ Some(names) => self.find_columns(&names)?,
+ None => self
Review Comment:
Thanks @kosiew as long as its documented I think it is okay to go with Pandas approach.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "kosiew (via GitHub)" <gi...@apache.org>.
kosiew commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1967089979
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
+ ) -> Result<DataFrame> {
+ let cols = match columns {
+ Some(names) => self.find_columns(&names)?,
+ None => self
Review Comment:
I was following the Pandas convention, where no limits (columns) means fill_null for all columns
https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.fillna.html
<img width="749" alt="image" src="https://github.com/user-attachments/assets/c4eab1eb-f1d2-4133-90c3-0a2c57b0349d" />
I could amend to no op as well if this is the preferred convention
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1965696512
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
Review Comment:
should we wrap into the Option here? empty vec already serves as None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "kosiew (via GitHub)" <gi...@apache.org>.
kosiew commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1967089979
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
+ ) -> Result<DataFrame> {
+ let cols = match columns {
+ Some(names) => self.find_columns(&names)?,
+ None => self
Review Comment:
Definitely!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "kosiew (via GitHub)" <gi...@apache.org>.
kosiew commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1967089979
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
+ ) -> Result<DataFrame> {
+ let cols = match columns {
+ Some(names) => self.find_columns(&names)?,
+ None => self
Review Comment:
I was following the Pandas convention, where no limits (columns) means fill_null for all columns
https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.fillna.html
I could amend to no op as well if this is the preferred convention
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on code in PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#discussion_r1965698780
##########
datafusion/core/src/dataframe/mod.rs:
##########
@@ -1926,6 +1930,71 @@ impl DataFrame {
plan,
})
}
+
+ /// Fill null values in specified columns with a given value
+ /// If no columns are specified, applies to all columns
+ /// Only fills if the value can be cast to the column's type
+ ///
+ /// # Arguments
+ /// * `value` - Value to fill nulls with
+ /// * `columns` - Optional list of column names to fill. If None, fills all columns
+ pub fn fill_null(
+ &self,
+ value: ScalarValue,
+ columns: Option<Vec<String>>,
+ ) -> Result<DataFrame> {
+ let cols = match columns {
+ Some(names) => self.find_columns(&names)?,
+ None => self
Review Comment:
if no cols set should we just no op?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2683332509
FWI @Omega359 and @timsaucer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] Add DataFrame fill_null [datafusion]
Posted by "Omega359 (via GitHub)" <gi...@apache.org>.
Omega359 commented on PR #14769:
URL: https://github.com/apache/datafusion/pull/14769#issuecomment-2683368595
I did a quick check in the spark functions PR, I didn't see anything related to fill.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org