You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "kazantsev-maksim (via GitHub)" <gi...@apache.org> on 2026/07/01 18:11:30 UTC

Re: [PR] feat: implement native empty2null spark inner function [datafusion-comet]

kazantsev-maksim commented on code in PR #4683:
URL: https://github.com/apache/datafusion-comet/pull/4683#discussion_r3508146702


##########
spark/src/test/scala/org/apache/comet/parquet/CometParquetWriterSuite.scala:
##########
@@ -37,6 +38,27 @@ class CometParquetWriterSuite extends CometTestBase {
 
   import testImplicits._
 
+  test("partitioned write with empty string partition value") {
+    withTempPath { path =>
+      Seq(("", 1), ("a", 2))
+        .toDF("part", "value")
+        .write

Review Comment:
   Sorry for the delayed response. This function is used for string fields during writes using partitionBy, and I encountered this while working on this: https://github.com/apache/datafusion-comet/pull/4670.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org