You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2025/07/25 05:39:00 UTC
[jira] [Resolved] (SPARK-52950) Enable ANSI mode in DataSourceV2StrategySuite
[ https://issues.apache.org/jira/browse/SPARK-52950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-52950.
----------------------------------
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 51660
[https://github.com/apache/spark/pull/51660]
> Enable ANSI mode in DataSourceV2StrategySuite
> ---------------------------------------------
>
> Key: SPARK-52950
> URL: https://issues.apache.org/jira/browse/SPARK-52950
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
> Affects Versions: 4.0.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> {code}
> 2025-07-24T02:23:00.6353808Z [0m[[0m[0minfo[0m] [0m[0m[32mDataSourceV2StrategySuite:[0m[0m
> 2025-07-24T02:23:00.6897846Z [0m[[0m[0minfo[0m] [0m[0m[32m- translate simple expression (15 milliseconds)[0m[0m
> 2025-07-24T02:23:00.6985931Z [0m[[0m[0minfo[0m] [0m[0m[32m- translate complex expression (9 milliseconds)[0m[0m
> 2025-07-24T02:23:00.6994927Z [0m[[0m[0minfo[0m] [0m[0m[32m- SPARK-36644: Push down boolean column filter (1 millisecond)[0m[0m
> 2025-07-24T02:23:00.7005821Z [0m[[0m[0minfo[0m] [0m[0m[32m- inability to convert unknown expressions and predicates (1 millisecond)[0m[0m
> 2025-07-24T02:23:00.7043976Z [0m[[0m[0minfo[0m] [0m[0m[32m- round trip conversion of CASE_WHEN expression (4 milliseconds)[0m[0m
> 2025-07-24T02:23:00.7216573Z [0m[[0m[0minfo[0m] [0m[0m[32m- round trip conversion of math functions (16 milliseconds)[0m[0m
> 2025-07-24T02:23:00.7247665Z [0m[[0m[0minfo[0m] [0m[0m[32m- round trip conversion of bitwise functions (2 milliseconds)[0m[0m
> 2025-07-24T02:23:00.7304502Z [0m[[0m[0minfo[0m] [0m[0m[32m- round trip conversion of predicate expressions (5 milliseconds)[0m[0m
> 2025-07-24T02:23:00.7308336Z [0m[[0m[0minfo[0m] [0m[0m[32m- Constant foldable CASE_WHEN expression (1 millisecond)[0m[0m
> 2025-07-24T02:23:00.7318021Z [0m[[0m[0minfo[0m] [0m[0m[32m- Constant foldable math functions (1 millisecond)[0m[0m
> 2025-07-24T02:23:00.7456695Z [0m[[0m[0minfo[0m] [0m[0m[31m- Partial constant folding of math functions *** FAILED *** (2 milliseconds)[0m[0m
> 2025-07-24T02:23:00.7483354Z [0m[[0m[0minfo[0m] [0m[0m[31m can't convert to V2 expression: (LOG10(100.0) + cint#535728) (DataSourceV2StrategySuite.scala:843)[0m[0m
> 2025-07-24T02:23:00.7484906Z [0m[[0m[0minfo[0m] [0m[0m[31m org.scalatest.exceptions.TestFailedException:[0m[0m
> 2025-07-24T02:23:00.7486279Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)[0m[0m
> 2025-07-24T02:23:00.7487806Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)[0m[0m
> 2025-07-24T02:23:00.7489460Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.scalatest.funsuite.AnyFunSuite.newAssertionFailedException(AnyFunSuite.scala:1564)[0m[0m
> 2025-07-24T02:23:00.7491165Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.scalatest.Assertions.fail(Assertions.scala:933)[0m[0m
> 2025-07-24T02:23:00.7492484Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.scalatest.Assertions.fail$(Assertions.scala:929)[0m[0m
> 2025-07-24T02:23:00.7493738Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.scalatest.funsuite.AnyFunSuite.fail(AnyFunSuite.scala:1564)[0m[0m
> 2025-07-24T02:23:00.7495734Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.apache.spark.sql.execution.datasources.v2.DataSourceV2StrategySuite.$anonfun$checkV2Conversion$1(DataSourceV2StrategySuite.scala:843)[0m[0m
> 2025-07-24T02:23:00.7497426Z [0m[[0m[0minfo[0m] [0m[0m[31m at scala.Option.getOrElse(Option.scala:201)[0m[0m
> 2025-07-24T02:23:00.7499185Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.apache.spark.sql.execution.datasources.v2.DataSourceV2StrategySuite.checkV2Conversion(DataSourceV2StrategySuite.scala:843)[0m[0m
> 2025-07-24T02:23:00.7501656Z [0m[[0m[0minfo[0m] [0m[0m[31m at org.apache.spark.sql.execution.datasources.v2.DataSourceV2StrategySuite.$anonfun$new$13(DataSourceV2StrategyS
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org