You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2022/01/11 19:54:00 UTC
[jira] [Comment Edited] (SPARK-37866) Set file.encoding to UTF-8 for SBT tests
[ https://issues.apache.org/jira/browse/SPARK-37866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17473139#comment-17473139 ]
Dongjoon Hyun edited comment on SPARK-37866 at 1/11/22, 7:53 PM:
-----------------------------------------------------------------
Although this happens in all Java versions, Java 17 has a different and sensitive behavior. So, I collect this issue here.
was (Author: dongjoon):
Although this happens in all Java versions, Java 17 has a different and sensitive behavior.
> Set file.encoding to UTF-8 for SBT tests
> ----------------------------------------
>
> Key: SPARK-37866
> URL: https://issues.apache.org/jira/browse/SPARK-37866
> Project: Spark
> Issue Type: Sub-task
> Components: Tests
> Affects Versions: 3.3.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Major
> Fix For: 3.3.0, 3.2.2
>
>
> {code}
> $ LANG=C.UTF-8 build/sbt "sql/testOnly *.JDBCV2Suite -- -z non-ascii"
> ...
> [info] - column name with non-ascii *** FAILED *** (2 seconds, 668 milliseconds)
> [info] "== Parsed Logical Plan ==
> [info] 'Project [unresolvedalias('COUNT('?), None)]
> [info] +- 'UnresolvedRelation [h2, test, person], [], false
> [info]
> [info] == Analyzed Logical Plan ==
> [info] count(?): bigint
> [info] Aggregate [count(?#x) AS count(?)#xL]
> [info] +- SubqueryAlias h2.test.person
> [info] +- RelationV2[?#x] test.person
> [info]
> [info] == Optimized Logical Plan ==
> [info] Project [COUNT(U&"\540d")#xL AS count(?#x)#xL AS count(?)#xL]
> [info] +- RelationV2[COUNT(U&"\540d")#xL] test.person
> [info]
> [info] == Physical Plan ==
> [info] *(1) Project [COUNT(U&"\540d")#xL AS count(?)#xL]
> [info] +- *(1) Scan org.apache.spark.sql.execution.datasources.v2.jdbc.JDBCScan$$anon$1@df881a4 [COUNT(U&"\540d")#xL] PushedAggregates: [COUNT(`?`)], PushedFilters: [], PushedGroupByColumns: [], ReadSchema: struct<COUNT(U&"\540d"):bigint>
> [info]
> [info] " did not contain "PushedAggregates: [COUNT(`名`)]" (ExplainSuite.scala:66)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org