You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/05/31 07:48:00 UTC

[jira] [Commented] (SPARK-35573) Support R 4.1.0

    [ https://issues.apache.org/jira/browse/SPARK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354269#comment-17354269 ] 

Hyukjin Kwon commented on SPARK-35573:
--------------------------------------

will take a look

> Support R 4.1.0
> ---------------
>
>                 Key: SPARK-35573
>                 URL: https://issues.apache.org/jira/browse/SPARK-35573
>             Project: Spark
>          Issue Type: Bug
>          Components: R
>    Affects Versions: 3.2.0
>            Reporter: Dongjoon Hyun
>            Priority: Major
>
> Currently, there exists 6 SparkR UT failures in R 4.1.0.
> Until R 4.0.5, there was no errors.
> {code}
> ══ Failed ══════════════════════════════════════════════════════════════════════
> ── 1. Failure (test_sparkSQL_arrow.R:71:3): createDataFrame/collect Arrow optimi
> collect(createDataFrame(rdf)) not equal to `expected`.
> Component “g”: 'tzone' attributes are inconsistent ('UTC' and '')
> ── 2. Failure (test_sparkSQL_arrow.R:143:3): dapply() Arrow optimization - type
> collect(ret) not equal to `rdf`.
> Component “b”: 'tzone' attributes are inconsistent ('UTC' and '')
> ── 3. Failure (test_sparkSQL_arrow.R:229:3): gapply() Arrow optimization - type
> collect(ret) not equal to `rdf`.
> Component “b”: 'tzone' attributes are inconsistent ('UTC' and '')
> ── 4. Error (test_sparkSQL.R:1454:3): column functions ─────────────────────────
> Error: (converted from warning) cannot xtfrm data frames
> Backtrace:
>   1. base::sort(collect(distinct(select(df, input_file_name())))) test_sparkSQL.R:1454:2
>   2. base::sort.default(collect(distinct(select(df, input_file_name()))))
>   5. base::order(x, na.last = na.last, decreasing = decreasing)
>   6. base::lapply(z, function(x) if (is.object(x)) as.vector(xtfrm(x)) else x)
>   7. base:::FUN(X[[i]], ...)
>  10. base::xtfrm.data.frame(x)
> ── 5. Failure (test_utils.R:67:3): cleanClosure on R functions ─────────────────
> `actual` not equal to `g`.
> names for current but not for target
> Length mismatch: comparison on first 0 components
> ── 6. Failure (test_utils.R:80:3): cleanClosure on R functions ─────────────────
> `actual` not equal to `g`.
> names for current but not for target
> Length mismatch: comparison on first 0 components
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org