You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2023/06/26 13:00:00 UTC

[jira] [Updated] (SPARK-44191) SparkR test failed with R 4.3.0

     [ https://issues.apache.org/jira/browse/SPARK-44191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yang Jie updated SPARK-44191:
-----------------------------
    Description: 
run

 
{code:java}
build/sbt package -Psparkr
R/install-dev.sh; R/run-tests.sh {code}
 

 

 
{code:java}
══ Failed ══════════════════════════════════════════════════════════════════════
── 1. Error ('test_streaming.R:190:3'): PartitionBy ────────────────────────────
Error: Error in awaitTermination : streaming query error - Wrong basePath /var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet for the root path: file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpBFGJln/sparkr-testd75a4d1118fd.parquet/part-00000-bca8678d-70e2-42ef-abaf-5d5b56d46d62-c000.snappy.parquet
=== Streaming Query ===
Identifier: [id = 5a6a5714-ea05-473d-bdef-d30db92c8ef6, runId = bcfc36cd-bd4c-4b4a-9693-8ecafa70129a]
Current Committed Offsets: {}
Current Available Offsets: {FileStreamSource[file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet]: {"logOffset":0}}


Current State: ACTIVE
Thread State: RUNNABLE


Logical Plan:
WriteToMicroBatchDataSourceV1 FileSink[/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T//RtmpDbPxOv/sparkr-testcf961f3f32b4.text], 5a6a5714-ea05-473d-bdef-d30db92c8ef6, [path=/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T//RtmpDbPxOv/sparkr-testcf961f3f32b4.text, checkpointLocation=append], Append
+- StreamingExecutionRelation FileStreamSource[file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet], [name#53978, age#53979, count#53980]


Backtrace:
    ▆
 1. ├─SparkR::awaitTermination(q, 5 * 1000) at test_streaming.R:190:2
 2. └─SparkR::awaitTermination(q, 5 * 1000)
 3.   └─SparkR:::handledCallJMethod(x@ssq, "awaitTermination", as.integer(timeout))
 4.     └─base::tryCatch(...)
 5.       └─base (local) tryCatchList(expr, classes, parentenv, handlers)
 6.         └─base (local) tryCatchOne(expr, names, parentenv, handlers[[1L]])
 7.           └─value[[3L]](cond)
 8.             └─SparkR:::captureJVMException(e, method)


══ DONE ════════════════════════════════════════════════════════════════════════
Error: Test failures{code}
 

ENV:

 
{code:java}
R --version
R version 4.3.0 (2023-04-21) -- "Already Tomorrow"
Copyright (C) 2023 The R Foundation for Statistical Computing
Platform: aarch64-apple-darwin20 (64-bit)


R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under the terms of the
GNU General Public License versions 2 or 3.
For more information about these matters see
https://www.gnu.org/licenses/.


java -version
openjdk version "1.8.0_372"
OpenJDK Runtime Environment (Zulu 8.70.0.23-CA-macos-aarch64) (build 1.8.0_372-b07)
OpenJDK 64-Bit Server VM (Zulu 8.70.0.23-CA-macos-aarch64) (build 25.372-b07, mixed mode) {code}
 

 

Run on M2 Max/MacOs 13.4.1

 

  was:
run

 
{code:java}
build/sbt package -Psparkr
R/install-dev.sh; R/run-tests.sh {code}
 

 

 
{code:java}
══ Failed ══════════════════════════════════════════════════════════════════════
── 1. Error ('test_streaming.R:190:3'): PartitionBy ────────────────────────────
Error: Error in awaitTermination : streaming query error - Wrong basePath /var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet for the root path: file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpBFGJln/sparkr-testd75a4d1118fd.parquet/part-00000-bca8678d-70e2-42ef-abaf-5d5b56d46d62-c000.snappy.parquet
=== Streaming Query ===
Identifier: [id = 5a6a5714-ea05-473d-bdef-d30db92c8ef6, runId = bcfc36cd-bd4c-4b4a-9693-8ecafa70129a]
Current Committed Offsets: {}
Current Available Offsets: {FileStreamSource[file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet]: {"logOffset":0}}


Current State: ACTIVE
Thread State: RUNNABLE


Logical Plan:
WriteToMicroBatchDataSourceV1 FileSink[/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T//RtmpDbPxOv/sparkr-testcf961f3f32b4.text], 5a6a5714-ea05-473d-bdef-d30db92c8ef6, [path=/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T//RtmpDbPxOv/sparkr-testcf961f3f32b4.text, checkpointLocation=append], Append
+- StreamingExecutionRelation FileStreamSource[file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet], [name#53978, age#53979, count#53980]


Backtrace:
    ▆
 1. ├─SparkR::awaitTermination(q, 5 * 1000) at test_streaming.R:190:2
 2. └─SparkR::awaitTermination(q, 5 * 1000)
 3.   └─SparkR:::handledCallJMethod(x@ssq, "awaitTermination", as.integer(timeout))
 4.     └─base::tryCatch(...)
 5.       └─base (local) tryCatchList(expr, classes, parentenv, handlers)
 6.         └─base (local) tryCatchOne(expr, names, parentenv, handlers[[1L]])
 7.           └─value[[3L]](cond)
 8.             └─SparkR:::captureJVMException(e, method)


══ DONE ════════════════════════════════════════════════════════════════════════
错误: Test failures{code}
 

 

ENV:

 
{code:java}
R --version
R version 4.3.0 (2023-04-21) -- "Already Tomorrow"
Copyright (C) 2023 The R Foundation for Statistical Computing
Platform: aarch64-apple-darwin20 (64-bit)


R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under the terms of the
GNU General Public License versions 2 or 3.
For more information about these matters see
https://www.gnu.org/licenses/.


java -version
openjdk version "1.8.0_372"
OpenJDK Runtime Environment (Zulu 8.70.0.23-CA-macos-aarch64) (build 1.8.0_372-b07)
OpenJDK 64-Bit Server VM (Zulu 8.70.0.23-CA-macos-aarch64) (build 25.372-b07, mixed mode) {code}
 

 

Run on M2 Max/MacOs 13.4.1

 


> SparkR test failed with R 4.3.0
> -------------------------------
>
>                 Key: SPARK-44191
>                 URL: https://issues.apache.org/jira/browse/SPARK-44191
>             Project: Spark
>          Issue Type: Bug
>          Components: SparkR
>    Affects Versions: 3.5.0
>            Reporter: Yang Jie
>            Priority: Major
>
> run
>  
> {code:java}
> build/sbt package -Psparkr
> R/install-dev.sh; R/run-tests.sh {code}
>  
>  
>  
> {code:java}
> ══ Failed ══════════════════════════════════════════════════════════════════════
> ── 1. Error ('test_streaming.R:190:3'): PartitionBy ────────────────────────────
> Error: Error in awaitTermination : streaming query error - Wrong basePath /var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet for the root path: file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpBFGJln/sparkr-testd75a4d1118fd.parquet/part-00000-bca8678d-70e2-42ef-abaf-5d5b56d46d62-c000.snappy.parquet
> === Streaming Query ===
> Identifier: [id = 5a6a5714-ea05-473d-bdef-d30db92c8ef6, runId = bcfc36cd-bd4c-4b4a-9693-8ecafa70129a]
> Current Committed Offsets: {}
> Current Available Offsets: {FileStreamSource[file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet]: {"logOffset":0}}
> Current State: ACTIVE
> Thread State: RUNNABLE
> Logical Plan:
> WriteToMicroBatchDataSourceV1 FileSink[/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T//RtmpDbPxOv/sparkr-testcf961f3f32b4.text], 5a6a5714-ea05-473d-bdef-d30db92c8ef6, [path=/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T//RtmpDbPxOv/sparkr-testcf961f3f32b4.text, checkpointLocation=append], Append
> +- StreamingExecutionRelation FileStreamSource[file:/var/folders/2w/_w3fqbdn7pl8n4z2q6p6zcj80000gn/T/RtmpDbPxOv/sparkr-testcf965edf703d.parquet], [name#53978, age#53979, count#53980]
> Backtrace:
>     ▆
>  1. ├─SparkR::awaitTermination(q, 5 * 1000) at test_streaming.R:190:2
>  2. └─SparkR::awaitTermination(q, 5 * 1000)
>  3.   └─SparkR:::handledCallJMethod(x@ssq, "awaitTermination", as.integer(timeout))
>  4.     └─base::tryCatch(...)
>  5.       └─base (local) tryCatchList(expr, classes, parentenv, handlers)
>  6.         └─base (local) tryCatchOne(expr, names, parentenv, handlers[[1L]])
>  7.           └─value[[3L]](cond)
>  8.             └─SparkR:::captureJVMException(e, method)
> ══ DONE ════════════════════════════════════════════════════════════════════════
> Error: Test failures{code}
>  
> ENV:
>  
> {code:java}
> R --version
> R version 4.3.0 (2023-04-21) -- "Already Tomorrow"
> Copyright (C) 2023 The R Foundation for Statistical Computing
> Platform: aarch64-apple-darwin20 (64-bit)
> R is free software and comes with ABSOLUTELY NO WARRANTY.
> You are welcome to redistribute it under the terms of the
> GNU General Public License versions 2 or 3.
> For more information about these matters see
> https://www.gnu.org/licenses/.
> java -version
> openjdk version "1.8.0_372"
> OpenJDK Runtime Environment (Zulu 8.70.0.23-CA-macos-aarch64) (build 1.8.0_372-b07)
> OpenJDK 64-Bit Server VM (Zulu 8.70.0.23-CA-macos-aarch64) (build 25.372-b07, mixed mode) {code}
>  
>  
> Run on M2 Max/MacOs 13.4.1
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org