You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/01/09 02:23:00 UTC
[jira] [Resolved] (SPARK-41894) sql/core module mvn clean failed
[ https://issues.apache.org/jira/browse/SPARK-41894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jungtaek Lim resolved SPARK-41894.
----------------------------------
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39406
[https://github.com/apache/spark/pull/39406]
> sql/core module mvn clean failed
> --------------------------------
>
> Key: SPARK-41894
> URL: https://issues.apache.org/jira/browse/SPARK-41894
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming, Tests
> Affects Versions: 3.4.0
> Reporter: Yang Jie
> Assignee: Yang Jie
> Priority: Major
> Fix For: 3.4.0
>
>
> run the following commands:
> # mvn clean install -pl sql/core -am -DskipTests
> # mvn test -pl sql/core
> # mvn clean
>
> then following error:
>
> {code:java}
> [INFO] Spark Project Parent POM ........................... SUCCESS [ 0.133 s]
> [INFO] Spark Project Tags ................................. SUCCESS [ 0.008 s]
> [INFO] Spark Project Sketch ............................... SUCCESS [ 0.007 s]
> [INFO] Spark Project Local DB ............................. SUCCESS [ 0.008 s]
> [INFO] Spark Project Networking ........................... SUCCESS [ 0.015 s]
> [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 0.020 s]
> [INFO] Spark Project Unsafe ............................... SUCCESS [ 0.007 s]
> [INFO] Spark Project Launcher ............................. SUCCESS [ 0.008 s]
> [INFO] Spark Project Core ................................. SUCCESS [ 0.279 s]
> [INFO] Spark Project ML Local Library ..................... SUCCESS [ 0.010 s]
> [INFO] Spark Project GraphX ............................... SUCCESS [ 0.016 s]
> [INFO] Spark Project Streaming ............................ SUCCESS [ 0.039 s]
> [INFO] Spark Project Catalyst ............................. SUCCESS [ 0.262 s]
> [INFO] Spark Project SQL .................................. FAILURE [ 1.305 s]
> [INFO] Spark Project ML Library ........................... SKIPPED
> [INFO] Spark Project Tools ................................ SKIPPED
> [INFO] Spark Project Hive ................................. SKIPPED
> [INFO] Spark Project REPL ................................. SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................. SKIPPED
> [INFO] Spark Project YARN ................................. SKIPPED
> [INFO] Spark Project Mesos ................................ SKIPPED
> [INFO] Spark Project Kubernetes ........................... SKIPPED
> [INFO] Spark Project Hive Thrift Server ................... SKIPPED
> [INFO] Spark Ganglia Integration .......................... SKIPPED
> [INFO] Spark Project Hadoop Cloud Integration ............. SKIPPED
> [INFO] Spark Project Assembly ............................. SKIPPED
> [INFO] Kafka 0.10+ Token Provider for Streaming ........... SKIPPED
> [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
> [INFO] Kafka 0.10+ Source for Structured Streaming ........ SKIPPED
> [INFO] Spark Kinesis Integration .......................... SKIPPED
> [INFO] Spark Project Examples ............................. SKIPPED
> [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
> [INFO] Spark Avro ......................................... SKIPPED
> [INFO] Spark Project Connect Common ....................... SKIPPED
> [INFO] Spark Project Connect Server ....................... SKIPPED
> [INFO] Spark Project Connect Client ....................... SKIPPED
> [INFO] Spark Protobuf ..................................... SKIPPED
> [INFO] Spark Project Kinesis Assembly ..................... SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 2.896 s
> [INFO] Finished at: 2023-01-05T15:15:57+08:00
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-clean-plugin:3.1.0:clean (default-clean) on project spark-sql_2.13: Failed to clean project: Failed to delete /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc -> [Help 1]
> {code}
>
>
> run :
> * ll /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc
>
>
> {code:java}
> -rw-r--r-- 1 work work 12 Dec 28 16:06 /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc{code}
>
>
> and current user(work) can't rm this file:
> * rm /${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc
>
> {code:java}
> rm: cannot remove `/${basedir}/sql/core/target/tmp/streaming.metadata-1b8b16d8-c9ba-4c38-9ac0-94a39f583082/commits/.0.crc': Permission denied {code}
> need to use root to clean this file
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org