You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sedona.apache.org by "Kristin Cowalcijk (Jira)" <ji...@apache.org> on 2023/04/27 00:50:00 UTC

[jira] [Created] (SEDONA-277) Sedona spark artifacts for scala 2.13 do not have proper POMs

Kristin Cowalcijk created SEDONA-277:
----------------------------------------

             Summary: Sedona spark artifacts for scala 2.13 do not have proper POMs
                 Key: SEDONA-277
                 URL: https://issues.apache.org/jira/browse/SEDONA-277
             Project: Apache Sedona
          Issue Type: Bug
            Reporter: Kristin Cowalcijk


A strange error happens when launching spark-shell with {{--packages}} specified as sedona spark packages:

{code}
		::::::::::::::::::::::::::::::::::::::::::::::

		::          UNRESOLVED DEPENDENCIES         ::

		::::::::::::::::::::::::::::::::::::::::::::::

		:: org.apache.sedona#sedona-spark-shaded-3.0_2.13;1.4.0: java.text.ParseException: inconsistent module descriptor file found in 'https://repo1.maven.org/maven2/org/apache/sedona/sedona-spark-shaded-3.0_2.13/1.4.0/sedona-spark-shaded-3.0_2.13-1.4.0.pom': bad module name: expected='sedona-spark-shaded-3.0_2.13' found='sedona-spark-shaded-3.0_2.12'; 

		:: org.scalatest#scalatest_2.13;working@kontinuation: not found

		:: org.scala-lang.modules#scala-collection-compat_2.13;working@kontinuation: not found

		::::::::::::::::::::::::::::::::::::::::::::::


:::: ERRORS
	unknown resolver null

		central: bad module name found in https://repo1.maven.org/maven2/org/apache/sedona/sedona-spark-shaded-3.0_2.13/1.4.0/sedona-spark-shaded-3.0_2.13-1.4.0.pom: expected='sedona-spark-shaded-3.0_2.13 found='sedona-spark-shaded-3.0_2.12'
{code}

It complains that the POM of spark-shaded contains an inconsistent module name. Part of the POM file of {{sedona-spark-shaded-3.0_2.13;1.4.0}} looks like this:

{code:xml}
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  <parent>
    <artifactId>sedona-parent</artifactId>
    <groupId>org.apache.sedona</groupId>
    <version>1.4.0</version>
  </parent>
  <modelVersion>4.0.0</modelVersion>
  <artifactId>sedona-spark-shaded-${spark.compat.version}_${scala.compat.version}</artifactId>
  <name>${project.groupId}:${project.artifactId}</name>
  <description>A cluster computing system for processing large-scale spatial data: Spark Shaded.</description>
  <url>http://sedona.apache.org/</url>
{code}

The {{artifactId}} was not resolved to constants when publishing, so the dependency resolver uses the property definitions in parent POM to resolve {{${spark.compat.version}_${scala.compat.version}}}. The parent POM defined {{spark.compat.version}} as 3.0 and {{scala.compat.version}} as 2.12 in default activated profile, so the artifact name would be {{sedona-spark-shaded-3.0_2.12}}, which is inconsistent with {{sedona-spark-shaded-3.0_2.13}}.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)