[jira] [Comment Edited] (MAHOUT-1939) fastutil version clash with spark distributions

["Dmitriy Lyubimov (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAHOUT-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862045#comment-15862045 ] 

Dmitriy Lyubimov edited comment on MAHOUT-1939 at 2/11/17 12:16 AM:
--------------------------------------------------------------------

perhaps mahout should  include fast-util in a shaded form in mahout-math or mahout-math-scala.
like this (in mahout-math):

      <plugin>
        <groupId>org.apache.maven.plugins</groupId>
        <artifactId>maven-shade-plugin</artifactId>
        <version>3.0.0</version>
        <executions>
          <execution>
            <phase>package</phase>
            <goals>
              <goal>shade</goal>
            </goals>
            <configuration>
              <relocations>
                <relocation>
                  <pattern>it.unimi.dsi.fastutil</pattern>
                  <shadedPattern>shaded.it.unimi.dsi.fastutil</shadedPattern>
                </relocation>
              </relocations>
            </configuration>
          </execution>
        </executions>
      </plugin>



was (Author: dlyubimov):
perhaps mahout should  include fast-util in a shaded form in mahout-math or mahout-math-scala.

> fastutil version clash with spark distributions
> -----------------------------------------------
>
>                 Key: MAHOUT-1939
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1939
>             Project: Mahout
>          Issue Type: Bug
>            Reporter: Dmitriy Lyubimov
>            Priority: Critical
>
> Version difference in fast util breaks sparse algebra (specifically, RandomAccessSparseVector in assign, e.g., vec *= 5).
> observed version in CDH:
>     file:/opt/cloudera/parcels/CDH-5.9.0-1.cdh5.9.0.p0.21/jars/fastutil-6.3.jar
> mahout uses 7.0.12
> java.lang.UnsupportedOperationException
>         at it.unimi.dsi.fastutil.ints.AbstractInt2DoubleMap$BasicEntry.setValue(AbstractInt2DoubleMap.java:146)
>         at org.apache.mahout.math.RandomAccessSparseVector$RandomAccessElement.set(RandomAccessSparseVector.java:235)
>         at org.apache.mahout.math.VectorView$DecoratorElement.set(VectorView.java:181)
>         at org.apache.mahout.math.AbstractVector.assign(AbstractVector.java:536)
>         at org.apache.mahout.math.scalabindings.RLikeVectorOps.$div$eq(RLikeVectorOps.scala:45)
>     ...



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)