[jira] [Commented] (SPARK-14848) DatasetSuite - Java encoder fails on Big Endian platforms

["Pete Robbins (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253816#comment-15253816 ] 

Pete Robbins commented on SPARK-14848:
--------------------------------------

changing the Java encoder test to use toSet and compare against Set(...) makes the test pass on both little endian and big endian platforms.

I will submit a PR.

[~cloud_fan] can you confirm my thoughts?

> DatasetSuite - Java encoder fails on Big Endian platforms
> ---------------------------------------------------------
>
>                 Key: SPARK-14848
>                 URL: https://issues.apache.org/jira/browse/SPARK-14848
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Pete Robbins
>
> Since this PR https://github.com/apache/spark/pull/10703 for https://issues.apache.org/jira/browse/SPARK-12756 the "Java encoder" test in DatasetSuite has been failing on big endian platforms:
> - Java encoder *** FAILED ***
>   Array((JavaData(2),1), (JavaData(1),1)) did not equal List((JavaData(1),1), (JavaData(2),1)) (DatasetSuite.scala:478)
> I note that the code for the "Kyro encoder" test was changed in the PR to use toSet and compare results against a Set to stop it failing in the same way whereas the Java encoder test still uses toSeq. 
> Is it that the order is not guaranteed (but happens to be in the expected order on little endian) and this is a test issue?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org