[GitHub] spark issue #20235: [Spark-22887][ML][TESTS][WIP] ML test for StructuredStre...

[smurakozi <gi...@git.apache.org>]

Github user smurakozi commented on the issue:

    https://github.com/apache/spark/pull/20235
  
    @WeichenXu123  Executing `test("FPGrowth fit and transform with different data types")` with Byte data type produces an 
    `org.apache.spark.sql.AnalysisException: cannot resolve 'CAST(`items` AS BINARY)' due to data type mismatch: cannot cast array<tinyint> to binary`
    I don't remember all the details, but somewhere (catalyst?) the Array[Byte] has special treatment as Binary. When `testTransformerOnStreamData` tries to collect the data from the dataframe to test it as a stream this special casing causes the above mentioned exception.



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org