[jira] [Commented] (HDDS-7501) Spark 3.2.2 and Ozone integration

["Wei-Chiu Chuang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDDS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17716353#comment-17716353 ] 

Wei-Chiu Chuang commented on HDDS-7501:
---------------------------------------

I believe this is fixed by HDDS-6926 and in release 1.3.0.

> Spark 3.2.2 and Ozone integration
> ---------------------------------
>
>                 Key: HDDS-7501
>                 URL: https://issues.apache.org/jira/browse/HDDS-7501
>             Project: Apache Ozone
>          Issue Type: Bug
>    Affects Versions: 1.2.1
>         Environment: * spark 3.2.2
>  * hadoop 3.1.2
>  * ozone 1.2.1
>            Reporter: Dmitry Kravchuk
>            Priority: Major
>              Labels: spark
>             Fix For: 1.2.1
>
>         Attachments: pyspark_ozone_1.txt
>
>
> We've integrated Ozone with HDFS and everything works fine from the shell - it's possible to use hdfs dfs -ls command for ozone filies.
> When we're trying to read files with spark it fails with strange error of class incomplitance.
> {code:java}
> org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OMRequest cannot be cast to org.apache.hadoop.shaded.com.google.protobuf.Message{code}
> Application log is attached.[^pyspark_ozone_1.txt]
> Can you please help?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org