You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "the coder (JIRA)" <ji...@apache.org> on 2019/02/26 12:34:00 UTC

[jira] [Created] (PARQUET-1541) ClassCastException

the coder created PARQUET-1541:
----------------------------------

             Summary: ClassCastException
                 Key: PARQUET-1541
                 URL: https://issues.apache.org/jira/browse/PARQUET-1541
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
    Affects Versions: 1.10.1
            Reporter: the coder


Hi

I'm writing protobuf to Parquet using ProtoParquetWriter, i'm also writing to local HDFS and write only  one file.

my code running in a bit data environment.

the problem is that after about 30 min of run i'm starting to get exception like this:

 

java.lang.ClassCastException: org.apache.parquet.io.MessageColumnIO cannot be cast to org.apache.parquet.io.PrimitiveColumnIO
 at org.apache.parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.getColumnWriter(MessageColumnIO.java:432)
 at org.apache.parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.addLong(MessageColumnIO.java:449)
 at org.apache.parquet.proto.ProtoWriteSupport$LongWriter.writeRawValue(ProtoWriteSupport.java:294)
 at org.apache.parquet.proto.ProtoWriteSupport$FieldWriter.writeField(ProtoWriteSupport.java:145)
 at org.apache.parquet.proto.ProtoWriteSupport$MessageWriter.writeAllFields(ProtoWriteSupport.java:229)
 at org.apache.parquet.proto.ProtoWriteSupport$MessageWriter.writeTopLevelMessage(ProtoWriteSupport.java:194)

 

I printed the message that cause to this error and I can't see any problem with it.

any idea?

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)