You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Tristan Davolt (Jira)" <ji...@apache.org> on 2020/01/20 21:56:00 UTC
[jira] [Created] (PARQUET-1773) Parquet file in invalid state while
writing to S3 when calling ParquetWriter.write
Tristan Davolt created PARQUET-1773:
---------------------------------------
Summary: Parquet file in invalid state while writing to S3 when calling ParquetWriter.write
Key: PARQUET-1773
URL: https://issues.apache.org/jira/browse/PARQUET-1773
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.10.0
Reporter: Tristan Davolt
This may be related to [PARQUET-632|https://issues.apache.org/jira/browse/PARQUET-632]. I am also writing parquet to S3, but I am calling ParquetWriter.write directly.
Exception:
java.io.IOException
Message:
The file being written is in an invalid state. Probably caused by an error thrown previously. Current state: BLOCK
Stacktrace:
{code:java}
org.apache.parquet.hadoop.ParquetFileWriter$STATE.error(ParquetFileWriter.java:168)org.apache.parquet.hadoop.ParquetFileWriter$STATE.startBlock(ParquetFileWriter.java:160)org.apache.parquet.hadoop.ParquetFileWriter.startBlock(ParquetFileWriter.java:291)org.apache.parquet.hadoop.InternalParquetRecordWriter.flushRowGroupToStore(InternalParquetRecordWriter.java:171)org.apache.parquet.hadoop.InternalParquetRecordWriter.close(InternalParquetRecordWriter.java:114)org.apache.parquet.hadoop.ParquetWriter.close(ParquetWriter.java:308)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)