You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "yugu (JIRA)" <ji...@apache.org> on 2017/06/28 20:45:00 UTC
[jira] [Updated] (PARQUET-1047) Anyway to write empty row group?
[ https://issues.apache.org/jira/browse/PARQUET-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
yugu updated PARQUET-1047:
--------------------------
Description:
[Error]
So I'm trying to write only header information (column names and such).
{code:java}
parquet::RowGroupWriter* rg_writer =
file_writer->AppendRowGroup(0);
for (i = 0; i < Cols; i++){
parquet::BoolWriter* writer = static_cast<parquet::BoolWriter*>(rg_writer->NextColumn());
writer->WriteBatch(0, nullptr, nullptr, nullptr);
}
{code}
The problem is that when trying to close the file_writer, the program throws:
{code:java}
Parquet what error: Parquet Write error: Column 3 is not complete.
{code}
[Possbility]
I know this is possible because as per [this post|https://issues.apache.org/jira/browse/PARQUET-104?jql=project%20%3D%20PARQUET%20AND%20text%20~%20%22empty%22] an empty row group was written to the back.
Tho the problem was present in parquet-mr instead of parquet-cpp, I guess it's fair to expect some feature like that.
Or maybe I don't fully understand how the system works.... would be great if you guys can point out where to look it : D
was:
[Error]
So I'm trying to write only header information (column names and such).
{code:java}
parquet::RowGroupWriter* rg_writer =
file_writer->AppendRowGroup(0);
for (i = 0; i < Cols; i++){
parquet::BoolWriter* writer = static_cast<parquet::BoolWriter*>(rg_writer->NextColumn());
writer->WriteBatch(0, nullptr, nullptr, nullptr);
}
{code}
The problem is that when trying to close the file_writer, the program throws:
{code:java}
Parquet what error: Parquet Write error: Column 3 is not complete.
{code}
[Possbility]
I know this is possible because as per [this post|https://issues.apache.org/jira/browse/PARQUET-104?jql=project%20%3D%20PARQUET%20AND%20text%20~%20%22empty%22] a empty row group was written to the back.
Tho the problem was present in parquet-mr instead of parquet-cpp, I guess it's fair to expect some feature like that.
Or maybe I don't fully understand how the system works.... would be great if you guys can point out where to look it : D
> Anyway to write empty row group?
> --------------------------------
>
> Key: PARQUET-1047
> URL: https://issues.apache.org/jira/browse/PARQUET-1047
> Project: Parquet
> Issue Type: Bug
> Components: parquet-cpp
> Affects Versions: cpp-1.1.0
> Reporter: yugu
>
> [Error]
> So I'm trying to write only header information (column names and such).
> {code:java}
> parquet::RowGroupWriter* rg_writer =
> file_writer->AppendRowGroup(0);
> for (i = 0; i < Cols; i++){
> parquet::BoolWriter* writer = static_cast<parquet::BoolWriter*>(rg_writer->NextColumn());
> writer->WriteBatch(0, nullptr, nullptr, nullptr);
> }
> {code}
> The problem is that when trying to close the file_writer, the program throws:
> {code:java}
> Parquet what error: Parquet Write error: Column 3 is not complete.
> {code}
> [Possbility]
> I know this is possible because as per [this post|https://issues.apache.org/jira/browse/PARQUET-104?jql=project%20%3D%20PARQUET%20AND%20text%20~%20%22empty%22] an empty row group was written to the back.
> Tho the problem was present in parquet-mr instead of parquet-cpp, I guess it's fair to expect some feature like that.
> Or maybe I don't fully understand how the system works.... would be great if you guys can point out where to look it : D
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)