zzh created ARROW-15881:
---------------------------
Summary: [c++] call parquet::arrow::WriteTable in a child thread get segmentation fault
Key: ARROW-15881
URL: https://issues.apache.org/jira/browse/ARROW-15881
Project: Apache Arrow
Issue Type: Bug
Components: C++
Affects Versions: 7.0.0
Environment: CentOS7,gcc7.0+
Reporter: zzh
Attachments: message.png
When I try to use Arrow to write parquet files, I encounter a error. The parquet::arrow::WriteTable out child thread can call successful, but parquet::arrow::WriteTable in child thread while cause Segmentation fault.
The code like this:
{code:cpp}
arrow::Int64Builder test_a;
for (int i = 0; i < 1e7; ++i) {
PARQUET_THROW_NOT_OK(test_a.Append(i));
}
auto sc = arrow::schema({arrow::field("A", arrow::int64())});
auto table = arrow::Table::Make(sc,{test_a.Finish().ValueOrDie()});
const string &fileid = sole::uuid4().str();
string filename = "test.parq";
try {
std::shared_ptr<arrow::io::FileOutputStream> outfile;
PARQUET_ASSIGN_OR_THROW(
outfile,arrow::io::FileOutputStream::Open(filename)
);
PARQUET_THROW_NOT_OK(
parquet::arrow::WriteTable(*table, arrow::default_memory_pool(), outfile, table->num_rows())
);
} catch (exception &ex) {
cout << ex.what() << endl;
}
shared_ptr<std::thread> thread = make_shared<std::thread>([=]() {
arrow::Int64Builder test_a;
for (int i = 0; i < 1e7; ++i) {
PARQUET_THROW_NOT_OK(test_a.Append(i));
}
auto sc = arrow::schema({arrow::field("A", arrow::int64())});
auto table = arrow::Table::Make(sc,{test_a.Finish().ValueOrDie()});
const string &fileid = sole::uuid4().str();
string filename = "test.parq";
try {
std::shared_ptr<arrow::io::FileOutputStream> outfile;
PARQUET_ASSIGN_OR_THROW(
outfile,arrow::io::FileOutputStream::Open(filename)
);
PARQUET_THROW_NOT_OK(
parquet::arrow::WriteTable(*table, arrow::default_memory_pool(), outfile, table->num_rows())
);
} catch (exception &ex) {
cout << ex.what() << endl;
}
};{code}
The stack message is in the picture in attachment.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)