You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "David Li (Jira)" <ji...@apache.org> on 2021/11/08 13:45:00 UTC
[jira] [Updated] (ARROW-14630) [C++] DCHECK in GroupByNode when
error encountered
[ https://issues.apache.org/jira/browse/ARROW-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
David Li updated ARROW-14630:
-----------------------------
Description:
[~thisisnic] found that this example crashes:
{code:java}
library(arrow)
library(dplyr)
write_dataset(group_by(iris, Species), "iris_data")open_dataset("iris_data") %>%
group_by(Species) %>%
summarise(mean(Sepal.Length)) %>%
collect() {code}
There are two bugs here:
* StopProducing is written in a way that causes a future to be finished twice, triggering a DCHECK.
* Consume() doesn't set the length of the key column batch, causing a spurious error because the group ID datum and the values datum will have different lengths.
was:
[~thisisnic] found that this example crashes:
{code:java}
library(arrow)
library(dplyr)write_dataset(group_by(iris, Species), "iris_data")open_dataset("iris_data") %>%
group_by(Species) %>%
summarise(mean(Sepal.Length)) %>%
collect() {code}
There are two bugs here:
* StopProducing is written in a way that causes a future to be finished twice, triggering a DCHECK.
* Consume() doesn't set the length of the key column batch, causing a spurious error because the group ID datum and the values datum will have different lengths.
> [C++] DCHECK in GroupByNode when error encountered
> --------------------------------------------------
>
> Key: ARROW-14630
> URL: https://issues.apache.org/jira/browse/ARROW-14630
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Affects Versions: 6.0.0
> Reporter: Nicola Crane
> Assignee: David Li
> Priority: Major
> Labels: query-engine
>
> [~thisisnic] found that this example crashes:
> {code:java}
> library(arrow)
> library(dplyr)
> write_dataset(group_by(iris, Species), "iris_data")open_dataset("iris_data") %>%
> group_by(Species) %>%
> summarise(mean(Sepal.Length)) %>%
> collect() {code}
> There are two bugs here:
> * StopProducing is written in a way that causes a future to be finished twice, triggering a DCHECK.
> * Consume() doesn't set the length of the key column batch, causing a spurious error because the group ID datum and the values datum will have different lengths.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)