You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Krisztian Szucs (Jira)" <ji...@apache.org> on 2021/09/06 14:49:00 UTC

[jira] [Comment Edited] (ARROW-13914) [C++][Python] Optimize type inference when converting from python values

    [ https://issues.apache.org/jira/browse/ARROW-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410654#comment-17410654 ] 

Krisztian Szucs edited comment on ARROW-13914 at 9/6/21, 2:48 PM:
------------------------------------------------------------------

Same time ratio with both {{[1, 2, 3] * 10000}} and {{[[1, 2]] * 10000}}


was (Author: kszucs):
Same time ratio with both `[1, 2, 3] * 10000` and `[[1, 2]] * 10000`

> [C++][Python] Optimize type inference when converting from python values
> ------------------------------------------------------------------------
>
>                 Key: ARROW-13914
>                 URL: https://issues.apache.org/jira/browse/ARROW-13914
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Krisztian Szucs
>            Priority: Minor
>
> Currently we use an extensive set of checks to infer arrow type from python sequences. 
> Last time I checked using asv, the inference part had a significant overhead. 
> We could try other approaches to speed-up the type inference, see comments: https://github.com/apache/arrow/pull/11076#discussion_r702808196



--
This message was sent by Atlassian Jira
(v8.3.4#803005)