[jira] [Resolved] (KUDU-1891) Uploading 100,000 rows x 20 columns results in not enough mutation buffer space when uploading data using Python

["Todd Lipcon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KUDU-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon resolved KUDU-1891.
-------------------------------
       Resolution: Not A Problem
    Fix Version/s: n/a

> Uploading 100,000 rows x 20 columns results in not enough mutation buffer space when uploading data using Python
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: KUDU-1891
>                 URL: https://issues.apache.org/jira/browse/KUDU-1891
>             Project: Kudu
>          Issue Type: Bug
>          Components: python
>    Affects Versions: 1.2.0
>         Environment: Ubuntu 16.04
>            Reporter: Roger
>             Fix For: n/a
>
>
> The table had one timestamp column and 19 single precision columns with only the timestamp as the primary key.
> The tuples were uploaded in the following way:
> {code}
> table = client.table('new_table')
> session = client.new_session()
> for t in tuples[:100000]:
>     session.apply(table.new_insert(t))
> {code}
> Please note that the default flush mode in Python is manual.
> This resulted in the bellow error:
> {code}
> ---------------------------------------------------------------------------
> KuduBadStatus                             Traceback (most recent call last)
> <ipython-input-8-0dc8979dc1a0> in <module>()
>       2 session = client.new_session()
>       3 for t in tuples[:100000]:
> ----> 4     session.apply(table.new_insert(t))
>       5 
>       6 try:
> /root/anaconda3/envs/sifr-repository/lib/python3.5/site-packages/kudu/client.pyx in kudu.client.Session.apply (kudu/client.cpp:15185)()
> /root/anaconda3/envs/sifr-repository/lib/python3.5/site-packages/kudu/client.pyx in kudu.client.WriteOperation.add_to_session (kudu/client.cpp:27992)()
> /root/anaconda3/envs/sifr-repository/lib/python3.5/site-packages/kudu/errors.pyx in kudu.errors.check_status (kudu/errors.cpp:1314)()
> KuduBadStatus: b'Incomplete: not enough mutation buffer space remaining for operation: required additional 225 when 7339950 of 7340032 already used'
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)