[jira] [Created] (CASSANDRA-14982) PicklingError: Can't pickle : attribute lookup cqlshlib.copyutil.ImmutableDict failed

["Vaclav (JIRA)" <ji...@apache.org>]

Vaclav created CASSANDRA-14982:
----------------------------------

             Summary: PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
                 Key: CASSANDRA-14982
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-14982
             Project: Cassandra
          Issue Type: Bug
          Components: CQL/Interpreter
         Environment: cqlsh --version
cqlsh 5.0.1

 
            Reporter: Vaclav
             Fix For: 3.11.3


Hello

I am trying to load records from file containing some very long lines (up to 180_000 characters). In some cases order of lines in file causes error
'Error from server: code=2200 [Invalid query] message="Batch too large"' catched and printed in copyutils.py, class SendingChanel in method feed(), but error is just printed, records are not loaded, no error file with unimported rows is created and import continues. cqlsh at the end returns code 0 even not all rows are imported. Even that number of imported rows is wrong, it shows number of records in file but in fact it loaded less records. So I cannot be sure, based on returned code, that copy command did load all rows. My problem is that in this case only way to find something went wrong and data are not loaded correctly is to watch for error message on screen, which is problem when this happens in very long import script (script loading many tables).

I think when not all rows are loaded correctly return code should not be 0, or when records aren't loaded it should exit with error immediatelly.


$ cqlsh 127.0.0.1 --request-timeout="3600" -e "copy woc.item_container from '/tmp/cexport/woc/item_container.csv' with escape='\"' and null=null and header=True"
Reading options from the command line: \{'header': 'True', 'null': 'null', 'escape': '"'}
Using 7 child processes

Starting copy of woc.item_container with columns [container_id, capacity, classes, instances, owner_id, type].
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
PicklingError: Can't pickle <class 'cqlshlib.copyutil.ImmutableDict'>: attribute lookup cqlshlib.copyutil.ImmutableDict failed
Processed: 38420 rows; Rate: 7455 rows/s; Avg. rate: 6881 rows/s
38420 rows imported from 1 files in 5.584 seconds (0 skipped).
$ echo $?
0



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org