You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cassandra.apache.org by Micha <mi...@fantasymail.de> on 2017/07/13 09:43:57 UTC
possible race in copy from csv, cassandra 3.9
I use "copy from" to import a bunch of csv files, each with 1000000 rows
(exported by "copy to" from another table)
There is a chance that the copy from just hangs, after importing 9995000
lines, doing nothing, waiting forever.
Could this be a race in the copy code? I use NUMPROCESSES=6, in bash a
"ps" shows 8 started cqlsh.py processes. For me it seems that all of the
processes are waiting for the signal that the import is done, but they
are all blocked. So they wait forever.
Checking random records of the imported file indicate that it is
completely imported.
The logs show no errors.
Any suggestions?
Thanks,
Michael
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@cassandra.apache.org
For additional commands, e-mail: dev-help@cassandra.apache.org
Re: possible race in copy from csv, cassandra 3.9
Posted by Stefania Alborghetti <st...@datastax.com>.
Looks similar to what was fixed by CASSANDRA-12740
<https://issues.apache.org/jira/browse/CASSANDRA-12740>, released in 3.10.
On Thu, Jul 13, 2017 at 5:43 PM, Micha <mi...@fantasymail.de> wrote:
> I use "copy from" to import a bunch of csv files, each with 1000000 rows
> (exported by "copy to" from another table)
>
> There is a chance that the copy from just hangs, after importing 9995000
> lines, doing nothing, waiting forever.
>
> Could this be a race in the copy code? I use NUMPROCESSES=6, in bash a
> "ps" shows 8 started cqlsh.py processes. For me it seems that all of the
> processes are waiting for the signal that the import is done, but they
> are all blocked. So they wait forever.
>
> Checking random records of the imported file indicate that it is
> completely imported.
>
> The logs show no errors.
>
> Any suggestions?
>
> Thanks,
> Michael
>
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@cassandra.apache.org
> For additional commands, e-mail: dev-help@cassandra.apache.org
>
>
--
<http://www.datastax.com/>
STEFANIA ALBORGHETTI
Software engineer | +852 6114 9265 | stefania.alborghetti@datastax.com
[image: http://www.datastax.com/cloud-applications]
<http://www.datastax.com/cloud-applications>