[jira] [Commented] (CASSANDRA-8619) using CQLSSTableWriter gives ConcurrentModificationException

["Ajit Joglekar (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386726#comment-14386726 ] 

Ajit Joglekar commented on CASSANDRA-8619:
------------------------------------------

I am using the latest snapshot built from 2.1 branch (2.1.3-SNAPSHOT) and I am always getting the following error:
Exception in thread "main" java.lang.AssertionError: Empty partition
        at org.apache.cassandra.io.sstable.SSTableSimpleUnsortedWriter$DiskWriter.run(SSTableSimpleUnsortedWriter.java:228)

It happens at a certain point that seems to be repeatable. Only issue is I am converting 400 million records into multiple SSTables and creating small test is a challenge

Is there a work around, quick fix that I can try out locally?

Thanks,
-Ajit

> using CQLSSTableWriter gives ConcurrentModificationException
> ------------------------------------------------------------
>
>                 Key: CASSANDRA-8619
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8619
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>         Environment: sun jdk 7
> linux - ubuntu
>            Reporter: Igor Berman
>            Assignee: Benedict
>             Fix For: 2.1.3, 2.0.13
>
>         Attachments: 8619, TimeSeriesCassandraLoaderTest.java
>
>
> Using CQLSSTableWriter gives ConcurrentModificationException 
> I'm trying to load many timeseries into cassandra 2.0.11-1
> using  'org.apache.cassandra:cassandra-all:2.0.11'
> {noformat}
> java.util.ConcurrentModificationException
> 	at java.util.TreeMap$PrivateEntryIterator.nextEntry(TreeMap.java:1115)
> 	at java.util.TreeMap$ValueIterator.next(TreeMap.java:1160)
> 	at org.apache.cassandra.db.ColumnIndex$Builder.build(ColumnIndex.java:126)
> 	at org.apache.cassandra.io.sstable.SSTableWriter.rawAppend(SSTableWriter.java:202)
> 	at org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:187)
> 	at org.apache.cassandra.io.sstable.SSTableSimpleUnsortedWriter$DiskWriter.run(SSTableSimpleUnsortedWriter.java:215)
> schema
> CREATE TABLE test.sample (ts_id bigint, yr int, t timestamp, v double, tgs set<varchar>, PRIMARY KEY((ts_id,yr), t)) WITH CLUSTERING ORDER BY (t DESC) AND COMPRESSION = {'sstable_compression': 'LZ4Compressor'};
> statement:
> INSERT INTO  test.sample(ts_id, yr, t, v) VALUES (?,?,?,?)
> {noformat}
> with .withBufferSizeInMB(128); it happens more than with
> .withBufferSizeInMB(256);
> code based on http://planetcassandra.org/blog/using-the-cassandra-bulk-loader-updated/
> writer.addRow(tsId, year, new Date(time), value);
> Any suggestions will be highly appreciated



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)