You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by AI Rumman <ru...@gmail.com> on 2017/09/22 06:24:09 UTC
Cassandra copy command is giving OverflowError
Hi,
This is my first post here. I am copying my writings from
https://stackoverflow.com/questions/46354677/cassandra-copy-command-is-giving-overflowerror
I am new with Cassandra and running DataStax Cassandra 4.8.14.
My cluster is as:
3 nodes - cassandra
3 nodes - solr search by DataStax
Table:
CREATE TABLE keyspace1.table1 (
id bigint,
is_dir boolean,
dir text,
name text,
created_date timestamp,
size bigint,
solr_query text,
status text,
PRIMARY KEY (id, is_dir, dir, name)
) WITH CLUSTERING ORDER BY (is_dir ASC, dir ASC, name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'}
AND compression = {'sstable_compression':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99.0PERCENTILE';
CREATE CUSTOM INDEX keyspace1_table1_created_date_index ON
keyspace1.table1 (created_date) USING
'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
CREATE CUSTOM INDEX keyspace1_table1_size_index ON keyspace1.table1
(size) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
CREATE CUSTOM INDEX keyspace1_table1_solr_query_index ON
keyspace1.table1 (solr_query) USING
'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
CREATE CUSTOM INDEX keyspace1_table1_status_index ON keyspace1.table1
(status) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
Command executed:
COPY keyspace1.table1 TO '/tmp/table1.csv';
I was trying to execute copy command and got the following error:
<stdin>:10:Error for (None, -9207222088349382333): OverflowError -
date value out of range (will try again later attempt 1 of 5)
<stdin>:10:Error for (-2699117314734179807, -2639913056120220671):
NoHostAvailable - ('Unable to complete the operation against any
hosts', {}) (permanently given up after 95000 rows and 1 attempts)
<stdin>:10:Error for (4414337294902011474, 4418434771303296337):
NoHostAvailable - ('Unable to complete the operation against any
hosts', {}) (will try again later attempt 1 of 5)
<stdin>:10:Error for (-835790340821162882, -820685939947495393):
NoHostAvailable - ('Unable to complete the operation against any
hosts', {}) (permanently given up after 49000 rows and 1 attempts)
Can anyone please tell me what it means?
Thanks.
Re: [EXTERNAL] Cassandra copy command is giving OverflowError
Posted by AI Rumman <ru...@gmail.com>.
That did not work. It was giving me the same error.
However I came to know that it can happen if there is out of range date
values.
Now I ran the following query and got result:
select id,created_date from table1 where solr_query =
> '{"q":"*:*","sort":"created_date desc"}' limit 2;
Traceback (most recent call last):
> File "/usr/share/dse/resources/cassandra/bin/cqlsh", line 1124, in
> perform_simple_statement
> rows = self.session.execute(statement, trace=self.tracing_enabled)
> File
> "/usr/share/dse/resources/cassandra/bin/../lib/cassandra-driver-internal-only-2.7.2-2fc8a2b.zip/cassandra-driver-2.7.2-2fc8a2b/cassandra/cluster.py",
> line 1602, in execute
> result = future.result()
> File
> "/usr/share/dse/resources/cassandra/bin/../lib/cassandra-driver-internal-only-2.7.2-2fc8a2b.zip/cassandra-driver-2.7.2-2fc8a2b/cassandra/cluster.py",
> line 3347, in result
> raise self._final_exception
> OverflowError: date value out of range
How can I identify the rows which have incorrect date values?
Thanks.
On Fri, Sep 22, 2017 at 12:50 PM, Mohapatra, Kishore <
Kishore.Mohapatra@nuance.com> wrote:
> Try this.
>
>
>
> COPY keyspace1.table1 TO '/tmp/table1.csv' WITH PAGETIMEOUT=40 AND
> PAGESIZE=20;
>
>
>
> Thanks
>
>
>
> *Kishore Mohapatra*
>
> Principal Operations DBA
>
> Seattle, WA
>
> Email : kishore.mohapatra@nuance.com
>
>
>
>
>
> *From:* AI Rumman [mailto:rummandba@gmail.com]
> *Sent:* Thursday, September 21, 2017 11:24 PM
> *To:* user@cassandra.apache.org
> *Subject:* [EXTERNAL] Cassandra copy command is giving OverflowError
>
>
>
> Hi,
>
> This is my first post here. I am copying my writings from
>
> https://stackoverflow.com/questions/46354677/cassandra-
> copy-command-is-giving-overflowerror
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com_questions_46354677_cassandra-2Dcopy-2Dcommand-2Dis-2Dgiving-2Doverflowerror&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=O20_rcIS1QazTO3_J10I1cPIygxnuBZ4sUCz1TS16XE&m=WVMxYLsaSHTdagCzuPZ_weE2J4Hq1UK7pl-QUvvm-Qk&s=OSU0O7iolFVo5R76vXgSBXzY33AbVkHUF4lCBVb8jz4&e=>
>
>
> I am new with Cassandra and running DataStax Cassandra 4.8.14.
>
> My cluster is as:
>
> 3 nodes - cassandra
>
> 3 nodes - solr search by DataStax
>
> Table:
>
> CREATE TABLE keyspace1.table1 (
>
> id bigint,
>
> is_dir boolean,
>
> dir text,
>
> name text,
>
> created_date timestamp,
>
> size bigint,
>
> solr_query text,
>
> status text,
>
> PRIMARY KEY (id, is_dir, dir, name)
>
> ) WITH CLUSTERING ORDER BY (is_dir ASC, dir ASC, name ASC)
>
> AND bloom_filter_fp_chance = 0.01
>
> AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
>
> AND comment = ''
>
> AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'}
>
> AND compression = {'sstable_compression': 'org.apache.cassandra.io.compress.LZ4Compressor'}
>
> AND dclocal_read_repair_chance = 0.1
>
> AND default_time_to_live = 0
>
> AND gc_grace_seconds = 864000
>
> AND max_index_interval = 2048
>
> AND memtable_flush_period_in_ms = 0
>
> AND min_index_interval = 128
>
> AND read_repair_chance = 0.0
>
> AND speculative_retry = '99.0PERCENTILE';
>
> CREATE CUSTOM INDEX keyspace1_table1_created_date_index ON keyspace1.table1 (created_date) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
>
> CREATE CUSTOM INDEX keyspace1_table1_size_index ON keyspace1.table1 (size) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
>
> CREATE CUSTOM INDEX keyspace1_table1_solr_query_index ON keyspace1.table1 (solr_query) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
>
> CREATE CUSTOM INDEX keyspace1_table1_status_index ON keyspace1.table1 (status) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
>
> Command executed:
>
> COPY keyspace1.table1 TO '/tmp/table1.csv';
>
> I was trying to execute copy command and got the following error:
>
> <stdin>:10:Error for (None, -9207222088349382333): OverflowError - date value out of range (will try again later attempt 1 of 5)
>
> <stdin>:10:Error for (-2699117314734179807, -2639913056120220671): NoHostAvailable - ('Unable to complete the operation against any hosts', {}) (permanently given up after 95000 rows and 1 attempts)
>
> <stdin>:10:Error for (4414337294902011474, 4418434771303296337): NoHostAvailable - ('Unable to complete the operation against any hosts', {}) (will try again later attempt 1 of 5)
>
> <stdin>:10:Error for (-835790340821162882, -820685939947495393): NoHostAvailable - ('Unable to complete the operation against any hosts', {}) (permanently given up after 49000 rows and 1 attempts)
>
> Can anyone please tell me what it means?
>
> Thanks.
>
RE: [EXTERNAL] Cassandra copy command is giving OverflowError
Posted by "Mohapatra, Kishore" <Ki...@nuance.com>.
Try this.
COPY keyspace1.table1 TO '/tmp/table1.csv' WITH PAGETIMEOUT=40 AND PAGESIZE=20;
Thanks
Kishore Mohapatra
Principal Operations DBA
Seattle, WA
Email : kishore.mohapatra@nuance.com<ma...@nuance.com>
From: AI Rumman [mailto:rummandba@gmail.com]
Sent: Thursday, September 21, 2017 11:24 PM
To: user@cassandra.apache.org
Subject: [EXTERNAL] Cassandra copy command is giving OverflowError
Hi,
This is my first post here. I am copying my writings from
https://stackoverflow.com/questions/46354677/cassandra-copy-command-is-giving-overflowerror<https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com_questions_46354677_cassandra-2Dcopy-2Dcommand-2Dis-2Dgiving-2Doverflowerror&d=DwMFaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=O20_rcIS1QazTO3_J10I1cPIygxnuBZ4sUCz1TS16XE&m=WVMxYLsaSHTdagCzuPZ_weE2J4Hq1UK7pl-QUvvm-Qk&s=OSU0O7iolFVo5R76vXgSBXzY33AbVkHUF4lCBVb8jz4&e=>
I am new with Cassandra and running DataStax Cassandra 4.8.14.
My cluster is as:
3 nodes - cassandra
3 nodes - solr search by DataStax
Table:
CREATE TABLE keyspace1.table1 (
id bigint,
is_dir boolean,
dir text,
name text,
created_date timestamp,
size bigint,
solr_query text,
status text,
PRIMARY KEY (id, is_dir, dir, name)
) WITH CLUSTERING ORDER BY (is_dir ASC, dir ASC, name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
AND comment = ''
AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy'}
AND compression = {'sstable_compression': 'org.apache.cassandra.io.compress.LZ4Compressor'}
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99.0PERCENTILE';
CREATE CUSTOM INDEX keyspace1_table1_created_date_index ON keyspace1.table1 (created_date) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
CREATE CUSTOM INDEX keyspace1_table1_size_index ON keyspace1.table1 (size) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
CREATE CUSTOM INDEX keyspace1_table1_solr_query_index ON keyspace1.table1 (solr_query) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
CREATE CUSTOM INDEX keyspace1_table1_status_index ON keyspace1.table1 (status) USING 'com.datastax.bdp.search.solr.Cql3SolrSecondaryIndex';
Command executed:
COPY keyspace1.table1 TO '/tmp/table1.csv';
I was trying to execute copy command and got the following error:
<stdin>:10:Error for (None, -9207222088349382333): OverflowError - date value out of range (will try again later attempt 1 of 5)
<stdin>:10:Error for (-2699117314734179807, -2639913056120220671): NoHostAvailable - ('Unable to complete the operation against any hosts', {}) (permanently given up after 95000 rows and 1 attempts)
<stdin>:10:Error for (4414337294902011474, 4418434771303296337): NoHostAvailable - ('Unable to complete the operation against any hosts', {}) (will try again later attempt 1 of 5)
<stdin>:10:Error for (-835790340821162882, -820685939947495393): NoHostAvailable - ('Unable to complete the operation against any hosts', {}) (permanently given up after 49000 rows and 1 attempts)
Can anyone please tell me what it means?
Thanks.