You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Ekaterina Dimitrova (Jira)" <ji...@apache.org> on 2020/08/06 23:30:00 UTC

[jira] [Comment Edited] (CASSANDRA-15990) Running CQL command with non-ASCII values raises UnicodeDecodeError

    [ https://issues.apache.org/jira/browse/CASSANDRA-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172725#comment-17172725 ] 

Ekaterina Dimitrova edited comment on CASSANDRA-15990 at 8/6/20, 11:29 PM:
---------------------------------------------------------------------------

Trunk [patch |https://github.com/ekaterinadimitrova2/cassandra/tree/CASSANDRA-15990], new basic [dtests |https://github.com/ekaterinadimitrova2/cassandra-dtest/tree/CASSANDRA-15990] added
 _I will squash the commits and remove the circle custom config commit when the patch get approval to be committed._
 *All CQLSH tests pass successfully on trunk, probably good to run them also on the other branches in Jenkins, even if I was told the issue was seen only on trunk*
 CI run:
 [JAVA 8 |https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/295/workflows/168d88ab-f55f-4560-a23e-8243aff7b1bd]
 _test_resume_stopped_build - materialized_views_test.TestMaterializedViews_ - no ticket and no Jenkins failures but it doesn't seem related; I will open a ticket to be investigated
 _test_disk_balance_after_boundary_change_lcs - disk_balance_test.TestDiskBalance_ - not failing in Jenkins but there is an old ticket pointing to the same issue from 2018; could be used, still open - CASSANDRA-14030
 _test_node_cannot_join_as_hibernating_node_without_replace_address - bootstrap_test.TestBootstrap_ - CASSANDRA-16030
 _test_dead_sync_initiator - repair_tests.repair_test.TestRepair_ - CASSANDRA-15963
 _testQueueWhenPoolFullStrategy - org.apache.cassandra.service.ActiveRepairServiceTest_ - no failures in Jenkins; no tickets; I will open a new one as it looks a legit issue, not related to this patch
 _test_cleanup - bootstrap_test.TestBootstrap_ - no failures in Jenkins; no tickets; I will open a new one as it looks a legit issue, not related to this patch

[Java 11 |https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/295/workflows/2604dffe-9cc2-46ef-a7ed-09a9d9aecfbe]:

_test_node_cannot_join_as_hibernating_node_without_replace_address_ - CASSANDRA-16030
 _test_dead_sync_initiator - repair_tests.repair_test.TestRepair_ - CASSANDRA-15963
 _testMessagePurging - org.apache.cassandra.net.ConnectionTest_ - known issue from CASSANDRA-15338, [~yifanc] follows up on it

 

[~djoshi], [~dcapwell] - do you mind to review it, please, if you have some free time? 


was (Author: e.dimitrova):
Trunk [patch |https://github.com/ekaterinadimitrova2/cassandra/tree/CASSANDRA-15990], new basic [dtests |https://github.com/ekaterinadimitrova2/cassandra-dtest/tree/CASSANDRA-15990] added
 _I will squash the commits and remove the circle custom config commit when the patch get approval to be committed._
 *All CQLSH tests pass successfully on trunk, probably good to run them also on the other branches in Jenkins, even if I was told the issue was seen only on trunk*
 CI run:
 [JAVA 8 |https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/295/workflows/168d88ab-f55f-4560-a23e-8243aff7b1bd]
 _test_resume_stopped_build - materialized_views_test.TestMaterializedViews_ - no ticket and no Jenkins failures but it doesn't seem related; I will open a ticket to be investigated
 _test_disk_balance_after_boundary_change_lcs - disk_balance_test.TestDiskBalance_ - not failing in Jenkins but there is an old ticket pointing to the same issue from 2018; could be used, still open - CASSANDRA-14030
 _test_node_cannot_join_as_hibernating_node_without_replace_address - bootstrap_test.TestBootstrap_ - CASSANDRA-16030
 _test_dead_sync_initiator - repair_tests.repair_test.TestRepair_ - CASSANDRA-15963
 _testQueueWhenPoolFullStrategy - org.apache.cassandra.service.ActiveRepairServiceTest_ - no failures in Jenkins; no tickets; I will open a new one as it looks a legit issue, not related to this patch
 _test_cleanup - bootstrap_test.TestBootstrap_ - no failures in Jenkins; no tickets; I will open a new one as it looks a legit issue, not related to this patch

[Java 11 |https://app.circleci.com/pipelines/github/ekaterinadimitrova2/cassandra/295/workflows/2604dffe-9cc2-46ef-a7ed-09a9d9aecfbe]:

_test_node_cannot_join_as_hibernating_node_without_replace_address_ - CASSANDRA-16030
 _test_dead_sync_initiator - repair_tests.repair_test.TestRepair_ - CASSANDRA-15963
 _testMessagePurging - org.apache.cassandra.net.ConnectionTest_ - known issue from CASSANDRA-15338, [~yifanc] follows up on it

> Running CQL command with non-ASCII values raises UnicodeDecodeError
> -------------------------------------------------------------------
>
>                 Key: CASSANDRA-15990
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-15990
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tool/cqlsh
>            Reporter: Joseph Chu
>            Assignee: Ekaterina Dimitrova
>            Priority: Normal
>             Fix For: 4.0-beta
>
>
> There are INSERT statements that contains non-ASCII values that have run fine in Cassandra 3.11, but now raises a UnicodeDecodeError when I try executing them in 4.0-alpha4 and 4.0-beta1. 
> Example input and output:
> {code:java}
> echo $LANG
> en_US.UTF-8
> $ cqlsh --debug
> Using CQL driver: <module 'cassandra' from '/usr/share/cassandra/bin/../lib/cassandra-driver-internal-only-3.23.0.post0-1a184b99.zip/cassandra-driver-3.23.0.post0-1a184b99/cassandra/__init__.py'>
> Using connect timeout: 5 seconds
> Using 'utf-8' encoding
> Using ssl: False
> Connected to Cassandra Cluster at 127.0.0.1:9042.
> [cqlsh 5.0.1 | Cassandra 4.0-beta1 | CQL spec 3.4.5 | Native protocol v4]
> Use HELP for help.
> cqlsh> CREATE KEYSPACE killr_video WITH replication = {'class': 'NetworkTopologyStrategy', 'DC-Houston': 1};
> cqlsh> USE killr_video;
> cqlsh:killr_video> CREATE TABLE movies_by_genre ( genre TEXT, title TEXT, year INT, duration INT, avg_rating FLOAT, country TEXT, PRIMARY KEY ((genre), title, year));
> cqlsh:killr_video> INSERT INTO movies_by_genre (genre, title, year, duration, avg_rating, country)
>  ... VALUES ('Action', 'The Extraordinary Adventures of Adèle Blanc-Sec', 2010, 107, 6.30, 'France');
> Traceback (most recent call last):
>  File "/usr/share/cassandra/bin/cqlsh.py", line 937, in onecmd
>  self.handle_statement(st, statementtext)
>  File "/usr/share/cassandra/bin/cqlsh.py", line 962, in handle_statement
>  readline.add_history(new_hist)
> UnicodeEncodeError: 'ascii' codec can't encode character u'\xe8' in position 134: ordinal not in range(128){code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org