[jira] [Created] (HIVE-11129) Issue a warning when copied from UTF-8 to ISO 8859-1

["Aihua Xu (JIRA)" <ji...@apache.org>]

Aihua Xu created HIVE-11129:
-------------------------------

             Summary: Issue a warning when copied from UTF-8 to ISO 8859-1
                 Key: HIVE-11129
                 URL: https://issues.apache.org/jira/browse/HIVE-11129
             Project: Hive
          Issue Type: Bug
          Components: File Formats
            Reporter: Aihua Xu


Copying data from a table using UTF-8 encoding to one using ISO 8859-1 encoding causes data corruption without warning.

{noformat}
CREATE TABLE person_utf8 (name STRING)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' 
WITH SERDEPROPERTIES ('serialization.encoding'='UTF8');
{noformat}

Put the following data in the table:
Müller,Thomas
Jørgensen,Jørgen
Vega,Andrés
中村,浩人
אביה,נועם

{noformat}
CREATE TABLE person_2 ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' 
WITH SERDEPROPERTIES ('serialization.encoding'='ISO8859_1')
AS select * from person_utf8;
{noformat}

expected to get mangled data but we should give a warning. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)