You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Taraka Rama Rao Lethavadla (Jira)" <ji...@apache.org> on 2021/05/21 14:26:00 UTC
[jira] [Updated] (HIVE-25150) Tab characters are not removed before
decimal conversion similar to space character which is fixed as part of
HIVE-24378
[ https://issues.apache.org/jira/browse/HIVE-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Taraka Rama Rao Lethavadla updated HIVE-25150:
----------------------------------------------
Description:
Test case:
column values with space and tab character
{noformat}
bash-4.2$ cat data/files/test_dec_space.csv
1,0
2, 1
3, 2{noformat}
{noformat}
create external table test_dec_space (id int, value decimal) ROW FORMAT DELIMITED
FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
{noformat}
output of select * from test_dec_space would be
{noformat}
1 0
2 1
3 NULL{noformat}
The behaviour in MySQL when there is tab & space characters in decimal values
bash-4.2$ cat /tmp/insert.csv
"1","aa",11.88
"2","bb", 99.88
"4","dd", 209.88
MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
Query OK, 3 rows affected, 3 warnings (0.00 sec)
Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
MariaDB [test]> select * from t2;
+-------+-----++-------
|id|name|score|
+-------+-----++-------
|1|aa|12|
|2|bb|100|
|4|dd|210|
+-------+-----++-------
3 rows in set (0.00 sec)
So hive should not show up NULL
was:
Test case:
column values with space and tab character
bash-4.2$ cat data/files/test_dec_space.csv
1,0
2, 1
3, 2
{noformat}
create external table test_dec_space (id int, value decimal) ROW FORMAT DELIMITED
FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
{noformat}
output of select * from test_dec_space would be
{noformat}
1 0
2 1
3 NULL{noformat}
The behaviour in MySQL when there is tab & space characters in decimal values
bash-4.2$ cat /tmp/insert.csv
"1","aa",11.88
"2","bb", 99.88
"4","dd", 209.88
MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
Query OK, 3 rows affected, 3 warnings (0.00 sec)
Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
MariaDB [test]> select * from t2;
+------+------+-------+
| id | name | score |
+------+------+-------+
| 1 | aa | 12 |
| 2 | bb | 100 |
| 4 | dd | 210 |
+------+------+-------+
3 rows in set (0.00 sec)
So hive should not show up NULL
> Tab characters are not removed before decimal conversion similar to space character which is fixed as part of HIVE-24378
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-25150
> URL: https://issues.apache.org/jira/browse/HIVE-25150
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 4.0.0
> Reporter: Taraka Rama Rao Lethavadla
> Priority: Major
>
> Test case:
> column values with space and tab character
> {noformat}
> bash-4.2$ cat data/files/test_dec_space.csv
> 1,0
> 2, 1
> 3, 2{noformat}
> {noformat}
> create external table test_dec_space (id int, value decimal) ROW FORMAT DELIMITED
> FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
> {noformat}
>
> output of select * from test_dec_space would be
>
> {noformat}
> 1 0
> 2 1
> 3 NULL{noformat}
> The behaviour in MySQL when there is tab & space characters in decimal values
> bash-4.2$ cat /tmp/insert.csv
> "1","aa",11.88
> "2","bb", 99.88
> "4","dd", 209.88
> MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
> Query OK, 3 rows affected, 3 warnings (0.00 sec)
> Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
> MariaDB [test]> select * from t2;
> +-------+-----++-------
> |id|name|score|
> +-------+-----++-------
> |1|aa|12|
> |2|bb|100|
> |4|dd|210|
> +-------+-----++-------
> 3 rows in set (0.00 sec)
> So hive should not show up NULL
--
This message was sent by Atlassian Jira
(v8.3.4#803005)