You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "caofangkun (Created) (JIRA)" <ji...@apache.org> on 2012/01/17 03:22:40 UTC
[jira] [Created] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
----------------------------------------------------------------------------
Key: HIVE-2722
URL: https://issues.apache.org/jira/browse/HIVE-2722
Project: Hive
Issue Type: Improvement
Components: UDF
Affects Versions: 0.8.0
Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
java version "1.6.0_25"
hadoop-0.20.2-cdh3u0
hive-0.7.0-cdh3u0
Reporter: caofangkun
Priority: Minor
Fix For: 0.9.0
select instr("中文字符测试-第一行","-") from testTable limit 1;
result:19 (one Chinese Character was considered as 3 Unicode bits)
select substr("中文字符测试-第一行",1,2) from testTable limit 1;
result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-2722:
-----------------------------------
Affects Version/s: 0.9.0
Fix Version/s: (was: 0.9.0)
Unlinking from 0.9
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0, 0.9.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Attachments: HIVE-2722.patch, udf_instr_1.q
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "caofangkun (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
caofangkun updated HIVE-2722:
-----------------------------
Attachment: udf_instr_1.q
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Fix For: 0.9.0
>
> Attachments: HIVE-2722.patch, udf_instr_1.q
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "caofangkun (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13187398#comment-13187398 ]
caofangkun commented on HIVE-2722:
----------------------------------
hive -e "SELECT instr('ab中国c字d', '国') from dual limit 1"
Result : 4
hive -e "select instr('ab中国c字d', '字') from dual limit 1"
Result: 6
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Fix For: 0.9.0
>
> Attachments: HIVE-2722.patch, udf_instr_1.q
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "caofangkun (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
caofangkun updated HIVE-2722:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Fix For: 0.9.0
>
> Attachments: HIVE-2722.patch, udf_instr_1.q
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan reopened HIVE-2722:
------------------------------------
How is it resolved? Its not committed. Is it a non-issue?
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Fix For: 0.9.0
>
> Attachments: HIVE-2722.patch, udf_instr_1.q
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "caofangkun (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
caofangkun updated HIVE-2722:
-----------------------------
Release Note: change ByteBuffer to CharBuffer in GenericUDFUtil.findText
Hadoop Flags: Reviewed
Status: Patch Available (was: Open)
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Fix For: 0.9.0
>
> Attachments: HIVE-2722.patch, udf_instr_1.q
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2722) GenericUDFUtils.findText use
CharBuffer other than ByteBuffer will be better
Posted by "caofangkun (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
caofangkun updated HIVE-2722:
-----------------------------
Attachment: HIVE-2722.patch
use CharBuffer
> GenericUDFUtils.findText use CharBuffer other than ByteBuffer will be better
> ----------------------------------------------------------------------------
>
> Key: HIVE-2722
> URL: https://issues.apache.org/jira/browse/HIVE-2722
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Affects Versions: 0.8.0
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
> Reporter: caofangkun
> Priority: Minor
> Labels: udf
> Fix For: 0.9.0
>
> Attachments: HIVE-2722.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> select instr("中文字符测试-第一行","-") from testTable limit 1;
> result:19 (one Chinese Character was considered as 3 Unicode bits)
> select substr("中文字符测试-第一行",1,2) from testTable limit 1;
> result: "中文" (one Chinese Character was considered as 1 Unicode Unit )
> instr should considered one chinese character as one Unicode Unit too.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira