You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "kranthikiran (JIRA)" <ji...@apache.org> on 2011/08/29 12:37:41 UTC
[jira] [Created] (HIVE-2418) replace or translate function in hive
replace or translate function in hive
-------------------------------------
Key: HIVE-2418
URL: https://issues.apache.org/jira/browse/HIVE-2418
Project: Hive
Issue Type: Task
Components: Query Processor
Affects Versions: 0.7.0
Environment: hive-0.7.0
Reporter: kranthikiran
replace or translate function in hive
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289925#comment-13289925 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
+1 will commit if test pass.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-2418:
----------------------------------
Component/s: (was: Query Processor)
UDF
Affects Version/s: (was: 0.7.0)
0.9.0
Fix Version/s: 0.10.0
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-2418:
----------------------------------
Issue Type: New Feature (was: Task)
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283849#comment-13283849 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
What would the function do more details are needed.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291448#comment-13291448 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
Seems like this failure is not related to the check-in and it was still committed (I see it on svn). So, I guess all is well? Also, I was thinking of documenting this UDF on the Hive UDF wiki page and putting a note saying it's available starting Hive 0.10. Is that OK? Or, is the convention to wait until the release is out and then document it? (If I can still remember to do so:-))
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288319#comment-13288319 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
The code and test .q files are ready but I am having some trouble generating the .q.out files for the tests.
As a matter of fact, I am not even able to run the existing unit tests successfully. I believe it's because of the fact the source tables that these tests access e.g. "src" are not available. Do I have to edit some configuration or run some init script before I can run the test?
The command I am using to run my test is something like (this runs an existing test and fails):
ant -lib testlibs clean-test test -Dtestcase=TestCliDriver -Dqfile=udf_concat_ws.q
with an exception:
2012-06-03 19:33:21,399 ERROR exec.Task (SessionState.java:printError(400)) - Execution failed with exit status: 127
2012-06-03 19:33:21,400 ERROR exec.Task (SessionState.java:printError(400)) - Obtaining error information
2012-06-03 19:33:21,401 ERROR exec.Task (SessionState.java:printError(400)) -
Task failed!
Task ID:
Stage-1
Logs:
2012-06-03 19:33:21,401 ERROR exec.Task (SessionState.java:printError(400)) - /home/mgrover/hive_install/src/trunk/build/ql/tmp//hive.log
2012-06-03 19:33:21,402 ERROR exec.ExecDriver (MapRedTask.java:execute(286)) - Execution failed with exit status: 127
2012-06-03 19:33:21,594 ERROR ql.Driver (SessionState.java:printError(400)) - FAILED: Execution Error, return code 127 from org.apache.hadoop.hive.ql.exec.MapRedTask
Any thoughts?
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291473#comment-13291473 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
Thanks, Ed. Looks like Lars Francke beat me to it (love your dedication to documentation, Lars!). So, it's now appropriately documented at https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-StringFunctions
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-2418:
----------------------------------
Attachment: hive-2418.1.patch.txt
Removed negative test cases.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-2418:
----------------------------------
Release Note: (was: Committed. Thanks Mark. Nice job with internal documentation. )
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Joey Echeverria (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283855#comment-13283855 ]
Joey Echeverria commented on HIVE-2418:
---------------------------------------
Perhaps they meant a function similar to Postgres's translate function:
http://www.postgresql.org/docs/9.1/interactive/functions-string.html
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291465#comment-13291465 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
@Mark yes. If anything is failing the last thing committed "fails" You are more then welcome to document anything you like in the wiki. You can put a caveat about the version if you like.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Grover updated HIVE-2418:
------------------------------
Attachment: udf_translate_v3_with_3_negative_tests.patch
New version of the patch with minor changes related to formatting and checkstyle.
With three negative tests
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290555#comment-13290555 ]
Hudson commented on HIVE-2418:
------------------------------
Integrated in Hive-trunk-h0.21 #1469 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1469/])
HIVE-2418 Translate/Replace UDF (Mark Grover via egc) (Revision 1346933)
Result = FAILURE
ecapriolo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1346933
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFTranslate.java
* /hive/trunk/ql/src/test/queries/clientpositive/udf_translate.q
* /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out
* /hive/trunk/ql/src/test/results/clientpositive/udf_translate.q.out
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289059#comment-13289059 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
Mark all looks good. 2 exceptions you need to remove the @author tag and follow the hive style rules mainly 2 spaces for an indent not tabs. There should be en eclipse style template to help with this.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289533#comment-13289533 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
@Mark sorry to make you go through a couple iterations because I did only did partial reviews. One last question/comment.
Hive tries to avoid allocating new objects each evaluate if possible.
I notice in your process input method.
{noformat}
+ private String processInput(Text input) {
+ StringBuilder resultBuilder = new StringBuilder();
{noformat}
Then later.
{noformat}
+ String resultString = resultBuilder.toString();
+ return resultString;
{noformat}
It is possible to change your return type to TEXT and declare the StringBuilder and result object outside the method, then each call to evaluate can clear these objects?
If you do not believe coding the feature this way will create less temporary objects/garbage just say 'no', and I will commit as is.
Also you need only provide the version with the single negative test if you commit a new version.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288339#comment-13288339 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
Thanks, Ed. That fixed the issue!
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289914#comment-13289914 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
No worries, Ed. I thought about that too. However, StringBuilder doesn't have a clear() so in order to clear it (in a non-hacky way), we have to re-create it. Alternatively, if we use Text as the return type of processInput() and get rid of the StringBuilder object, we will have to call Text.append() to append new code points to the result. Text.append() takes a byte[] as parameter. However, all the ways I can think of right now to convert a char[] (containing the code point) to byte[] (for appending to the Text object) involve creating an immutable String object as an intermediary which kind of defeats the purpose of moving away from the StringBuilder object.
Given this information, I think it's best if we keep the StringBuilder creation and the code the way it is. Thanks!
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Grover updated HIVE-2418:
------------------------------
Attachment: udf_translate_v2_with_1_negative_test.patch
A new version of the patch with a minor bug fix related to complex argument being passed as a parameter.
This has only 1 negative test.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288329#comment-13288329 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
127 might mean hive is not able to find java aka ... no JAVA_HOME is set. Code looks great so far. You do not need so many negative tests, tests take a long time to run. 1 or 0 is more then enough.
Nice job so far.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283862#comment-13283862 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
Edward, I would be happy to work on this. Not sure how to assign this to myself but if you could do that, that would be much appreciated. Thanks!
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289115#comment-13289115 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
Thanks for reviewing, Ed. I have taken out the @author tag and fixed the indentation. Made some minor checkstyle related fixes too. Please let me know if there is anything else.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Grover updated HIVE-2418:
------------------------------
Attachment: udf_translate_v1.patch
Here is what I have so far. It's missing the .q.out files since I haven't been able to run the tests yet but I am posting it so folks can start the review.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288344#comment-13288344 ]
Mark Grover commented on HIVE-2418:
-----------------------------------
I uploaded 2 v2 patches. One has 3 negative tests, the only has 1. Take your pick on which one you'd like to deploy.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Grover updated HIVE-2418:
------------------------------
Attachment: udf_translate_v2_with_3_negative_tests.patch
A new version of the patch with a minor bug fix related to complex argument being passed as a parameter.
This has 3 negative tests.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2418) replace or translate function in hive
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan reassigned HIVE-2418:
--------------------------------------
Assignee: Mark Grover
Mark,
Assigned to you. Hack away!
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Grover updated HIVE-2418:
------------------------------
Attachment: udf_translate_v3_with_1_negative_test.patch
New version of the patch with minor changes related to formatting and checkstyle.
With only one negative test.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Attachments: udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark Grover updated HIVE-2418:
------------------------------
Status: Patch Available (was: Open)
Here is what I have so far. It's missing the .q.out files since I haven't been able to run the tests yet but I am posting it so folks can start the review.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2418) replace or translate function in hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-2418:
----------------------------------
Resolution: Fixed
Release Note: Committed. Thanks Mark. Nice job with internal documentation.
Status: Resolved (was: Patch Available)
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: New Feature
> Components: UDF
> Affects Versions: 0.9.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Assignee: Mark Grover
> Labels: cql
> Fix For: 0.10.0
>
> Attachments: hive-2418.1.patch.txt, udf_translate_v1.patch, udf_translate_v2_with_1_negative_test.patch, udf_translate_v2_with_3_negative_tests.patch, udf_translate_v3_with_1_negative_test.patch, udf_translate_v3_with_3_negative_tests.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2418) replace or translate function in
hive
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283861#comment-13283861 ]
Edward Capriolo commented on HIVE-2418:
---------------------------------------
This would be a nice issue to tackle for someone looking to break into hive.
> replace or translate function in hive
> -------------------------------------
>
> Key: HIVE-2418
> URL: https://issues.apache.org/jira/browse/HIVE-2418
> Project: Hive
> Issue Type: Task
> Components: Query Processor
> Affects Versions: 0.7.0
> Environment: hive-0.7.0
> Reporter: kranthikiran
> Labels: cql
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> replace or translate function in hive
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira