You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2012/11/07 20:46:13 UTC
[jira] [Created] (PIG-3039) Not possible to use custom version of
jackson jars
Rohini Palaniswamy created PIG-3039:
---------------------------------------
Summary: Not possible to use custom version of jackson jars
Key: PIG-3039
URL: https://issues.apache.org/jira/browse/PIG-3039
Project: Pig
Issue Type: Bug
Affects Versions: 0.10.0
Reporter: Rohini Palaniswamy
User is trying
register jackson_core_asl-1.9.4_1.jar;
register jackson_mapper_asl-1.9.4_1.jar;
register jackson_xc-1.9.4_1.jar;
But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-3039:
------------------------------------
Resolution: Fixed
Fix Version/s: 0.11
Status: Resolved (was: Patch Available)
Thanks Cheolsoo for the ivy download patch and the review. Committed the patch to 0.11 and trunk.
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.11, 0.12
>
> Attachments: PIG-3039-download-jackson.patch, PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499153#comment-13499153 ]
Rohini Palaniswamy commented on PIG-3039:
-----------------------------------------
Thanks Cheolsoo. I will use your patch while checking in. Its more clean and better. Tested it out and it works fine.
bq.I would also like to include this in 0.11 if others agree as this is a regression from 0.9.
Any thoughts on this?
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-download-jackson.patch, PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494320#comment-13494320 ]
Rohini Palaniswamy commented on PIG-3039:
-----------------------------------------
You mean how it works in 0.9? It is simple. Before PIG-2457, jackson was not packaged as part of pig.jar. So users could register their version of jackson jar in pig with mapreduce.user.classpath.first=true to avoid hadoop's jackson jars being in classpath.
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Julien Le Dem (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499351#comment-13499351 ]
Julien Le Dem commented on PIG-3039:
------------------------------------
Pig-3039 solves it in the backend while pig-3043 solves in the frontend
Julien
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-download-jackson.patch, PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Julien Le Dem (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494325#comment-13494325 ]
Julien Le Dem commented on PIG-3039:
------------------------------------
I see. Thanks!
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499313#comment-13499313 ]
Dmitriy V. Ryaboy commented on PIG-3039:
----------------------------------------
Doesn't PIG-3043 solve the problem in a general way?
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-download-jackson.patch, PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499156#comment-13499156 ]
Cheolsoo Park commented on PIG-3039:
------------------------------------
I am +1 for adding this to 0.11. In fact, I ran a full unit test and e2e with your patch and didn't find any regression.
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-download-jackson.patch, PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-3039:
-------------------------------
Attachment: PIG-3039-download-jackson.patch
Hi Rohini,
The patch looks good. My only concern is that we have to remember this test case when we bump jackson to 1.9.9 in future.
I suggest that we should at least make a comment in ivy/libraries.properties regarding this test case so that we won't forget to update this test case when we update the version of jackson.
In addition, wouldn't it better to download the jackson 1.9.9 binaries using ant instead of checking them in? I made a quick patch that does this, so please feel free to use it if you like to. This is just a suggestion, and I won't insist.
Thanks!
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-download-jackson.patch, PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-3039:
------------------------------------
Fix Version/s: 0.12
Assignee: Rohini Palaniswamy
Status: Patch Available (was: Open)
I would also like to include this in 0.11 if others agree as this is a regression from 0.9.
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Julien Le Dem (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494318#comment-13494318 ]
Julien Le Dem commented on PIG-3039:
------------------------------------
Could you explain how it was working before ? Were the classes from the registered jar added to the same job jar and overwriting the pig.jar classes?
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12
>
> Attachments: PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-3039) Not possible to use custom version of
jackson jars
Posted by "Rohini Palaniswamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-3039:
------------------------------------
Attachment: PIG-3039-trunk.patch
Attached patch fixes the scenario. Patch does not include jackson jars that need to be added to test/resources directory.
{noformat}
ls test/resources/
jackson-core-asl-1.9.9.jar jackson-mapper-asl-1.9.9.jar org
{noformat}
[~alangates],
The test case I added needs a specific version of jackson jars in the test/resources folder. Just wanted to check with you if there is any restriction to checking in jars like that.
> Not possible to use custom version of jackson jars
> --------------------------------------------------
>
> Key: PIG-3039
> URL: https://issues.apache.org/jira/browse/PIG-3039
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Rohini Palaniswamy
> Attachments: PIG-3039-trunk.patch
>
>
> User is trying
> register jackson_core_asl-1.9.4_1.jar;
> register jackson_mapper_asl-1.9.4_1.jar;
> register jackson_xc-1.9.4_1.jar;
> But pig.jar/pig-withouthadoop.jar has jackson jars and JarManager packages the jackson from pig.jar into job.jar(PIG-2457). We could not find any possible workaround with mapreduce framework to put the user jar first in the classpath as job.jar always takes precedence.
> The pig script works fine with 0.9 and is a regression in 0.10.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira