You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org> on 2014/02/18 21:57:21 UTC

[jira] [Comment Edited] (PIG-3558) ORC support for Pig

    [ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904574#comment-13904574 ] 

Dmitriy V. Ryaboy edited comment on PIG-3558 at 2/18/14 8:55 PM:
-----------------------------------------------------------------

I am pro adding ORC support in Pig, but against introducing massive dependencies.

According to http://mvnrepository.com/artifact/org.apache.hive/hive-exec/0.12.0 the hive-exec jar for 0.12 is 9 megs, and hides within it specific versions of jackson, snappy, org.json, chunks of thrift, hadoop.io (?!), avro, commons, protobuf, and guava. If ORC authors are not interested in improving their dependency hygene, they have to live with the fact that their project is unlikely to get integrated into other projects.

This is self-inflicted jar hell. Please don't do this. When ORC cleans up their dependencies, let's revisit.


was (Author: dvryaboy):
I am pro adding ORC support in Pig, but against introducing massive dependencies.

According to http://mvnrepository.com/artifact/org.apache.hive/hive-exec/0.12.0 the hive-exec jar for 0.12 is 9 megs, and hides within it specific versions of jackson, snappy, org.json, chunks of thrift, hadoop.io (?!), avro, commons, protobuf, and guava. If ORC authors are not interested in reducing their dependency hygene, they have to live with the fact that their project is unlikely to get integrated into other projects.

This is self-inflicted jar hell. Please don't do this. When ORC cleans up their dependencies, let's revisit.

> ORC support for Pig
> -------------------
>
>                 Key: PIG-3558
>                 URL: https://issues.apache.org/jira/browse/PIG-3558
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.13.0
>
>         Attachments: PIG-3558-1.patch, PIG-3558-2.patch, PIG-3558-3.patch
>
>
> Adding LoadFunc and StoreFunc for ORC.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)