You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Russell Jurney (JIRA)" <ji...@apache.org> on 2012/10/05 20:10:02 UTC
[jira] [Created] (PIG-2948) Add multimedia support to Pig: types
for images, audio, video common document formats and accompanying
internal-UDFs
Russell Jurney created PIG-2948:
-----------------------------------
Summary: Add multimedia support to Pig: types for images, audio, video common document formats and accompanying internal-UDFs
Key: PIG-2948
URL: https://issues.apache.org/jira/browse/PIG-2948
Project: Pig
Issue Type: New Feature
Components: data, documentation, e2e harness, grunt, impl, internal-udfs, parser, piggybank, tools
Environment: Pie in the Sky.
Inside my head. Someone mentioned this last evening and I decided to JIRA it.
Reporter: Russell Jurney
Assignee: Russell Jurney
Priority: Minor
Pig should have support for multimedia: images, audio, video, common document formats. By continuing to add additional types, Pig can outpace other tools.
Ideally a java-based library that can already handle these formats would be used to transform them to Pig relations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2948) Add multimedia support to Pig: types
for images, audio, video common document formats and accompanying
internal-UDFs
Posted by "Jonathan Coveney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470663#comment-13470663 ]
Jonathan Coveney commented on PIG-2948:
---------------------------------------
Russell,
I'm curious what you have in mind here. What is gained from having a specific type for these things that you couldn't do by passing around bytearrays (besides the cost of serialization)?
> Add multimedia support to Pig: types for images, audio, video common document formats and accompanying internal-UDFs
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-2948
> URL: https://issues.apache.org/jira/browse/PIG-2948
> Project: Pig
> Issue Type: New Feature
> Components: data, documentation, e2e harness, grunt, impl, internal-udfs, parser, piggybank, tools
> Environment: Pie in the Sky.
> Inside my head. Someone mentioned this last evening and I decided to JIRA it.
> Reporter: Russell Jurney
> Assignee: Russell Jurney
> Priority: Minor
>
> Pig should have support for multimedia: images, audio, video, common document formats. By continuing to add additional types, Pig can outpace other tools.
> Ideally a java-based library that can already handle these formats would be used to transform them to Pig relations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2948) Add multimedia support to Pig: types
for images, audio, video common document formats and accompanying
internal-UDFs
Posted by "Russell Jurney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470684#comment-13470684 ]
Russell Jurney commented on PIG-2948:
-------------------------------------
You make a good point: the benefit of a type only comes once there are sufficient UDFs supporting image/audio/video/document load/store/modify operations that you want to pull them into builtins and add a type. We've seen this with boolean and datetime types.
Once there are assets for Pig/images in contrib, the benefit of having operations as pig builtins is that you can specify pipelines for multimedia processing when there are large numbers of multimedia assets. I get the feeling that Pig might do well in certain circles as a way to process multimedia inputs, and a cohesive, organized syntax would facilitate ease of use and productivity.
But the way to start isn't to being a new type. It is to explore working with some type of one of these types and go from there. I'm going to do that. I put this ticket here as a long-term goal, because I believe there is demand. I will link appropriate tickets, knowledge and tools here as I edit the wiki.
> Add multimedia support to Pig: types for images, audio, video common document formats and accompanying internal-UDFs
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-2948
> URL: https://issues.apache.org/jira/browse/PIG-2948
> Project: Pig
> Issue Type: New Feature
> Components: data, documentation, e2e harness, grunt, impl, internal-udfs, parser, piggybank, tools
> Environment: Pie in the Sky.
> Inside my head. Someone mentioned this last evening and I decided to JIRA it.
> Reporter: Russell Jurney
> Assignee: Russell Jurney
> Priority: Minor
>
> Pig should have support for multimedia: images, audio, video, common document formats. By continuing to add additional types, Pig can outpace other tools.
> Ideally a java-based library that can already handle these formats would be used to transform them to Pig relations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2948) Add multimedia support to Pig: types
for images, audio, video common document formats and accompanying
internal-UDFs
Posted by "Russell Jurney (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470721#comment-13470721 ]
Russell Jurney commented on PIG-2948:
-------------------------------------
I just found this: http://hipi.cs.virginia.edu/
There is an existing inputformat, and lots there to work with. This could be the basis for creating an image loader in Pig.
> Add multimedia support to Pig: types for images, audio, video common document formats and accompanying internal-UDFs
> --------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-2948
> URL: https://issues.apache.org/jira/browse/PIG-2948
> Project: Pig
> Issue Type: New Feature
> Components: data, documentation, e2e harness, grunt, impl, internal-udfs, parser, piggybank, tools
> Environment: Pie in the Sky.
> Inside my head. Someone mentioned this last evening and I decided to JIRA it.
> Reporter: Russell Jurney
> Assignee: Russell Jurney
> Priority: Minor
>
> Pig should have support for multimedia: images, audio, video, common document formats. By continuing to add additional types, Pig can outpace other tools.
> Ideally a java-based library that can already handle these formats would be used to transform them to Pig relations.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira