You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Rob Verkuylen (Created) (JIRA)" <ji...@apache.org> on 2012/02/12 21:04:59 UTC
[jira] [Created] (FLUME-965) .avro extension on avrofiles
.avro extension on avrofiles
----------------------------
Key: FLUME-965
URL: https://issues.apache.org/jira/browse/FLUME-965
Project: Flume
Issue Type: Improvement
Components: Sinks+Sources
Reporter: Rob Verkuylen
Priority: Minor
There's no section in the official AVRO spec, but the general consensus
seems to be to use the ".avro" extension for writing avro data files. See
AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-965) .avro extension on avrofiles
Posted by "Mingjie Lai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13276544#comment-13276544 ]
Mingjie Lai commented on FLUME-965:
-----------------------------------
+1 to have a fileSuffix config for hdfs sink.
> .avro extension on avrofiles
> ----------------------------
>
> Key: FLUME-965
> URL: https://issues.apache.org/jira/browse/FLUME-965
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4, v1.0.0
> Reporter: Rob Verkuylen
> Priority: Minor
>
> There's no section in the official AVRO spec, but the general consensus
> seems to be to use the ".avro" extension for writing avro data files. See
> AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
> AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-965) .avro extension on avrofiles
Posted by "Brock Noland (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227604#comment-13227604 ]
Brock Noland commented on FLUME-965:
------------------------------------
This looks fairly straightforward. I think we should add an option to HDFSEventSink called "filePostfix" or something similar. Then when writing out avro files you could set this parameter.
I don't see a good way of automatically adding this extension if the source is avro.
> .avro extension on avrofiles
> ----------------------------
>
> Key: FLUME-965
> URL: https://issues.apache.org/jira/browse/FLUME-965
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4, v1.0.0
> Reporter: Rob Verkuylen
> Priority: Minor
>
> There's no section in the official AVRO spec, but the general consensus
> seems to be to use the ".avro" extension for writing avro data files. See
> AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
> AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-965) .avro extension on avrofiles
Posted by "joseph montague (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206517#comment-13206517 ]
joseph montague commented on FLUME-965:
---------------------------------------
<a href="http://futbolsfera.blogspot.com/">Noticias de Futbol</a>,<a href="http://androidblogforum.blogspot.com/">Android Blog Forum</a>,<a href="http://apple-iphone-ipad-ipod-imac.blogspot.com/">Apple iPhone iPad iPod iMac</a>,<a href="http://www.comodiminuirabarriga.com/">Como diminuir a barriga</a>,<a href="http://coches20.blogspot.com/">Noticias de Coches</a>,<a href="http://socialmediabloger.blogspot.com/">Social Media Bloger</a>,<a href="http://iphoneblog-news.blogspot.com/">Iphone Blog News</a>,<a href="http://movilsfera.blogspot.com/">Smartphones y Moviles</a>,<a href="http://tecnicasderelaxamento.com">Técnicas de relaxamento</a>,<a href="http://tabletis.com">Tablets and Technology</a>,<a href="http://gameblr.com">online games</a>,<a href="http://funnypicpictures.blogspot.com/">FunnyPicPictures</a>,<a href="http://tecnoget.blogspot.com/">Tecnologia y Gadgets</a>,<a href="http://sportmedianews.blogspot.com/">Sport Media News</a>,<a href="http://blogs20.blogspot.com/">Social Media Noticias</a>,<a href="http://dietasyalimentos.blogspot.com/">Dietas y Alimentos</a>,<a href="http://motos30.blogspot.com/">Noticias de Motos</a>,<a href="http://ipadfanatic.blogspot.com/">Ipad News</a>,<a href="http://golhd.com">Noticias de Futbol</a>,<a href="http://facetele.com">TV online</a>,<a href="http://gameblr.com">Social Gaming Network</a>,<a href="http://gifmash.com">Funny Gifs</a>,<a href="http://sociapple.com">Apple Social Network</a>,<a href="http://witzelustige.blogspot.com">Witze Lustige</a>,<a href="http://gifanimierte.blogspot.com">Gif Animierte</a>,<a href="http://gifmash.blogspot.com">Funny gifs</a>,<a href="http://clipslustige.blogspot.com">clips lustige</a>,<a href="http://gifsmileys.blogspot.com">gif smileys</a>,<a href="http://gifsbilder.blogspot.com">gifs bilder</a>,<a href="http://lustigetiere.blogspot.com">lustige tiere</a>,<a href="http://lustigesbilder.blogspot.com">lustiges bilder</a>,<a href="http://funnyvideoclipers.blogspot.com">funny video clipers</a>,<a href="http://witzigevideo.blogspot.com">witzige video</a>,<a href="http://witzigevideo.blogspot.com">witzige video</a>,<a href="http://lustigesvideos.blogspot.com">lustiges videos</a>,<a href="http://lasmejoresofertasadsl.blogspot.com">las mejores ofertas adsl</a>,<a href="http://adsloferta.blogspot.com">adsl oferta</a>,<a href="http://el-mejor-seguro.blogspot.com">el mejor seguro</a>,<a href="http://humourhd.com">humour hd</a>,<a href="http://soeingif.blogspot.com">so ein gif</a>,<a href="http://funnyvip.com">funny vip</a>,<a href="http://etget.com>Technology</a>
> .avro extension on avrofiles
> ----------------------------
>
> Key: FLUME-965
> URL: https://issues.apache.org/jira/browse/FLUME-965
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Reporter: Rob Verkuylen
> Priority: Minor
>
> There's no section in the official AVRO spec, but the general consensus
> seems to be to use the ".avro" extension for writing avro data files. See
> AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
> AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-965) .avro extension on avrofiles
Posted by "Brock Noland (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated FLUME-965:
-------------------------------
Affects Version/s: v1.0.0
> .avro extension on avrofiles
> ----------------------------
>
> Key: FLUME-965
> URL: https://issues.apache.org/jira/browse/FLUME-965
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4, v1.0.0
> Reporter: Rob Verkuylen
> Priority: Minor
>
> There's no section in the official AVRO spec, but the general consensus
> seems to be to use the ".avro" extension for writing avro data files. See
> AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
> AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-965) .avro extension on avrofiles
Posted by "Brock Noland (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated FLUME-965:
-------------------------------
Affects Version/s: v0.9.4
> .avro extension on avrofiles
> ----------------------------
>
> Key: FLUME-965
> URL: https://issues.apache.org/jira/browse/FLUME-965
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v0.9.4, v1.0.0
> Reporter: Rob Verkuylen
> Priority: Minor
>
> There's no section in the official AVRO spec, but the general consensus
> seems to be to use the ".avro" extension for writing avro data files. See
> AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
> AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-965) .avro extension on avrofiles
Posted by "Arvind Prabhakar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar updated FLUME-965:
-----------------------------------
Comment: was deleted
(was: <a href="http://futbolsfera.blogspot.com/">Noticias de Futbol</a>,<a href="http://androidblogforum.blogspot.com/">Android Blog Forum</a>,<a href="http://apple-iphone-ipad-ipod-imac.blogspot.com/">Apple iPhone iPad iPod iMac</a>,<a href="http://www.comodiminuirabarriga.com/">Como diminuir a barriga</a>,<a href="http://coches20.blogspot.com/">Noticias de Coches</a>,<a href="http://socialmediabloger.blogspot.com/">Social Media Bloger</a>,<a href="http://iphoneblog-news.blogspot.com/">Iphone Blog News</a>,<a href="http://movilsfera.blogspot.com/">Smartphones y Moviles</a>,<a href="http://tecnicasderelaxamento.com">Técnicas de relaxamento</a>,<a href="http://tabletis.com">Tablets and Technology</a>,<a href="http://gameblr.com">online games</a>,<a href="http://funnypicpictures.blogspot.com/">FunnyPicPictures</a>,<a href="http://tecnoget.blogspot.com/">Tecnologia y Gadgets</a>,<a href="http://sportmedianews.blogspot.com/">Sport Media News</a>,<a href="http://blogs20.blogspot.com/">Social Media Noticias</a>,<a href="http://dietasyalimentos.blogspot.com/">Dietas y Alimentos</a>,<a href="http://motos30.blogspot.com/">Noticias de Motos</a>,<a href="http://ipadfanatic.blogspot.com/">Ipad News</a>,<a href="http://golhd.com">Noticias de Futbol</a>,<a href="http://facetele.com">TV online</a>,<a href="http://gameblr.com">Social Gaming Network</a>,<a href="http://gifmash.com">Funny Gifs</a>,<a href="http://sociapple.com">Apple Social Network</a>,<a href="http://witzelustige.blogspot.com">Witze Lustige</a>,<a href="http://gifanimierte.blogspot.com">Gif Animierte</a>,<a href="http://gifmash.blogspot.com">Funny gifs</a>,<a href="http://clipslustige.blogspot.com">clips lustige</a>,<a href="http://gifsmileys.blogspot.com">gif smileys</a>,<a href="http://gifsbilder.blogspot.com">gifs bilder</a>,<a href="http://lustigetiere.blogspot.com">lustige tiere</a>,<a href="http://lustigesbilder.blogspot.com">lustiges bilder</a>,<a href="http://funnyvideoclipers.blogspot.com">funny video clipers</a>,<a href="http://witzigevideo.blogspot.com">witzige video</a>,<a href="http://witzigevideo.blogspot.com">witzige video</a>,<a href="http://lustigesvideos.blogspot.com">lustiges videos</a>,<a href="http://lasmejoresofertasadsl.blogspot.com">las mejores ofertas adsl</a>,<a href="http://adsloferta.blogspot.com">adsl oferta</a>,<a href="http://el-mejor-seguro.blogspot.com">el mejor seguro</a>,<a href="http://humourhd.com">humour hd</a>,<a href="http://soeingif.blogspot.com">so ein gif</a>,<a href="http://funnyvip.com">funny vip</a>,<a href="http://etget.com>Technology</a>
)
> .avro extension on avrofiles
> ----------------------------
>
> Key: FLUME-965
> URL: https://issues.apache.org/jira/browse/FLUME-965
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Reporter: Rob Verkuylen
> Priority: Minor
>
> There's no section in the official AVRO spec, but the general consensus
> seems to be to use the ".avro" extension for writing avro data files. See
> AVRO-153 <https://issues.apache.org/jira/browse/AVRO-153> and Cloudera on
> AVRO Usage <https://ccp.cloudera.com/display/CDHDOC/Avro+Usage>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira