You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Hari Shreedharan (JIRA)" <ji...@apache.org> on 2013/10/20 21:10:43 UTC

[jira] [Updated] (AVRO-1387) DataFileWriter must allow files not to be flushed at the end of every block.

     [ https://issues.apache.org/jira/browse/AVRO-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hari Shreedharan updated AVRO-1387:
-----------------------------------

    Summary: DataFileWriter must allow files not to be flushed at the end of every block.  (was: Avro container file format update to write checksums for individual record)

> DataFileWriter must allow files not to be flushed at the end of every block.
> ----------------------------------------------------------------------------
>
>                 Key: AVRO-1387
>                 URL: https://issues.apache.org/jira/browse/AVRO-1387
>             Project: Avro
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>
> We are considering changes in Flume's file channel to use Avro, one of the requirements is that each event (which maps to one avro record) be checksummed so we know if the data is corrupt. 
> We'd probably have to add a new version for this, since this will change the data format on disk. I can start working on a Java version if there are no objections



--
This message was sent by Atlassian JIRA
(v6.1#6144)