You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org> on 2010/01/14 15:52:54 UTC
[jira] Created: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Performance improvements Validating encoder/decoder for nested records
----------------------------------------------------------------------
Key: AVRO-328
URL: https://issues.apache.org/jira/browse/AVRO-328
Project: Avro
Issue Type: Improvement
Components: java
Reporter: Thiruvalluvan M. G.
Assignee: Thiruvalluvan M. G.
With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
The forthcoming patch does just that.
Try org.apache.avro.io.Perf -N
On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Attachment: AVRO-328.patch
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Attachment: AVRO-328-test.patch
AVRO-328.patch
Improved Perf to check if it reads back what was written.
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed revision 899888.
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Attachment: (was: AVRO-328-test.patch)
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Attachment: (was: AVRO-328.patch)
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Attachment: AVRO-328-test.patch
AVRO-328.patch
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Status: Patch Available (was: Open)
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-328) Performance improvements Validating
encoder/decoder for nested records
Posted by "Thiruvalluvan M. G. (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thiruvalluvan M. G. updated AVRO-328:
-------------------------------------
Attachment: (was: AVRO-328.patch)
> Performance improvements Validating encoder/decoder for nested records
> ----------------------------------------------------------------------
>
> Key: AVRO-328
> URL: https://issues.apache.org/jira/browse/AVRO-328
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Thiruvalluvan M. G.
> Assignee: Thiruvalluvan M. G.
> Attachments: AVRO-328-test.patch, AVRO-328.patch
>
>
> With nested records, Parser.pushProduction() gets called multiple times (once per record nesting). Since we do not have any events for beginning and end of records, it enhances the performance if we flatten the grammar, wherever possible.
> The forthcoming patch does just that.
> Try org.apache.avro.io.Perf -N
> On my machine (HP laptop with Cygwin) the improvement is about 20%.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.