You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@directmemory.apache.org by "Daniel Manzke (Created) (JIRA)" <ji...@apache.org> on 2012/02/19 23:48:34 UTC
[jira] [Created] (DIRECTMEMORY-64) Serializer should directly write
Serializer should directly write
--------------------------------
Key: DIRECTMEMORY-64
URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
Project: Apache DirectMemory
Issue Type: Wish
Reporter: Daniel Manzke
The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DIRECTMEMORY-64) Serializer should directly
write
Posted by "Benoit Perroud (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DIRECTMEMORY-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211911#comment-13211911 ]
Benoit Perroud commented on DIRECTMEMORY-64:
--------------------------------------------
https://issues.apache.org/jira/browse/DIRECTMEMORY-37 provide a way to request ByteBuffer and write directly into it, bypassing the byte[] representation.
An idea here is to use this mechanism to store the file in as much BB as needed, depending the unknown size of the "file" to store.
> Serializer should directly write
> --------------------------------
>
> Key: DIRECTMEMORY-64
> URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
> Project: Apache DirectMemory
> Issue Type: Wish
> Reporter: Daniel Manzke
>
> The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
> This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DIRECTMEMORY-64) Serializer should directly
write
Posted by "Daniel Manzke (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DIRECTMEMORY-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211601#comment-13211601 ]
Daniel Manzke commented on DIRECTMEMORY-64:
-------------------------------------------
After a first look in the code, this will be hard, do to the fact, that you have to know the size of your object. So DM can allocate the right amount of memory.
But I think this leads to a real problem, because you often don't know the size of an object. Think about files, which will be uploaded in chunks, where the total count of bytes is unknown and expect files.
> Serializer should directly write
> --------------------------------
>
> Key: DIRECTMEMORY-64
> URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
> Project: Apache DirectMemory
> Issue Type: Wish
> Reporter: Daniel Manzke
>
> The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
> This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DIRECTMEMORY-64) Serializer should directly
write
Posted by "Christoph Engelbert (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DIRECTMEMORY-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488642#comment-13488642 ]
Christoph Engelbert commented on DIRECTMEMORY-64:
-------------------------------------------------
As mentioned in DIRECTMEMORY-69 there is a new MemoryBuffer interface which features unified writethrough to the underlying memory access no matter if this is sun.misc.Unsafe, ByteBuffer, OutputStream, FileChannel, ...
> Serializer should directly write
> --------------------------------
>
> Key: DIRECTMEMORY-64
> URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
> Project: Apache DirectMemory
> Issue Type: Wish
> Reporter: Daniel Manzke
> Assignee: Christoph Engelbert
>
> The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
> This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (DIRECTMEMORY-64) Serializer should directly
write
Posted by "Simone Tripodi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DIRECTMEMORY-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211745#comment-13211745 ]
Simone Tripodi commented on DIRECTMEMORY-64:
--------------------------------------------
+1 for that. do you have some cycles to contribute a patch, please? otherwise I'll try to take care of it.
TIA!
> Serializer should directly write
> --------------------------------
>
> Key: DIRECTMEMORY-64
> URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
> Project: Apache DirectMemory
> Issue Type: Wish
> Reporter: Daniel Manzke
>
> The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
> This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (DIRECTMEMORY-64) Serializer should directly
write
Posted by "Christoph Engelbert (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DIRECTMEMORY-64?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christoph Engelbert resolved DIRECTMEMORY-64.
---------------------------------------------
Resolution: Fixed
Fix Version/s: 0.2
> Serializer should directly write
> --------------------------------
>
> Key: DIRECTMEMORY-64
> URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
> Project: Apache DirectMemory
> Issue Type: Wish
> Reporter: Daniel Manzke
> Assignee: Christoph Engelbert
> Fix For: 0.2
>
>
> The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
> This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (DIRECTMEMORY-64) Serializer should directly write
Posted by "Christoph Engelbert (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/DIRECTMEMORY-64?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christoph Engelbert updated DIRECTMEMORY-64:
--------------------------------------------
Assignee: Christoph Engelbert
> Serializer should directly write
> --------------------------------
>
> Key: DIRECTMEMORY-64
> URL: https://issues.apache.org/jira/browse/DIRECTMEMORY-64
> Project: Apache DirectMemory
> Issue Type: Wish
> Reporter: Daniel Manzke
> Assignee: Christoph Engelbert
>
> The serializers are returning a byte[] which means, the value has to fit into the memory. This also means, that DM can't be used for a file storage. The serializers should directly write the object into the storage location.
> This would allow to use stuff like nio and other things.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira