You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Andrey Mashenkov <an...@gmail.com> on 2018/04/02 13:09:27 UTC
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Hi,
Looks bad.
Ignite node tries to restore cache configuration on startup and seems can't
do it as old classes are lost.
Seems, it fails before cache configuration validation.
Also, I'm not sure we allow to rewrite cache config and the only way here
is to recreate a cache.
On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com> wrote:
> Hi,
>
> Thanks for checking out issue. I think its not about IDE issue.
> Again same thing i have reproduce like bellow steps
>
> 1.run the program from IDE as client
> 2.copy jar to ignite libs folder and start the server
> 3.Then check previous message steps so that can able to reproduce the
> issue.
> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
> I have attached the video link.Can you go through that video and check the
> issue.
>
>
> Thanks
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
--
Best regards,
Andrey V. Mashenkov
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Denis Garus <ga...@gmail.com>.
Ivan,
there are some questions related to ticket IGNITE-8162:
1. deleting a file of cache configuration leads to successfuly getting cache
clonfiguration. But, is there guarantee that cache will work correctly?
2. if deleting a file of cache configuration is enough to get cache able to
work, can we delete this file in catch block and continue cache start?
--
Sent from: http://apache-ignite-developers.2346864.n4.nabble.com/
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Denis Magda <dm...@apache.org>.
Thanks, Ivan,
It will be good if we fix usability issues like that as soon as possible
because usually, they don't involve much effort. Igniters, is anyone
interested to implement the improvement for 2.5 release?
--
Denis
On Fri, Apr 6, 2018 at 4:12 AM, Ivan Rakov <iv...@gmail.com> wrote:
> By the way, ticket is marked with "newbie" label.
> If there's anyone who wants to start contributing in Ignite, feel free to
> take this issue.
>
> Best Regards,
> Ivan Rakov
>
>
> On 06.04.2018 14:06, Ivan Rakov wrote:
>
>> Denis,
>>
>> I'm sure we can: https://issues.apache.org/jira/browse/IGNITE-8162
>>
>> Best Regards,
>> Ivan Rakov
>>
>> On 05.04.2018 22:39, Denis Magda wrote:
>>
>>> Ivan,
>>>
>>> How can we facilitate the user here? Can we generate a meaningful
>>> exception
>>> that explains how to tackle the issue?
>>>
>>> --
>>> Denis
>>>
>>> On Thu, Apr 5, 2018 at 2:49 AM, Ivan Rakov <iv...@gmail.com>
>>> wrote:
>>>
>>> Hi,
>>>>
>>>> Cache configuration is persisted in db\{consistent-ID}\cache-{cach
>>>> e-name}\cache_data.dat
>>>> file. It's just CacheConfiguration serialized by JDK marshaller.
>>>> Try to delete this file and start cache with new configuration (with
>>>> correct factory class names). All your data will persist as long as old
>>>> ignite data is compatible with new configuration.
>>>>
>>>> Best Regards,
>>>> Ivan Rakov
>>>>
>>>>
>>>> On 04.04.2018 23:08, Denis Magda wrote:
>>>>
>>>> Ivan R., Alex G., persistence experts,
>>>>>
>>>>> Please have a look at this question.
>>>>>
>>>>> --
>>>>> Denis
>>>>>
>>>>> On Mon, Apr 2, 2018 at 6:15 AM, Andrey Mashenkov <
>>>>> andrey.mashenkov@gmail.com
>>>>>
>>>>> wrote:
>>>>>> Crossposting to dev.
>>>>>>
>>>>>> Guys,
>>>>>> User use Ignite native persistence with CacheStore configured.
>>>>>> Seems, changing CacheStore requires cache recreation in his case to
>>>>>> changes
>>>>>> can be applied.
>>>>>>
>>>>>> Does anybody has idea how it can be fixed?
>>>>>>
>>>>>> Do we allow to rewrite cache config in native store if it has minor
>>>>>> changes
>>>>>> that will not cause issues? E.g. changing cacheStore factory or
>>>>>> changing
>>>>>> number of backups?
>>>>>> Otherwise, I'd suggest to deprecate such configuration.
>>>>>>
>>>>>>
>>>>>> On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com>
>>>>>> wrote:
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>>> Thanks for checking out issue. I think its not about IDE issue.
>>>>>>> Again same thing i have reproduce like bellow steps
>>>>>>>
>>>>>>> 1.run the program from IDE as client
>>>>>>> 2.copy jar to ignite libs folder and start the server
>>>>>>> 3.Then check previous message steps so that can able to reproduce the
>>>>>>> issue.
>>>>>>> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
>>>>>>> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
>>>>>>> I have attached the video link.Can you go through that video and
>>>>>>> check
>>>>>>>
>>>>>>> the
>>>>>>
>>>>>> issue.
>>>>>>>
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>> Best regards,
>>>>>> Andrey V. Mashenkov
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Best regards,
>>>>>> Andrey V. Mashenkov
>>>>>>
>>>>>>
>>>>>>
>>
>
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Ivan Rakov <iv...@gmail.com>.
By the way, ticket is marked with "newbie" label.
If there's anyone who wants to start contributing in Ignite, feel free
to take this issue.
Best Regards,
Ivan Rakov
On 06.04.2018 14:06, Ivan Rakov wrote:
> Denis,
>
> I'm sure we can: https://issues.apache.org/jira/browse/IGNITE-8162
>
> Best Regards,
> Ivan Rakov
>
> On 05.04.2018 22:39, Denis Magda wrote:
>> Ivan,
>>
>> How can we facilitate the user here? Can we generate a meaningful
>> exception
>> that explains how to tackle the issue?
>>
>> --
>> Denis
>>
>> On Thu, Apr 5, 2018 at 2:49 AM, Ivan Rakov <iv...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> Cache configuration is persisted in
>>> db\{consistent-ID}\cache-{cache-name}\cache_data.dat
>>> file. It's just CacheConfiguration serialized by JDK marshaller.
>>> Try to delete this file and start cache with new configuration (with
>>> correct factory class names). All your data will persist as long as old
>>> ignite data is compatible with new configuration.
>>>
>>> Best Regards,
>>> Ivan Rakov
>>>
>>>
>>> On 04.04.2018 23:08, Denis Magda wrote:
>>>
>>>> Ivan R., Alex G., persistence experts,
>>>>
>>>> Please have a look at this question.
>>>>
>>>> --
>>>> Denis
>>>>
>>>> On Mon, Apr 2, 2018 at 6:15 AM, Andrey Mashenkov <
>>>> andrey.mashenkov@gmail.com
>>>>
>>>>> wrote:
>>>>> Crossposting to dev.
>>>>>
>>>>> Guys,
>>>>> User use Ignite native persistence with CacheStore configured.
>>>>> Seems, changing CacheStore requires cache recreation in his case to
>>>>> changes
>>>>> can be applied.
>>>>>
>>>>> Does anybody has idea how it can be fixed?
>>>>>
>>>>> Do we allow to rewrite cache config in native store if it has minor
>>>>> changes
>>>>> that will not cause issues? E.g. changing cacheStore factory or
>>>>> changing
>>>>> number of backups?
>>>>> Otherwise, I'd suggest to deprecate such configuration.
>>>>>
>>>>>
>>>>> On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com>
>>>>> wrote:
>>>>>
>>>>> Hi,
>>>>>> Thanks for checking out issue. I think its not about IDE issue.
>>>>>> Again same thing i have reproduce like bellow steps
>>>>>>
>>>>>> 1.run the program from IDE as client
>>>>>> 2.copy jar to ignite libs folder and start the server
>>>>>> 3.Then check previous message steps so that can able to reproduce
>>>>>> the
>>>>>> issue.
>>>>>> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
>>>>>> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
>>>>>> I have attached the video link.Can you go through that video and
>>>>>> check
>>>>>>
>>>>> the
>>>>>
>>>>>> issue.
>>>>>>
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>
>>>>>>
>>>>> --
>>>>> Best regards,
>>>>> Andrey V. Mashenkov
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Best regards,
>>>>> Andrey V. Mashenkov
>>>>>
>>>>>
>
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Ivan Rakov <iv...@gmail.com>.
Denis,
I'm sure we can: https://issues.apache.org/jira/browse/IGNITE-8162
Best Regards,
Ivan Rakov
On 05.04.2018 22:39, Denis Magda wrote:
> Ivan,
>
> How can we facilitate the user here? Can we generate a meaningful exception
> that explains how to tackle the issue?
>
> --
> Denis
>
> On Thu, Apr 5, 2018 at 2:49 AM, Ivan Rakov <iv...@gmail.com> wrote:
>
>> Hi,
>>
>> Cache configuration is persisted in db\{consistent-ID}\cache-{cache-name}\cache_data.dat
>> file. It's just CacheConfiguration serialized by JDK marshaller.
>> Try to delete this file and start cache with new configuration (with
>> correct factory class names). All your data will persist as long as old
>> ignite data is compatible with new configuration.
>>
>> Best Regards,
>> Ivan Rakov
>>
>>
>> On 04.04.2018 23:08, Denis Magda wrote:
>>
>>> Ivan R., Alex G., persistence experts,
>>>
>>> Please have a look at this question.
>>>
>>> --
>>> Denis
>>>
>>> On Mon, Apr 2, 2018 at 6:15 AM, Andrey Mashenkov <
>>> andrey.mashenkov@gmail.com
>>>
>>>> wrote:
>>>> Crossposting to dev.
>>>>
>>>> Guys,
>>>> User use Ignite native persistence with CacheStore configured.
>>>> Seems, changing CacheStore requires cache recreation in his case to
>>>> changes
>>>> can be applied.
>>>>
>>>> Does anybody has idea how it can be fixed?
>>>>
>>>> Do we allow to rewrite cache config in native store if it has minor
>>>> changes
>>>> that will not cause issues? E.g. changing cacheStore factory or changing
>>>> number of backups?
>>>> Otherwise, I'd suggest to deprecate such configuration.
>>>>
>>>>
>>>> On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com> wrote:
>>>>
>>>> Hi,
>>>>> Thanks for checking out issue. I think its not about IDE issue.
>>>>> Again same thing i have reproduce like bellow steps
>>>>>
>>>>> 1.run the program from IDE as client
>>>>> 2.copy jar to ignite libs folder and start the server
>>>>> 3.Then check previous message steps so that can able to reproduce the
>>>>> issue.
>>>>> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
>>>>> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
>>>>> I have attached the video link.Can you go through that video and check
>>>>>
>>>> the
>>>>
>>>>> issue.
>>>>>
>>>>>
>>>>> Thanks
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>
>>>>>
>>>> --
>>>> Best regards,
>>>> Andrey V. Mashenkov
>>>>
>>>>
>>>>
>>>> --
>>>> Best regards,
>>>> Andrey V. Mashenkov
>>>>
>>>>
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Denis Magda <dm...@apache.org>.
Ivan,
How can we facilitate the user here? Can we generate a meaningful exception
that explains how to tackle the issue?
--
Denis
On Thu, Apr 5, 2018 at 2:49 AM, Ivan Rakov <iv...@gmail.com> wrote:
> Hi,
>
> Cache configuration is persisted in db\{consistent-ID}\cache-{cache-name}\cache_data.dat
> file. It's just CacheConfiguration serialized by JDK marshaller.
> Try to delete this file and start cache with new configuration (with
> correct factory class names). All your data will persist as long as old
> ignite data is compatible with new configuration.
>
> Best Regards,
> Ivan Rakov
>
>
> On 04.04.2018 23:08, Denis Magda wrote:
>
>> Ivan R., Alex G., persistence experts,
>>
>> Please have a look at this question.
>>
>> --
>> Denis
>>
>> On Mon, Apr 2, 2018 at 6:15 AM, Andrey Mashenkov <
>> andrey.mashenkov@gmail.com
>>
>>> wrote:
>>> Crossposting to dev.
>>>
>>> Guys,
>>> User use Ignite native persistence with CacheStore configured.
>>> Seems, changing CacheStore requires cache recreation in his case to
>>> changes
>>> can be applied.
>>>
>>> Does anybody has idea how it can be fixed?
>>>
>>> Do we allow to rewrite cache config in native store if it has minor
>>> changes
>>> that will not cause issues? E.g. changing cacheStore factory or changing
>>> number of backups?
>>> Otherwise, I'd suggest to deprecate such configuration.
>>>
>>>
>>> On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com> wrote:
>>>
>>> Hi,
>>>>
>>>> Thanks for checking out issue. I think its not about IDE issue.
>>>> Again same thing i have reproduce like bellow steps
>>>>
>>>> 1.run the program from IDE as client
>>>> 2.copy jar to ignite libs folder and start the server
>>>> 3.Then check previous message steps so that can able to reproduce the
>>>> issue.
>>>> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
>>>> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
>>>> I have attached the video link.Can you go through that video and check
>>>>
>>> the
>>>
>>>> issue.
>>>>
>>>>
>>>> Thanks
>>>>
>>>>
>>>>
>>>> --
>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>
>>>>
>>>
>>> --
>>> Best regards,
>>> Andrey V. Mashenkov
>>>
>>>
>>>
>>> --
>>> Best regards,
>>> Andrey V. Mashenkov
>>>
>>>
>
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Ivan Rakov <iv...@gmail.com>.
Hi,
Cache configuration is persisted in
db\{consistent-ID}\cache-{cache-name}\cache_data.dat file. It's just
CacheConfiguration serialized by JDK marshaller.
Try to delete this file and start cache with new configuration (with
correct factory class names). All your data will persist as long as old
ignite data is compatible with new configuration.
Best Regards,
Ivan Rakov
On 04.04.2018 23:08, Denis Magda wrote:
> Ivan R., Alex G., persistence experts,
>
> Please have a look at this question.
>
> --
> Denis
>
> On Mon, Apr 2, 2018 at 6:15 AM, Andrey Mashenkov <andrey.mashenkov@gmail.com
>> wrote:
>> Crossposting to dev.
>>
>> Guys,
>> User use Ignite native persistence with CacheStore configured.
>> Seems, changing CacheStore requires cache recreation in his case to changes
>> can be applied.
>>
>> Does anybody has idea how it can be fixed?
>>
>> Do we allow to rewrite cache config in native store if it has minor changes
>> that will not cause issues? E.g. changing cacheStore factory or changing
>> number of backups?
>> Otherwise, I'd suggest to deprecate such configuration.
>>
>>
>> On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com> wrote:
>>
>>> Hi,
>>>
>>> Thanks for checking out issue. I think its not about IDE issue.
>>> Again same thing i have reproduce like bellow steps
>>>
>>> 1.run the program from IDE as client
>>> 2.copy jar to ignite libs folder and start the server
>>> 3.Then check previous message steps so that can able to reproduce the
>>> issue.
>>> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
>>> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
>>> I have attached the video link.Can you go through that video and check
>> the
>>> issue.
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>> --
>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>
>>
>>
>> --
>> Best regards,
>> Andrey V. Mashenkov
>>
>>
>>
>> --
>> Best regards,
>> Andrey V. Mashenkov
>>
Re: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Denis Magda <dm...@apache.org>.
Ivan R., Alex G., persistence experts,
Please have a look at this question.
--
Denis
On Mon, Apr 2, 2018 at 6:15 AM, Andrey Mashenkov <andrey.mashenkov@gmail.com
> wrote:
> Crossposting to dev.
>
> Guys,
> User use Ignite native persistence with CacheStore configured.
> Seems, changing CacheStore requires cache recreation in his case to changes
> can be applied.
>
> Does anybody has idea how it can be fixed?
>
> Do we allow to rewrite cache config in native store if it has minor changes
> that will not cause issues? E.g. changing cacheStore factory or changing
> number of backups?
> Otherwise, I'd suggest to deprecate such configuration.
>
>
> On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com> wrote:
>
> > Hi,
> >
> > Thanks for checking out issue. I think its not about IDE issue.
> > Again same thing i have reproduce like bellow steps
> >
> > 1.run the program from IDE as client
> > 2.copy jar to ignite libs folder and start the server
> > 3.Then check previous message steps so that can able to reproduce the
> > issue.
> > https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
> > <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
> > I have attached the video link.Can you go through that video and check
> the
> > issue.
> >
> >
> > Thanks
> >
> >
> >
> > --
> > Sent from: http://apache-ignite-users.70518.x6.nabble.com/
> >
>
>
>
> --
> Best regards,
> Andrey V. Mashenkov
>
>
>
> --
> Best regards,
> Andrey V. Mashenkov
>
Fwd: Data Loss while upgrading custom jar from old jar in server and
client nodes
Posted by Andrey Mashenkov <an...@gmail.com>.
Crossposting to dev.
Guys,
User use Ignite native persistence with CacheStore configured.
Seems, changing CacheStore requires cache recreation in his case to changes
can be applied.
Does anybody has idea how it can be fixed?
Do we allow to rewrite cache config in native store if it has minor changes
that will not cause issues? E.g. changing cacheStore factory or changing
number of backups?
Otherwise, I'd suggest to deprecate such configuration.
On Tue, Mar 27, 2018 at 4:18 PM, siva <si...@bizruntime.com> wrote:
> Hi,
>
> Thanks for checking out issue. I think its not about IDE issue.
> Again same thing i have reproduce like bellow steps
>
> 1.run the program from IDE as client
> 2.copy jar to ignite libs folder and start the server
> 3.Then check previous message steps so that can able to reproduce the
> issue.
> https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s
> <https://www.youtube.com/watch?v=COQiu2gi8ag&t=43s>
> I have attached the video link.Can you go through that video and check the
> issue.
>
>
> Thanks
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
--
Best regards,
Andrey V. Mashenkov
--
Best regards,
Andrey V. Mashenkov