You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@helix.apache.org by Bo Liu <ne...@gmail.com> on 2018/02/16 15:54:04 UTC
Is there a way to reset an OnlineOffline resource?
We'd like to change all partitions of a resource to Offline state and then
let Helix to gradually move them to Online state. This will help us easily
refresh the dataset hosted on the resource.
We tried to disable&enable the resource. It doesn't change the states of
any partitions. So I guess it only disables Helix management for the
resource?
--
Best regards,
Bo
Re: Is there a way to reset an OnlineOffline resource?
Posted by Bo Liu <ne...@gmail.com>.
It turned out to be something related to the configuration attached.
It starts to go Offline if I remove this configuration before disabling it.
On Fri, Feb 16, 2018 at 10:04 AM, Bo Liu <ne...@gmail.com> wrote:
> Yup, "HELIX_ENABLE" : "false" is in the idealstate for the disabled
> resource. I randomly checked the zk message path for two hosts, and the zk
> nodes didn't exist. When there is no messages, do we expect zk nodes with
> empty content or non zk node exist?
>
> On Fri, Feb 16, 2018 at 9:09 AM, Lei Xia <xi...@gmail.com> wrote:
>
>> Did you see "HELIX_ENABLE" : "false" shown on your idealstate after you
>> disabling the resource. If yes, can you check if there are any pending
>> state transition messages under /INSTANCES/instancename/messages?
>>
>>
>>
>> Lei
>>
>> On Fri, Feb 16, 2018 at 9:04 AM, Bo Liu <ne...@gmail.com> wrote:
>>
>>> We tried to disable it through helix ui and restful api.
>>>
>>> Yes, I think it's not caused by the delay feature. Because the disabled
>>> resource stayed at online state forever.
>>>
>>> On Feb 16, 2018 08:48, "Lei Xia" <xi...@gmail.com> wrote:
>>>
>>>> Hi, Bo
>>>>
>>>> Disable a resource will bring all of its partitions to OFFLINE. How
>>>> did you disable the resource? After disable the resource, do you see state
>>>> transition messages sent to the instances which holds the partitions.
>>>>
>>>> DelayedRebalancer won't delay the resource disable, but instance
>>>> disable, i.e, if you disable an instance, all partitions on that instance
>>>> will be moved away only after the delay timeout.
>>>>
>>>>
>>>> Lei
>>>>
>>>> On Fri, Feb 16, 2018 at 8:42 AM, kishore g <g....@gmail.com> wrote:
>>>>
>>>>> Disable should move all partitions to OFFLINE state. This might be a
>>>>> bug with DelayedRebalancer. Lei, do you know more about this?
>>>>>
>>>>> On Fri, Feb 16, 2018 at 7:54 AM, Bo Liu <ne...@gmail.com> wrote:
>>>>>
>>>>>>
>>>>>> We'd like to change all partitions of a resource to Offline state and
>>>>>> then let Helix to gradually move them to Online state. This will help us
>>>>>> easily refresh the dataset hosted on the resource.
>>>>>> We tried to disable&enable the resource. It doesn't change the states
>>>>>> of any partitions. So I guess it only disables Helix management for the
>>>>>> resource?
>>>>>>
>>>>>> --
>>>>>> Best regards,
>>>>>> Bo
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Lei Xia
>>>>
>>>
>>
>>
>> --
>> Lei Xia
>>
>
>
>
> --
> Best regards,
> Bo
>
>
--
Best regards,
Bo
Re: Is there a way to reset an OnlineOffline resource?
Posted by Bo Liu <ne...@gmail.com>.
Yup, "HELIX_ENABLE" : "false" is in the idealstate for the disabled
resource. I randomly checked the zk message path for two hosts, and the zk
nodes didn't exist. When there is no messages, do we expect zk nodes with
empty content or non zk node exist?
On Fri, Feb 16, 2018 at 9:09 AM, Lei Xia <xi...@gmail.com> wrote:
> Did you see "HELIX_ENABLE" : "false" shown on your idealstate after you
> disabling the resource. If yes, can you check if there are any pending
> state transition messages under /INSTANCES/instancename/messages?
>
>
>
> Lei
>
> On Fri, Feb 16, 2018 at 9:04 AM, Bo Liu <ne...@gmail.com> wrote:
>
>> We tried to disable it through helix ui and restful api.
>>
>> Yes, I think it's not caused by the delay feature. Because the disabled
>> resource stayed at online state forever.
>>
>> On Feb 16, 2018 08:48, "Lei Xia" <xi...@gmail.com> wrote:
>>
>>> Hi, Bo
>>>
>>> Disable a resource will bring all of its partitions to OFFLINE. How
>>> did you disable the resource? After disable the resource, do you see state
>>> transition messages sent to the instances which holds the partitions.
>>>
>>> DelayedRebalancer won't delay the resource disable, but instance
>>> disable, i.e, if you disable an instance, all partitions on that instance
>>> will be moved away only after the delay timeout.
>>>
>>>
>>> Lei
>>>
>>> On Fri, Feb 16, 2018 at 8:42 AM, kishore g <g....@gmail.com> wrote:
>>>
>>>> Disable should move all partitions to OFFLINE state. This might be a
>>>> bug with DelayedRebalancer. Lei, do you know more about this?
>>>>
>>>> On Fri, Feb 16, 2018 at 7:54 AM, Bo Liu <ne...@gmail.com> wrote:
>>>>
>>>>>
>>>>> We'd like to change all partitions of a resource to Offline state and
>>>>> then let Helix to gradually move them to Online state. This will help us
>>>>> easily refresh the dataset hosted on the resource.
>>>>> We tried to disable&enable the resource. It doesn't change the states
>>>>> of any partitions. So I guess it only disables Helix management for the
>>>>> resource?
>>>>>
>>>>> --
>>>>> Best regards,
>>>>> Bo
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> Lei Xia
>>>
>>
>
>
> --
> Lei Xia
>
--
Best regards,
Bo
Re: Is there a way to reset an OnlineOffline resource?
Posted by Lei Xia <xi...@gmail.com>.
Did you see "HELIX_ENABLE" : "false" shown on your idealstate after you
disabling the resource. If yes, can you check if there are any pending
state transition messages under /INSTANCES/instancename/messages?
Lei
On Fri, Feb 16, 2018 at 9:04 AM, Bo Liu <ne...@gmail.com> wrote:
> We tried to disable it through helix ui and restful api.
>
> Yes, I think it's not caused by the delay feature. Because the disabled
> resource stayed at online state forever.
>
> On Feb 16, 2018 08:48, "Lei Xia" <xi...@gmail.com> wrote:
>
>> Hi, Bo
>>
>> Disable a resource will bring all of its partitions to OFFLINE. How
>> did you disable the resource? After disable the resource, do you see state
>> transition messages sent to the instances which holds the partitions.
>>
>> DelayedRebalancer won't delay the resource disable, but instance
>> disable, i.e, if you disable an instance, all partitions on that instance
>> will be moved away only after the delay timeout.
>>
>>
>> Lei
>>
>> On Fri, Feb 16, 2018 at 8:42 AM, kishore g <g....@gmail.com> wrote:
>>
>>> Disable should move all partitions to OFFLINE state. This might be a bug
>>> with DelayedRebalancer. Lei, do you know more about this?
>>>
>>> On Fri, Feb 16, 2018 at 7:54 AM, Bo Liu <ne...@gmail.com> wrote:
>>>
>>>>
>>>> We'd like to change all partitions of a resource to Offline state and
>>>> then let Helix to gradually move them to Online state. This will help us
>>>> easily refresh the dataset hosted on the resource.
>>>> We tried to disable&enable the resource. It doesn't change the states
>>>> of any partitions. So I guess it only disables Helix management for the
>>>> resource?
>>>>
>>>> --
>>>> Best regards,
>>>> Bo
>>>>
>>>>
>>>
>>
>>
>> --
>> Lei Xia
>>
>
--
Lei Xia
Re: Is there a way to reset an OnlineOffline resource?
Posted by Bo Liu <ne...@gmail.com>.
We tried to disable it through helix ui and restful api.
Yes, I think it's not caused by the delay feature. Because the disabled
resource stayed at online state forever.
On Feb 16, 2018 08:48, "Lei Xia" <xi...@gmail.com> wrote:
> Hi, Bo
>
> Disable a resource will bring all of its partitions to OFFLINE. How did
> you disable the resource? After disable the resource, do you see state
> transition messages sent to the instances which holds the partitions.
>
> DelayedRebalancer won't delay the resource disable, but instance
> disable, i.e, if you disable an instance, all partitions on that instance
> will be moved away only after the delay timeout.
>
>
> Lei
>
> On Fri, Feb 16, 2018 at 8:42 AM, kishore g <g....@gmail.com> wrote:
>
>> Disable should move all partitions to OFFLINE state. This might be a bug
>> with DelayedRebalancer. Lei, do you know more about this?
>>
>> On Fri, Feb 16, 2018 at 7:54 AM, Bo Liu <ne...@gmail.com> wrote:
>>
>>>
>>> We'd like to change all partitions of a resource to Offline state and
>>> then let Helix to gradually move them to Online state. This will help us
>>> easily refresh the dataset hosted on the resource.
>>> We tried to disable&enable the resource. It doesn't change the states of
>>> any partitions. So I guess it only disables Helix management for the
>>> resource?
>>>
>>> --
>>> Best regards,
>>> Bo
>>>
>>>
>>
>
>
> --
> Lei Xia
>
Re: Is there a way to reset an OnlineOffline resource?
Posted by Lei Xia <xi...@gmail.com>.
Hi, Bo
Disable a resource will bring all of its partitions to OFFLINE. How did
you disable the resource? After disable the resource, do you see state
transition messages sent to the instances which holds the partitions.
DelayedRebalancer won't delay the resource disable, but instance disable,
i.e, if you disable an instance, all partitions on that instance will be
moved away only after the delay timeout.
Lei
On Fri, Feb 16, 2018 at 8:42 AM, kishore g <g....@gmail.com> wrote:
> Disable should move all partitions to OFFLINE state. This might be a bug
> with DelayedRebalancer. Lei, do you know more about this?
>
> On Fri, Feb 16, 2018 at 7:54 AM, Bo Liu <ne...@gmail.com> wrote:
>
>>
>> We'd like to change all partitions of a resource to Offline state and
>> then let Helix to gradually move them to Online state. This will help us
>> easily refresh the dataset hosted on the resource.
>> We tried to disable&enable the resource. It doesn't change the states of
>> any partitions. So I guess it only disables Helix management for the
>> resource?
>>
>> --
>> Best regards,
>> Bo
>>
>>
>
--
Lei Xia
Re: Is there a way to reset an OnlineOffline resource?
Posted by kishore g <g....@gmail.com>.
Disable should move all partitions to OFFLINE state. This might be a bug
with DelayedRebalancer. Lei, do you know more about this?
On Fri, Feb 16, 2018 at 7:54 AM, Bo Liu <ne...@gmail.com> wrote:
>
> We'd like to change all partitions of a resource to Offline state and then
> let Helix to gradually move them to Online state. This will help us easily
> refresh the dataset hosted on the resource.
> We tried to disable&enable the resource. It doesn't change the states of
> any partitions. So I guess it only disables Helix management for the
> resource?
>
> --
> Best regards,
> Bo
>
>