You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by "maker_dong@foxmail.com" <ma...@foxmail.com> on 2021/05/26 02:46:44 UTC

doris fe重启失败:Current node is not in the electable_nodes list. will exit

doris宕机,fe节点重启,起初一直刷:
wait catalog to be ready. FE type: UNKNOWN. is ready: false
在GitHub上查到在fe.conf中添加metadata_failure_recovery=true
重启,三个FOLLOWER节点都顺利恢复,但是OBSERVER节点会报错:
Current node is not in the electable_nodes list. will exit
附上FE状态:
+---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
| Name                            | IP           | HostName | EditLogPort | HttpPort | QueryPort | RpcPort | Role     | IsMaster | ClusterId  | Join  | Alive | ReplayedJournalId | LastHeartbeat       | IsHelper | ErrMsg        | Version       |
+---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
| 10.19.249.40_9011_1621994581221 | 10.19.249.40 | vplc04   | 9011        | 8030     | 0            | 0          | OBSERVER  | false    | 1776031258 | false | false | 0                       | NULL                          | false    | got exception | NULL          |
| 10.19.249.44_9011_1620463961328 | 10.19.249.44 | vplc08   | 9011        | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 | false | true  | 1050027           | 2021-05-26 10:38:25 | true     |           | trunk-cf82d2a |
| 10.19.249.42_9011_1620463909222 | 10.19.249.42 | vplc06   | 9011        | 8030     | 9030      | 9020    | FOLLOWER | true     | 1776031258 | true  | true  | 1066776           | 2021-05-26 10:38:25 | true     |           | trunk-cf82d2a |
| 10.19.249.43_9011_1620463960390 | 10.19.249.43 | vplc07   | 9011        | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 | false | true  | 1050785           | 2021-05-26 10:38:25 | true     |           | trunk-cf82d2a |
+---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
请问有人遇到过吗?
希望大佬帮助。



maker_dong@foxmail.com

Re: Re: doris fe重启失败:Current node is not in the electable_nodes list. will exit

Posted by ling miao <li...@apache.org>.
You can say which step the error happened.
An Observer can actually be understood as a stateless node. You can clean
up the previous environment and join the cluster as a brand new node.

Of course, first of all, you have to make sure you clean up the environment.
Secondly, it needs to be started with the --helper parameter.

Ling Miao

maker_dong@foxmail.com <ma...@foxmail.com> 于2021年5月26日周三 上午11:01写道:

> Thank you, I follow this process, but I can't solve it。
>
> ------------------------------
> maker_dong@foxmail.com
>
>
> *发件人:* ling miao <li...@apache.org>
> *发送时间:* 2021-05-26 10:52
> *收件人:* dev <de...@doris.apache.org>; maker_dong <ma...@foxmail.com>
> *主题:* Re: doris fe重启失败:Current node is not in the electable_nodes list.
> will exit
> The observer node
> 1. Firstly, using the command 'alter system drop observer' to drop the
> node.
> 2. Then clear the observer's metadata dir.
> 3. Start observer and add --helper parameter
> 4. After startup, you will see a log similar to 'wait to add'
> 5. Finally, use the 'alter system add observer' command to rejoin the
> observer to the cluster.
>
> Ling Miao
>
> maker_dong@foxmail.com <ma...@foxmail.com> 于2021年5月26日周三 上午10:47写道:
>
> > doris宕机,fe节点重启,起初一直刷:
> > wait catalog to be ready. FE type: UNKNOWN. is ready: false
> > 在GitHub上查到在fe.conf中添加metadata_failure_recovery=true
> > 重启,三个FOLLOWER节点都顺利恢复,但是OBSERVER节点会报错:
> > Current node is not in the electable_nodes list. will exit
> > 附上FE状态:
> >
> >
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
>
> > | Name                            | IP           | HostName |
> EditLogPort
> > | HttpPort | QueryPort | RpcPort | Role     | IsMaster | ClusterId  |
> Join
> > | Alive | ReplayedJournalId | LastHeartbeat       | IsHelper | ErrMsg
> >   | Version       |
> >
> >
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
>
> > | 10.19.249.40_9011_1621994581221 | 10.19.249.40 | vplc04   | 9011
> > | 8030     | 0            | 0          | OBSERVER  | false    |
> 1776031258
> > | false | false | 0                       |
> NULL                          |
> > false    | got exception | NULL          |
> > | 10.19.249.44_9011_1620463961328 | 10.19.249.44 | vplc08   | 9011
> > | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 |
> false
> > | true  | 1050027           | 2021-05-26 10:38:25 | true     |
> |
> > trunk-cf82d2a |
> > | 10.19.249.42_9011_1620463909222 | 10.19.249.42 | vplc06   | 9011
> > | 8030     | 9030      | 9020    | FOLLOWER | true     | 1776031258 |
> true
> > | true  | 1066776           | 2021-05-26 10:38:25 | true     |
> |
> > trunk-cf82d2a |
> > | 10.19.249.43_9011_1620463960390 | 10.19.249.43 | vplc07   | 9011
> > | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 |
> false
> > | true  | 1050785           | 2021-05-26 10:38:25 | true     |
> |
> > trunk-cf82d2a |
> >
> >
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
>
> > 请问有人遇到过吗?
> > 希望大佬帮助。
> >
> >
> >
> > maker_dong@foxmail.com
> >
>
>

Re: Re: doris fe重启失败:Current node is not in the electable_nodes list. will exit

Posted by "maker_dong@foxmail.com" <ma...@foxmail.com>.
The observer node
1. Firstly, using the command 'alter system drop observer' to drop the node.
2. Then clear the observer's metadata dir.
3. Start observer and add --helper parameter
4. After startup, you will see a log similar to 'wait to add'
5. Finally, use the 'alter system add observer' command to rejoin the
observer to the cluster.

Ling Miao

maker_dong@foxmail.com <ma...@foxmail.com> 于2021年5月26日周三 上午10:47写道:

> doris宕机,fe节点重启,起初一直刷:
> wait catalog to be ready. FE type: UNKNOWN. is ready: false
> 在GitHub上查到在fe.conf中添加metadata_failure_recovery=true
> 重启,三个FOLLOWER节点都顺利恢复,但是OBSERVER节点会报错:
> Current node is not in the electable_nodes list. will exit
> 附上FE状态:
>
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
> | Name                            | IP           | HostName | EditLogPort
> | HttpPort | QueryPort | RpcPort | Role     | IsMaster | ClusterId  | Join
> | Alive | ReplayedJournalId | LastHeartbeat       | IsHelper | ErrMsg
>   | Version       |
>
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
> | 10.19.249.40_9011_1621994581221 | 10.19.249.40 | vplc04   | 9011
> | 8030     | 0            | 0          | OBSERVER  | false    | 1776031258
> | false | false | 0                       | NULL                          |
> false    | got exception | NULL          |
> | 10.19.249.44_9011_1620463961328 | 10.19.249.44 | vplc08   | 9011
> | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 | false
> | true  | 1050027           | 2021-05-26 10:38:25 | true     |           |
> trunk-cf82d2a |
> | 10.19.249.42_9011_1620463909222 | 10.19.249.42 | vplc06   | 9011
> | 8030     | 9030      | 9020    | FOLLOWER | true     | 1776031258 | true
> | true  | 1066776           | 2021-05-26 10:38:25 | true     |           |
> trunk-cf82d2a |
> | 10.19.249.43_9011_1620463960390 | 10.19.249.43 | vplc07   | 9011
> | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 | false
> | true  | 1050785           | 2021-05-26 10:38:25 | true     |           |
> trunk-cf82d2a |
>
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
> 请问有人遇到过吗?
> 希望大佬帮助。
>
>
>
> maker_dong@foxmail.com
>

Re: doris fe重启失败:Current node is not in the electable_nodes list. will exit

Posted by ling miao <li...@apache.org>.
The observer node
1. Firstly, using the command 'alter system drop observer' to drop the node.
2. Then clear the observer's metadata dir.
3. Start observer and add --helper parameter
4. After startup, you will see a log similar to 'wait to add'
5. Finally, use the 'alter system add observer' command to rejoin the
observer to the cluster.

Ling Miao

maker_dong@foxmail.com <ma...@foxmail.com> 于2021年5月26日周三 上午10:47写道:

> doris宕机,fe节点重启,起初一直刷:
> wait catalog to be ready. FE type: UNKNOWN. is ready: false
> 在GitHub上查到在fe.conf中添加metadata_failure_recovery=true
> 重启,三个FOLLOWER节点都顺利恢复,但是OBSERVER节点会报错:
> Current node is not in the electable_nodes list. will exit
> 附上FE状态:
>
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
> | Name                            | IP           | HostName | EditLogPort
> | HttpPort | QueryPort | RpcPort | Role     | IsMaster | ClusterId  | Join
> | Alive | ReplayedJournalId | LastHeartbeat       | IsHelper | ErrMsg
>   | Version       |
>
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
> | 10.19.249.40_9011_1621994581221 | 10.19.249.40 | vplc04   | 9011
> | 8030     | 0            | 0          | OBSERVER  | false    | 1776031258
> | false | false | 0                       | NULL                          |
> false    | got exception | NULL          |
> | 10.19.249.44_9011_1620463961328 | 10.19.249.44 | vplc08   | 9011
> | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 | false
> | true  | 1050027           | 2021-05-26 10:38:25 | true     |           |
> trunk-cf82d2a |
> | 10.19.249.42_9011_1620463909222 | 10.19.249.42 | vplc06   | 9011
> | 8030     | 9030      | 9020    | FOLLOWER | true     | 1776031258 | true
> | true  | 1066776           | 2021-05-26 10:38:25 | true     |           |
> trunk-cf82d2a |
> | 10.19.249.43_9011_1620463960390 | 10.19.249.43 | vplc07   | 9011
> | 8030     | 9030      | 9020    | FOLLOWER | false    | 1776031258 | false
> | true  | 1050785           | 2021-05-26 10:38:25 | true     |           |
> trunk-cf82d2a |
>
> +---------------------------------+--------------+----------+-------------+----------+-----------+---------+----------+----------+------------+-------+-------+-------------------+---------------------+----------+---------------+---------------+
> 请问有人遇到过吗?
> 希望大佬帮助。
>
>
>
> maker_dong@foxmail.com
>