Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

etcd not bootstrapping #17

Open
roberto-maggi opened this issue Nov 21, 2022 · 0 comments
Open

etcd not bootstrapping #17

roberto-maggi opened this issue Nov 21, 2022 · 0 comments

Comments

@roberto-maggi
Copy link

Hi you all,
first time ho Kubernetes bare metal, first issue I can't solve...

I went through all the procedure , inso far..., and got stuck at the etcd bootstrapping.

first I got problems with the certificates, avoided to solve fast the problem because I'm working on my own laptop,

this is the leader etcd1 etcd.service

[Unit]
Description=etcd
Documentation=http://github.com/coreos
[Service]
ExecStart=/usr/bin/etcd --name etcd1
--initial-advertise-peer-urls http://10.240.0.12:2380
--listen-peer-urls http://10.240.0.12:2380
--listen-client-urls http://10.240.0.12:2379,http://127.0.0.1:2379
--advertise-client-urls http://10.240.0.12:2379
--initial-cluster-token etcd-cluster-0
--initial-cluster etcd1=http://10.240.0.12:2380,etcd2=http://10.240.0.100:2380
--initial-cluster-state new
--data-dir=/var/lib/etcd
--debug
Restart=on-failure
RestartSec=5
[Install]
WantedBy=multi-user.target

here's the spare 2nd etcd

[Unit]
Description=etcd
Documentation=http://github.com/coreos
[Service]
ExecStart=/usr/bin/etcd --name etcd2
--initial-advertise-peer-urls http://10.240.0.100:2380
--listen-peer-urls http://10.240.0.100:2380
--listen-client-urls http://10.240.0.100:2379,http://127.0.0.1:2379
--advertise-client-urls http://10.240.0.100:2379
--initial-cluster-token etcd-cluster-0
--initial-cluster etcd1=http://10.240.0.12:2380,etcd2=http://10.240.0.100:2380
--initial-cluster-state new
--data-dir=/var/lib/etcd
--debug
Restart=on-failure
RestartSec=5
[Install]
WantedBy=multi-user.target

as you can see the service rose apparently correctly

[root@nodo1-etcd1 ~]# systemctl status etcd
● etcd.service - etcd
Loaded: loaded (/etc/systemd/system/etcd.service; enabled; vendor preset: disabled)
Active: active (running) since lun 2022-11-21 08:56:11 EST; 7min ago
Docs: http://github.com/coreos
Main PID: 10840 (etcd)
CGroup: /system.slice/etcd.service
└─10840 /usr/bin/etcd --name etcd1 --initial-advertise-peer-urls http://10.240...

nov 21 09:03:33 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 received vote from aebb404b9...030
nov 21 09:03:33 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 [logterm: 1, index: 2] sent ...030
nov 21 09:03:34 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 is starting a new election a...030
nov 21 09:03:34 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 became candidate at term 5031
nov 21 09:03:34 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 received vote from aebb404b9...031
nov 21 09:03:34 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 [logterm: 1, index: 2] sent ...031
nov 21 09:03:36 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 is starting a new election a...031
nov 21 09:03:36 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 became candidate at term 5032
nov 21 09:03:36 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 received vote from aebb404b9...032
nov 21 09:03:36 nodo1-etcd1 etcd[10840]: aebb404b9385ccd4 [logterm: 1, index: 2] sent ...032
[root@nodo1-etcd1 ~]#

The logs say

Nov 21 09:12:55 nodo1-etcd1 systemd: Started etcd.
Nov 21 09:12:55 nodo1-etcd1 etcd: etcd Version: 3.0.7
Nov 21 09:12:55 nodo1-etcd1 etcd: Git SHA: 5695120
Nov 21 09:12:55 nodo1-etcd1 etcd: Go Version: go1.6.3
Nov 21 09:12:55 nodo1-etcd1 etcd: Go OS/Arch: linux/amd64
Nov 21 09:12:55 nodo1-etcd1 etcd: setting maximum number of CPUs to 1, total number of available CPUs is 1
Nov 21 09:12:55 nodo1-etcd1 etcd: the server is already initialized as member before, starting as etcd member...
Nov 21 09:12:55 nodo1-etcd1 etcd: listening for peers on http://10.240.0.12:2380
Nov 21 09:12:55 nodo1-etcd1 etcd: listening for client requests on 10.240.0.12:2379
Nov 21 09:12:55 nodo1-etcd1 etcd: listening for client requests on 127.0.0.1:2379
Nov 21 09:12:55 nodo1-etcd1 etcd: name = etcd1
Nov 21 09:12:55 nodo1-etcd1 etcd: data dir = /var/lib/etcd
Nov 21 09:12:55 nodo1-etcd1 etcd: member dir = /var/lib/etcd/member
Nov 21 09:12:55 nodo1-etcd1 etcd: heartbeat = 100ms
Nov 21 09:12:55 nodo1-etcd1 etcd: election = 1000ms
Nov 21 09:12:55 nodo1-etcd1 etcd: snapshot count = 10000
Nov 21 09:12:55 nodo1-etcd1 etcd: advertise client URLs = http://10.240.0.12:2379
Nov 21 09:12:55 nodo1-etcd1 etcd: restarting member aebb404b9385ccd4 in cluster 629f6191abaccb2f at commit index 2
Nov 21 09:12:55 nodo1-etcd1 etcd: aebb404b9385ccd4 became follower at term 5419
Nov 21 09:12:55 nodo1-etcd1 etcd: newRaft aebb404b9385ccd4 [peers: [], term: 5419, commit: 2, applied: 0, lastindex: 2, lastterm: 1]
Nov 21 09:12:55 nodo1-etcd1 etcd: starting server... [version: 3.0.7, cluster version: to_be_decided]
Nov 21 09:12:55 nodo1-etcd1 etcd: added member 332a8a315e569778 [http://etcd2:2380] to cluster 629f6191abaccb2f
Nov 21 09:12:55 nodo1-etcd1 etcd: starting peer 332a8a315e569778...
Nov 21 09:12:55 nodo1-etcd1 etcd: started HTTP pipelining with peer 332a8a315e569778
Nov 21 09:12:55 nodo1-etcd1 etcd: started peer 332a8a315e569778
Nov 21 09:12:55 nodo1-etcd1 etcd: added peer 332a8a315e569778
Nov 21 09:12:55 nodo1-etcd1 etcd: added member aebb404b9385ccd4 [http://etcd1:2380] to cluster 629f6191abaccb2f
Nov 21 09:12:55 nodo1-etcd1 etcd: started streaming with peer 332a8a315e569778 (writer)
Nov 21 09:12:55 nodo1-etcd1 etcd: started streaming with peer 332a8a315e569778 (writer)
Nov 21 09:12:55 nodo1-etcd1 etcd: started streaming with peer 332a8a315e569778 (stream MsgApp v2 reader)
Nov 21 09:12:55 nodo1-etcd1 etcd: started streaming with peer 332a8a315e569778 (stream Message reader)
Nov 21 09:12:56 nodo1-etcd1 etcd: aebb404b9385ccd4 is starting a new election at term 5419
Nov 21 09:12:56 nodo1-etcd1 etcd: aebb404b9385ccd4 became candidate at term 5420
Nov 21 09:12:56 nodo1-etcd1 etcd: aebb404b9385ccd4 received vote from aebb404b9385ccd4 at term 5420
Nov 21 09:12:56 nodo1-etcd1 etcd: aebb404b9385ccd4 [logterm: 1, index: 2] sent vote request to 332a8a315e569778 at term 5420
Nov 21 09:12:57 nodo1-etcd1 etcd: aebb404b9385ccd4 is starting a new election at term 5420
Nov 21 09:12:57 nodo1-etcd1 etcd: aebb404b9385ccd4 became candidate at term 5421
Nov 21 09:12:57 nodo1-etcd1 etcd: aebb404b9385ccd4 received vote from aebb404b9385ccd4 at term 5421
Nov 21 09:12:57 nodo1-etcd1 etcd: aebb404b9385ccd4 [logterm: 1, index: 2] sent vote request to 332a8a315e569778 at term 5421
Nov 21 09:12:59 nodo1-etcd1 etcd: aebb404b9385ccd4 is starting a new election at term 5421
...

after some seconds it started raining

Nov 21 09:13:10 nodo1-etcd1 etcd: publish error: etcdserver: request timed out
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 journal: Suppressed 344 messages from /system.slice/etcd.service
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request sent was ignored (cluster ID mismatch: peer[332a8a315e569778]=6b4bc4b81731158f, local=629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)
Nov 21 09:13:10 nodo1-etcd1 etcd: request cluster ID mismatch (got 6b4bc4b81731158f want 629f6191abaccb2f)

Could some one give me a hand?
thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant