Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flakes: TestLeaseGrantAndList/.../many_leases #13877

Closed
ptabor opened this issue Apr 3, 2022 · 1 comment
Closed

Flakes: TestLeaseGrantAndList/.../many_leases #13877

ptabor opened this issue Apr 3, 2022 · 1 comment

Comments

@ptabor
Copy link
Contributor

ptabor commented Apr 3, 2022 •
edited
Loading

https://github.com/etcd-io/etcd/runs/5804919674?check_suite_focus=true
https://github.com/etcd-io/etcd/runs/5804807788?check_suite_focus=true

=== CONT  TestLeaseGrantAndList/PeerAutoTLS/many_leases
    logger.go:130: 2022-04-03T09:30:30.053Z	INFO	m1	added member	{"member": "m1", "cluster-id": "d7cb653fa87df556", "local-member-id": "46ab64b97d116daa", "added-peer-id": "46ab64b97d116daa", "added-peer-peer-urls": ["unixs://127.0.0.1:2124206309"], "added-peer-is-learner": false}
    logger.go:130: 2022-04-03T09:30:30.054Z	INFO	m2	set message encoder	{"member": "m2", "from": "75ab03a884322e37", "to": "46ab64b97d116daa", "stream-type": "stream MsgApp v2"}
    logger.go:130: 2022-04-03T09:30:30.054Z	INFO	m2	set message encoder	{"member": "m2", "from": "75ab03a884322e37", "to": "46ab64b97d116daa", "stream-type": "stream Message"}
    logger.go:130: 2022-04-03T09:30:30.057Z	INFO	m0	starting initial election tick advance	{"member": "m0", "election-ticks": 10}
    logger.go:130: 2022-04-03T09:30:30.057Z	INFO	m0.raft	82e0e63a7e6bbcf4 switched to configuration voters=(5092274551502499242 8478874745762360887 9430790758617300212)	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.069Z	INFO	m1	launched a member	{"member": "m1", "name": "m1", "advertise-peer-urls": ["unixs://127.0.0.1:2124206309"], "listen-client-urls": ["unix://127.0.0.1:2124306309"], "grpc-url": "unix://localhost:m1"}
=== CONT  TestLeaseGrantAndList/PeerAutoTLS/many_leases
    logger.go:130: 2022-04-03T09:30:30.071Z	INFO	m1.raft	46ab64b97d116daa switched to configuration voters=(5092274551502499242 8478874745762360887 9430790758617300212)	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.071Z	INFO	m1	added member	{"member": "m1", "cluster-id": "d7cb653fa87df556", "local-member-id": "46ab64b97d116daa", "added-peer-id": "75ab03a884322e37", "added-peer-peer-urls": ["unixs://127.0.0.1:2124506309"], "added-peer-is-learner": false}
    logger.go:130: 2022-04-03T09:30:30.074Z	INFO	m1.raft	46ab64b97d116daa switched to configuration voters=(5092274551502499242 8478874745762360887 9430790758617300212)	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.074Z	INFO	m1	added member	{"member": "m1", "cluster-id": "d7cb653fa87df556", "local-member-id": "46ab64b97d116daa", "added-peer-id": "82e0e63a7e6bbcf4", "added-peer-peer-urls": ["unixs://127.0.0.1:2123906309"], "added-peer-is-learner": false}
    logger.go:130: 2022-04-03T09:30:30.074Z	INFO	m2	peer became active	{"member": "m2", "peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.074Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-writer-type": "stream MsgApp v2", "local-member-id": "75ab03a884322e37", "remote-peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.074Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-writer-type": "stream Message", "local-member-id": "75ab03a884322e37", "remote-peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.074Z	INFO	m0	added member	{"member": "m0", "cluster-id": "d7cb653fa87df556", "local-member-id": "82e0e63a7e6bbcf4", "added-peer-id": "46ab64b97d116daa", "added-peer-peer-urls": ["unixs://127.0.0.1:2124206309"], "added-peer-is-learner": false}
    logger.go:130: 2022-04-03T09:30:30.075Z	INFO	m0.raft	82e0e63a7e6bbcf4 switched to configuration voters=(5092274551502499242 8478874745762360887 9430790758617300212)	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.075Z	INFO	m0	added member	{"member": "m0", "cluster-id": "d7cb653fa87df556", "local-member-id": "82e0e63a7e6bbcf4", "added-peer-id": "75ab03a884322e37", "added-peer-peer-urls": ["unixs://127.0.0.1:2124506309"], "added-peer-is-learner": false}
    logger.go:130: 2022-04-03T09:30:30.075Z	INFO	m0.raft	82e0e63a7e6bbcf4 switched to configuration voters=(5092274551502499242 8478874745762360887 9430790758617300212)	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.075Z	INFO	m0	added member	{"member": "m0", "cluster-id": "d7cb653fa87df556", "local-member-id": "82e0e63a7e6bbcf4", "added-peer-id": "82e0e63a7e6bbcf4", "added-peer-peer-urls": ["unixs://127.0.0.1:2123906309"], "added-peer-is-learner": false}
=== CONT  TestLeaseGrantAndList/PeerAutoTLS/many_leases
    logger.go:130: 2022-04-03T09:30:30.077Z	INFO	m2	launched a member	{"member": "m2", "name": "m2", "advertise-peer-urls": ["unixs://127.0.0.1:2124506309"], "listen-client-urls": ["unix://127.0.0.1:2124606309"], "grpc-url": "unix://localhost:m2"}
=== CONT  TestLeaseGrantAndList/PeerAutoTLS/many_leases
    logger.go:130: 2022-04-03T09:30:30.078Z	INFO	m0	launched a member	{"member": "m0", "name": "m0", "advertise-peer-urls": ["unixs://127.0.0.1:2123906309"], "listen-client-urls": ["unix://127.0.0.1:2124006309"], "grpc-url": "unix://localhost:m0"}
    logger.go:130: 2022-04-03T09:30:30.082Z	INFO	m2	set message encoder	{"member": "m2", "from": "75ab03a884322e37", "to": "82e0e63a7e6bbcf4", "stream-type": "stream Message"}
    logger.go:130: 2022-04-03T09:30:30.087Z	INFO	m2	peer became active	{"member": "m2", "peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.087Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-writer-type": "stream Message", "local-member-id": "75ab03a884322e37", "remote-peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.088Z	INFO	m0	peer became active	{"member": "m0", "peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.088Z	INFO	m0	established TCP streaming connection with remote peer	{"member": "m0", "stream-reader-type": "stream Message", "local-member-id": "82e0e63a7e6bbcf4", "remote-peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.088Z	INFO	m0	established TCP streaming connection with remote peer	{"member": "m0", "stream-reader-type": "stream MsgApp v2", "local-member-id": "82e0e63a7e6bbcf4", "remote-peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.088Z	INFO	m2	set message encoder	{"member": "m2", "from": "75ab03a884322e37", "to": "82e0e63a7e6bbcf4", "stream-type": "stream MsgApp v2"}
    logger.go:130: 2022-04-03T09:30:30.088Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-writer-type": "stream MsgApp v2", "local-member-id": "75ab03a884322e37", "remote-peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.094Z	INFO	m2	initialized peer connections; fast-forwarding election ticks	{"member": "m2", "local-member-id": "75ab03a884322e37", "forward-ticks": 8, "forward-duration": "80ms", "election-ticks": 10, "election-timeout": "100ms", "active-remote-members": 2}
    logger.go:130: 2022-04-03T09:30:30.105Z	INFO	m1	initialized peer connections; fast-forwarding election ticks	{"member": "m1", "local-member-id": "46ab64b97d116daa", "forward-ticks": 8, "forward-duration": "80ms", "election-ticks": 10, "election-timeout": "100ms", "active-remote-members": 2}
    logger.go:130: 2022-04-03T09:30:30.106Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-reader-type": "stream MsgApp v2", "local-member-id": "75ab03a884322e37", "remote-peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.107Z	INFO	m1	set message encoder	{"member": "m1", "from": "46ab64b97d116daa", "to": "75ab03a884322e37", "stream-type": "stream Message"}
    logger.go:130: 2022-04-03T09:30:30.107Z	INFO	m1	established TCP streaming connection with remote peer	{"member": "m1", "stream-writer-type": "stream Message", "local-member-id": "46ab64b97d116daa", "remote-peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.107Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-reader-type": "stream Message", "local-member-id": "75ab03a884322e37", "remote-peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.108Z	INFO	m1.raft	46ab64b97d116daa is starting a new election at term 1	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.109Z	INFO	m1.raft	46ab64b97d116daa became candidate at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.109Z	INFO	m1.raft	46ab64b97d116daa received MsgVoteResp from 46ab64b97d116daa at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.109Z	INFO	m1.raft	46ab64b97d116daa [logterm: 1, index: 3] sent MsgVote request to 75ab03a884322e37 at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.109Z	INFO	m1.raft	46ab64b97d116daa [logterm: 1, index: 3] sent MsgVote request to 82e0e63a7e6bbcf4 at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.114Z	INFO	m0.raft	82e0e63a7e6bbcf4 [term: 1] received a MsgVote message with higher term from 46ab64b97d116daa [term: 2]	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.114Z	INFO	m0.raft	82e0e63a7e6bbcf4 became follower at term 2	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.114Z	INFO	m0.raft	82e0e63a7e6bbcf4 [logterm: 1, index: 3, vote: 0] cast MsgVote for 46ab64b97d116daa [logterm: 1, index: 3] at term 2	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.114Z	INFO	m2.raft	75ab03a884322e37 [term: 1] received a MsgVote message with higher term from 46ab64b97d116daa [term: 2]	{"member": "m2"}
    logger.go:130: 2022-04-03T09:30:30.114Z	INFO	m2.raft	75ab03a884322e37 became follower at term 2	{"member": "m2"}
    logger.go:130: 2022-04-03T09:30:30.114Z	INFO	m2.raft	75ab03a884322e37 [logterm: 1, index: 3, vote: 0] cast MsgVote for 46ab64b97d116daa [logterm: 1, index: 3] at term 2	{"member": "m2"}
    logger.go:130: 2022-04-03T09:30:30.119Z	INFO	m0	set message encoder	{"member": "m0", "from": "82e0e63a7e6bbcf4", "to": "75ab03a884322e37", "stream-type": "stream Message"}
    logger.go:130: 2022-04-03T09:30:30.119Z	INFO	m0	established TCP streaming connection with remote peer	{"member": "m0", "stream-writer-type": "stream Message", "local-member-id": "82e0e63a7e6bbcf4", "remote-peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.119Z	INFO	m1.raft	46ab64b97d116daa received MsgVoteResp from 75ab03a884322e37 at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.119Z	INFO	m1.raft	46ab64b97d116daa has received 2 MsgVoteResp votes and 0 vote rejections	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.119Z	INFO	m1.raft	46ab64b97d116daa became leader at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.119Z	INFO	m1.raft	raft.node: 46ab64b97d116daa elected leader 46ab64b97d116daa at term 2	{"member": "m1"}
    logger.go:130: 2022-04-03T09:30:30.120Z	INFO	m0.raft	raft.node: 82e0e63a7e6bbcf4 elected leader 46ab64b97d116daa at term 2	{"member": "m0"}
    logger.go:130: 2022-04-03T09:30:30.120Z	INFO	m2.raft	raft.node: 75ab03a884322e37 elected leader 46ab64b97d116daa at term 2	{"member": "m2"}
    logger.go:130: 2022-04-03T09:30:30.124Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-reader-type": "stream Message", "local-member-id": "75ab03a884322e37", "remote-peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.126Z	INFO	m0	set message encoder	{"member": "m0", "from": "82e0e63a7e6bbcf4", "to": "75ab03a884322e37", "stream-type": "stream MsgApp v2"}
    logger.go:130: 2022-04-03T09:30:30.129Z	INFO	m0	established TCP streaming connection with remote peer	{"member": "m0", "stream-writer-type": "stream MsgApp v2", "local-member-id": "82e0e63a7e6bbcf4", "remote-peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.127Z	INFO	m2	established TCP streaming connection with remote peer	{"member": "m2", "stream-reader-type": "stream MsgApp v2", "local-member-id": "75ab03a884322e37", "remote-peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.127Z	INFO	m1	published local member to cluster through raft	{"member": "m1", "local-member-id": "46ab64b97d116daa", "local-member-attributes": "{Name:m1 ClientURLs:[unix://127.0.0.1:2124306309]}", "cluster-id": "d7cb653fa87df556", "publish-timeout": "5.2s"}
    logger.go:130: 2022-04-03T09:30:30.127Z	INFO	m0	set message encoder	{"member": "m0", "from": "82e0e63a7e6bbcf4", "to": "46ab64b97d116daa", "stream-type": "stream Message"}
    logger.go:130: 2022-04-03T09:30:30.129Z	INFO	m0	established TCP streaming connection with remote peer	{"member": "m0", "stream-writer-type": "stream Message", "local-member-id": "82e0e63a7e6bbcf4", "remote-peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.127Z	INFO	m2	published local member to cluster through raft	{"member": "m2", "local-member-id": "75ab03a884322e37", "local-member-attributes": "{Name:m2 ClientURLs:[unix://127.0.0.1:2124606309]}", "cluster-id": "d7cb653fa87df556", "publish-timeout": "5.2s"}
    logger.go:130: 2022-04-03T09:30:30.127Z	INFO	m1	established TCP streaming connection with remote peer	{"member": "m1", "stream-reader-type": "stream Message", "local-member-id": "46ab64b97d116daa", "remote-peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.127Z	INFO	m1	set message encoder	{"member": "m1", "from": "46ab64b97d116daa", "to": "75ab03a884322e37", "stream-type": "stream MsgApp v2"}
    logger.go:130: 2022-04-03T09:30:30.130Z	INFO	m1	established TCP streaming connection with remote peer	{"member": "m1", "stream-writer-type": "stream MsgApp v2", "local-member-id": "46ab64b97d116daa", "remote-peer-id": "75ab03a884322e37"}
    logger.go:130: 2022-04-03T09:30:30.128Z	INFO	m0	initialized peer connections; fast-forwarding election ticks	{"member": "m0", "local-member-id": "82e0e63a7e6bbcf4", "forward-ticks": 8, "forward-duration": "80ms", "election-ticks": 10, "election-timeout": "100ms", "active-remote-members": 2}
    logger.go:130: 2022-04-03T09:30:30.135Z	INFO	m0	set message encoder	{"member": "m0", "from": "82e0e63a7e6bbcf4", "to": "46ab64b97d116daa", "stream-type": "stream MsgApp v2"}
    logger.go:130: 2022-04-03T09:30:30.135Z	INFO	m0	established TCP streaming connection with remote peer	{"member": "m0", "stream-writer-type": "stream MsgApp v2", "local-member-id": "82e0e63a7e6bbcf4", "remote-peer-id": "46ab64b97d116daa"}
    logger.go:130: 2022-04-03T09:30:30.135Z	INFO	m0	published local member to cluster through raft	{"member": "m0", "local-member-id": "82e0e63a7e6bbcf4", "local-member-attributes": "{Name:m0 ClientURLs:[unix://127.0.0.1:2124006309]}", "cluster-id": "d7cb653fa87df556", "publish-timeout": "5.2s"}
    logger.go:130: 2022-04-03T09:30:30.135Z	INFO	m1	established TCP streaming connection with remote peer	{"member": "m1", "stream-reader-type": "stream MsgApp v2", "local-member-id": "46ab64b97d116daa", "remote-peer-id": "82e0e63a7e6bbcf4"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m1	setting up initial cluster version using v3 API	{"member": "m1", "cluster-version": "3.6"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m1	set initial cluster version	{"member": "m1", "cluster-id": "d7cb653fa87df556", "local-member-id": "46ab64b97d116daa", "cluster-version": "3.6"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m1	cluster version is updated	{"member": "m1", "cluster-version": "3.6"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m0	set initial cluster version	{"member": "m0", "cluster-id": "d7cb653fa87df556", "local-member-id": "82e0e63a7e6bbcf4", "cluster-version": "3.6"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m1	cluster version differs from storage version.	{"member": "m1", "cluster-version": "3.6.0", "storage-version": "3.5.0"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m1	updated storage version	{"member": "m1", "new-storage-version": "3.6.0"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m0	cluster version differs from storage version.	{"member": "m0", "cluster-version": "3.6.0", "storage-version": "3.5.0"}
    logger.go:130: 2022-04-03T09:30:30.151Z	INFO	m0	updated storage version	{"member": "m0", "new-storage-version": "3.6.0"}
    logger.go:130: 2022-04-03T09:30:30.152Z	INFO	m2	set initial cluster version	{"member": "m2", "cluster-id": "d7cb653fa87df556", "local-member-id": "75ab03a884322e37", "cluster-version": "3.6"}
    logger.go:130: 2022-04-03T09:30:30.152Z	INFO	m2	cluster version differs from storage version.	{"member": "m2", "cluster-version": "3.6.0", "storage-version": "3.5.0"}
    logger.go:130: 2022-04-03T09:30:30.152Z	INFO	m2	updated storage version	{"member": "m2", "new-storage-version": "3.6.0"}
    cluster.go:236:  - m0 -> 82e0e63a7e6bbcf4 (unix://localhost:m0)
    cluster.go:236:  - m1 -> 46ab64b97d116daa (unix://localhost:m1)
    cluster.go:236:  - m2 -> 75ab03a884322e37 (unix://localhost:m2)
=== CONT  TestLeaseGrantAndList/PeerAutoTLS/many_leases
    lease_test.go:137: 
        	Error Trace:	lease_test.go:137
        	            				execute.go:29
        	            				asm_amd64.s:1581
        	Error:      	"[{%!s(clientv3.LeaseID=333027111[291](https://github.com/etcd-io/etcd/runs/5804919674?check_suite_focus=true#step:5:291)3927428)} {%!s(clientv3.LeaseID=7902269159625110789)}]" should have 3 item(s), but has 2
        	Test:       	TestLeaseGrantAndList/PeerAutoTLS/many_leases
=== CONT  TestLeaseGrantAndList/PeerAutoTLS/many_leases
@serathius
Copy link
Member

This should be fixed by #13868 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@serathius @ptabor