启动发现storage日志不能选举leader

[yangmeng]

启动之前

开始启动, 发现storagederr.log有日志中显示不能选举leader

这个日志是正常的嘛?

[yangmeng]

I0722 10:03:15.487586     1 NebulaStore.cpp:111] Load space 1 from disk
I0722 10:03:17.302532     1 NebulaStore.cpp:146] Need to open 15 parts of space 1
I0722 10:03:17.313266    65 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 1] lastLogId in wal is 20798762, lastLogTerm is 156, path is /data/storage/nebula/1/wal/1/0000000000020798754.wal
I0722 10:03:17.313446    68 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 4] lastLogId in wal is 20798813, lastLogTerm is 214, path is /data/storage/nebula/1/wal/4/0000000000020798805.wal
I0722 10:03:17.313454    66 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 2] lastLogId in wal is 20798201, lastLogTerm is 39, path is /data/storage/nebula/1/wal/2/0000000000020798194.wal
I0722 10:03:17.313570    67 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 3] lastLogId in wal is 20798410, lastLogTerm is 21, path is /data/storage/nebula/1/wal/3/0000000000020798402.wal
I0722 10:03:17.314484    65 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 1] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798762, lastLogTerm 156, committedLogId 20798760, term 156
I0722 10:03:17.314535    66 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 2] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798201, lastLogTerm 39, committedLogId 20798200, term 39
I0722 10:03:17.314543    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 1] Add peer "7代替IP1":44501
I0722 10:03:17.314550    68 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 4] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798813, lastLogTerm 214, committedLogId 20798811, term 214
I0722 10:03:17.314594    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 2] Add peer "7代替IP1":44501
I0722 10:03:17.314627    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 1] Add peer "7代替IP2":44501
I0722 10:03:17.314769    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 2] Add peer "7代替IP2":44501
I0722 10:03:17.314704    68 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 4] Add peer "7代替IP1":44501
I0722 10:03:17.314623    67 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 3] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798410, lastLogTerm 21, committedLogId 20798408, term 21
I0722 10:03:17.314936    65 NebulaStore.cpp:177] Load part 1, 1 from disk
I0722 10:03:17.314945    68 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 4] Add peer "7代替IP2":44501
I0722 10:03:17.315091    66 NebulaStore.cpp:177] Load part 1, 2 from disk
I0722 10:03:17.315007    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 3] Add peer "7代替IP2":44501
I0722 10:03:17.315147    65 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 5] lastLogId in wal is 20798691, lastLogTerm is 65, path is /data/storage/nebula/1/wal/5/0000000000020798684.wal
I0722 10:03:17.315213    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 3] Add peer "7代替IP1":44501
I0722 10:03:17.315291    68 NebulaStore.cpp:177] Load part 1, 4 from disk
I0722 10:03:17.315294    65 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 5] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798691, lastLogTerm 65, committedLogId 20798689, term 65
I0722 10:03:17.315383    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 5] Add peer "7代替IP1":44501
I0722 10:03:17.315415    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 5] Add peer "7代替IP2":44501
I0722 10:03:17.315436    65 NebulaStore.cpp:177] Load part 1, 5 from disk
I0722 10:03:17.315366    66 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 6] lastLogId in wal is 20798750, lastLogTerm is 183, path is /data/storage/nebula/1/wal/6/0000000000020798742.wal
I0722 10:03:17.315450    67 NebulaStore.cpp:177] Load part 1, 3 from disk
I0722 10:03:17.315575    65 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 9] lastLogId in wal is 20798879, lastLogTerm is 63, path is /data/storage/nebula/1/wal/9/0000000000020798872.wal
I0722 10:03:17.315587    68 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 8] lastLogId in wal is 20798343, lastLogTerm is 36, path is /data/storage/nebula/1/wal/8/0000000000020798335.wal
I0722 10:03:17.315765    67 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 7] lastLogId in wal is 20798881, lastLogTerm is 194, path is /data/storage/nebula/1/wal/7/0000000000020798875.wal
I0722 10:03:17.315676    65 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 9] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798879, lastLogTerm 63, committedLogId 20798878, term 63
I0722 10:03:17.315865    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 9] Add peer "7代替IP2":44501
I0722 10:03:17.315888    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 9] Add peer "7代替IP1":44501
I0722 10:03:17.315630    66 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 6] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798750, lastLogTerm 183, committedLogId 20798748, term 183
I0722 10:03:17.315908    65 NebulaStore.cpp:177] Load part 1, 9 from disk
I0722 10:03:17.315923    68 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 8] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798343, lastLogTerm 36, committedLogId 20798341, term 36
I0722 10:03:17.315961    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 6] Add peer "7代替IP2":44501
I0722 10:03:17.315964    67 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 7] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798881, lastLogTerm 194, committedLogId 20798880, term 194
I0722 10:03:17.316056    68 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 8] Add peer "7代替IP1":44501
I0722 10:03:17.316092    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 6] Add peer "7代替IP1":44501
I0722 10:03:17.316102    65 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 13] lastLogId in wal is 20798469, lastLogTerm is 28, path is /data/storage/nebula/1/wal/13/0000000000020798462.wal
I0722 10:03:17.316129    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 7] Add peer "7代替IP1":44501
I0722 10:03:17.316171    68 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 8] Add peer "7代替IP2":44501
I0722 10:03:17.316203    66 NebulaStore.cpp:177] Load part 1, 6 from disk
I0722 10:03:17.316252    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 7] Add peer "7代替IP2":44501
I0722 10:03:17.316284    65 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 13] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798469, lastLogTerm 28, committedLogId 20798467, term 28
I0722 10:03:17.316396    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 13] Add peer "7代替IP1":44501
I0722 10:03:17.316370    67 NebulaStore.cpp:177] Load part 1, 7 from disk
I0722 10:03:17.316293    68 NebulaStore.cpp:177] Load part 1, 8 from disk
I0722 10:03:17.316413    65 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 13] Add peer "7代替IP2":44501
I0722 10:03:17.316525    65 NebulaStore.cpp:177] Load part 1, 13 from disk
I0722 10:03:17.316545    66 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 10] lastLogId in wal is 20798807, lastLogTerm is 58, path is /data/storage/nebula/1/wal/10/0000000000020798800.wal
I0722 10:03:17.316679    67 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 11] lastLogId in wal is 20798732, lastLogTerm is 201, path is /data/storage/nebula/1/wal/11/0000000000020798724.wal
I0722 10:03:17.316704    66 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 10] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798807, lastLogTerm 58, committedLogId 20798805, term 58
I0722 10:03:17.316711    68 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 12] lastLogId in wal is 20798381, lastLogTerm is 169, path is /data/storage/nebula/1/wal/12/0000000000020798374.wal
I0722 10:03:17.316762    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 10] Add peer "7代替IP1":44501
I0722 10:03:17.316830    67 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 11] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798732, lastLogTerm 201, committedLogId 20798730, term 201
I0722 10:03:17.316856    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 10] Add peer "7代替IP2":44501
I0722 10:03:17.316928    68 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 12] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798381, lastLogTerm 169, committedLogId 20798380, term 169
I0722 10:03:17.316975    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 11] Add peer "7代替IP1":44501
I0722 10:03:17.317049    66 NebulaStore.cpp:177] Load part 1, 10 from disk
I0722 10:03:17.317091    68 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 12] Add peer "7代替IP2":44501
I0722 10:03:17.317132    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 11] Add peer "7代替IP2":44501
I0722 10:03:17.317220    68 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 12] Add peer "7代替IP1":44501
I0722 10:03:17.317286    67 NebulaStore.cpp:177] Load part 1, 11 from disk
I0722 10:03:17.317389    68 NebulaStore.cpp:177] Load part 1, 12 from disk
I0722 10:03:17.317420    66 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 14] lastLogId in wal is 20798752, lastLogTerm is 66, path is /data/storage/nebula/1/wal/14/0000000000020798745.wal
I0722 10:03:17.317585    66 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 14] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798752, lastLogTerm 66, committedLogId 20798750, term 66
I0722 10:03:17.317607    67 FileBasedWal.cpp:65] [Port: 44501, Space: 1, Part: 15] lastLogId in wal is 20798839, lastLogTerm is 71, path is /data/storage/nebula/1/wal/15/0000000000020798832.wal
I0722 10:03:17.317627    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 14] Add peer "7代替IP1":44501
I0722 10:03:17.317700    66 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 14] Add peer "7代替IP2":44501
I0722 10:03:17.317734    66 NebulaStore.cpp:177] Load part 1, 14 from disk
I0722 10:03:17.317787    67 RaftPart.cpp:295] [Port: 44501, Space: 1, Part: 15] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 20798839, lastLogTerm 71, committedLogId 20798838, term 71
I0722 10:03:17.317824    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 15] Add peer "7代替IP2":44501
I0722 10:03:17.317852    67 RaftPart.cpp:308] [Port: 44501, Space: 1, Part: 15] Add peer "7代替IP1":44501
I0722 10:03:17.317885    67 NebulaStore.cpp:177] Load part 1, 15 from disk
I0722 10:03:17.317932     1 NebulaStore.cpp:192] Load space 1 complete
I0722 10:03:17.317989     1 NebulaStore.cpp:201] Init data from partManager for "7.185.170.3":44500
I0722 10:03:17.318055     1 NebulaStore.cpp:291] Data space 1 has existed!
I0722 10:03:17.318087     1 NebulaStore.cpp:330] [Space: 1, Part: 1] has existed!
I0722 10:03:17.318114     1 NebulaStore.cpp:330] [Space: 1, Part: 2] has existed!
I0722 10:03:17.318140     1 NebulaStore.cpp:330] [Space: 1, Part: 3] has existed!
I0722 10:03:17.318166     1 NebulaStore.cpp:330] [Space: 1, Part: 4] has existed!
I0722 10:03:17.318195     1 NebulaStore.cpp:330] [Space: 1, Part: 5] has existed!
I0722 10:03:17.318222     1 NebulaStore.cpp:330] [Space: 1, Part: 6] has existed!
I0722 10:03:17.318250     1 NebulaStore.cpp:330] [Space: 1, Part: 7] has existed!
I0722 10:03:17.318277     1 NebulaStore.cpp:330] [Space: 1, Part: 8] has existed!
I0722 10:03:17.318303     1 NebulaStore.cpp:330] [Space: 1, Part: 9] has existed!
I0722 10:03:17.318331     1 NebulaStore.cpp:330] [Space: 1, Part: 10] has existed!
I0722 10:03:17.318358     1 NebulaStore.cpp:330] [Space: 1, Part: 11] has existed!
I0722 10:03:17.318385     1 NebulaStore.cpp:330] [Space: 1, Part: 12] has existed!
I0722 10:03:17.318413     1 NebulaStore.cpp:330] [Space: 1, Part: 13] has existed!
I0722 10:03:17.318439     1 NebulaStore.cpp:330] [Space: 1, Part: 14] has existed!
I0722 10:03:17.318464     1 NebulaStore.cpp:330] [Space: 1, Part: 15] has existed!
I0722 10:03:17.318516     1 NebulaStore.cpp:68] Register handler...
I0722 10:03:17.318545     1 StorageServer.cpp:83] Starting Storage HTTP Service
I0722 10:03:17.321270     1 StorageServer.cpp:87] Http Thread Pool started
I0722 10:03:17.325740   148 WebService.cpp:131] Web service started on HTTP[12000], HTTP2[19780]
I0722 10:03:17.325847     1 AdminTaskManager.cpp:17] max concurrenct subtasks: 10
I0722 10:03:17.326107     1 AdminTaskManager.cpp:27] exit AdminTaskManager::init()
I0722 10:03:17.326256   154 AdminTaskManager.cpp:89] waiting for incoming task
I0722 10:03:17.326689   156 StorageServer.cpp:219] The admin service start on "7.185.170.3":44499
I0722 10:03:17.328429   157 StorageServer.cpp:241] The internal storage service start(same with admin) on "7.185.170.3":44498
I0722 10:03:17.336073   155 StorageServer.cpp:193] The storage service start on "7.185.170.3":44500
I0722 10:03:17.430668    67 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 5] Start leader election, reason: lastMsgDur 116, term 65
I0722 10:03:17.430760    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 5] Sending out an election request (space = 1, part = 5, term = 66, lastLogId = 20798691, lastLogTerm = 65, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.437386    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.437537    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.437593    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 5] No one is elected, continue the election
I0722 10:03:17.561172    66 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 6] Start leader election, reason: lastMsgDur 246, term 183
I0722 10:03:17.561249    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 184, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.563391    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.563481    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.563539    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:17.614652    66 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 15] Start leader election, reason: lastMsgDur 297, term 71
I0722 10:03:17.614696    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 15] Sending out an election request (space = 1, part = 15, term = 72, lastLogId = 20798839, lastLogTerm = 71, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.616725    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.616803    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.616858    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 15] No one is elected, continue the election
I0722 10:03:17.647877    68 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 3] Start leader election, reason: lastMsgDur 335, term 21
I0722 10:03:17.647933    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 3] Sending out an election request (space = 1, part = 3, term = 22, lastLogId = 20798410, lastLogTerm = 21, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.649960    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.650048    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.650101    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 3] No one is elected, continue the election
I0722 10:03:17.742244    68 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 7] Start leader election, reason: lastMsgDur 427, term 194
I0722 10:03:17.742349    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 7] Sending out an election request (space = 1, part = 7, term = 195, lastLogId = 20798881, lastLogTerm = 194, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.744470    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.744547    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.744601    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 7] No one is elected, continue the election
I0722 10:03:17.773802    65 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 14] Start leader election, reason: lastMsgDur 457, term 66
I0722 10:03:17.773823    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 14] Sending out an election request (space = 1, part = 14, term = 67, lastLogId = 20798752, lastLogTerm = 66, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.775743    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.775812    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.775831    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 14] No one is elected, continue the election
I0722 10:03:17.946858    68 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 1] Start leader election, reason: lastMsgDur 634, term 156
I0722 10:03:17.946890    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 1] Sending out an election request (space = 1, part = 1, term = 157, lastLogId = 20798762, lastLogTerm = 156, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.949198    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.949272    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.949323    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 1] No one is elected, continue the election
I0722 10:03:17.970487    67 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 8] Start leader election, reason: lastMsgDur 655, term 36
I0722 10:03:17.970525    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 8] Sending out an election request (space = 1, part = 8, term = 37, lastLogId = 20798343, lastLogTerm = 36, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:17.972661    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:17.972728    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:17.972795    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 8] No one is elected, continue the election
I0722 10:03:18.077155    65 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 9] Start leader election, reason: lastMsgDur 762, term 63
I0722 10:03:18.077172    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 9] Sending out an election request (space = 1, part = 9, term = 64, lastLogId = 20798879, lastLogTerm = 63, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.079092    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.079129    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.079149    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 9] No one is elected, continue the election
I0722 10:03:18.085536    66 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 10] Start leader election, reason: lastMsgDur 769, term 58
I0722 10:03:18.085593    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 10] Sending out an election request (space = 1, part = 10, term = 59, lastLogId = 20798807, lastLogTerm = 58, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.087750    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.087841    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.087896    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 10] No one is elected, continue the election
I0722 10:03:18.108016    65 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 2] Start leader election, reason: lastMsgDur 795, term 39
I0722 10:03:18.108057    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 2] Sending out an election request (space = 1, part = 2, term = 40, lastLogId = 20798201, lastLogTerm = 39, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.110038    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.110085    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.110103    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 2] No one is elected, continue the election
I0722 10:03:18.156265    68 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 12] Start leader election, reason: lastMsgDur 840, term 169
I0722 10:03:18.156297    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 12] Sending out an election request (space = 1, part = 12, term = 170, lastLogId = 20798381, lastLogTerm = 169, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.158149    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:18.158219    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:18.158272    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 12] No one is elected, continue the election
I0722 10:03:18.221235    65 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 13] Start leader election, reason: lastMsgDur 905, term 28
I0722 10:03:18.221251    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 13] Sending out an election request (space = 1, part = 13, term = 29, lastLogId = 20798469, lastLogTerm = 28, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.223084    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.223202    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.223258    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 13] No one is elected, continue the election
I0722 10:03:18.233402    67 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 11] Start leader election, reason: lastMsgDur 917, term 201
I0722 10:03:18.233433    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 11] Sending out an election request (space = 1, part = 11, term = 202, lastLogId = 20798732, lastLogTerm = 201, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.235313    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.235510    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.235563    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 11] No one is elected, continue the election
I0722 10:03:18.258297    66 RaftPart.cpp:1043] [Port: 44501, Space: 1, Part: 4] Start leader election, reason: lastMsgDur 945, term 214
I0722 10:03:18.258342    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 4] Sending out an election request (space = 1, part = 4, term = 215, lastLogId = 20798813, lastLogTerm = 214, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.260279    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.260368    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.260426    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 4] No one is elected, continue the election
I0722 10:03:18.433818    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 185, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.435833    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.435910    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.435962    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:18.485069    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 8] Sending out an election request (space = 1, part = 8, term = 38, lastLogId = 20798343, lastLogTerm = 36, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.485985    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.486042    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.486095    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 8] No one is elected, continue the election
I0722 10:03:18.544793    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 15] Sending out an election request (space = 1, part = 15, term = 73, lastLogId = 20798839, lastLogTerm = 71, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.545858    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:18.545926    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:18.545984    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 15] No one is elected, continue the election
I0722 10:03:18.672336    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 9] Sending out an election request (space = 1, part = 9, term = 65, lastLogId = 20798879, lastLogTerm = 63, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.675827    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:18.675884    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:18.675935    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 9] No one is elected, continue the election
I0722 10:03:18.710371    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 3] Sending out an election request (space = 1, part = 3, term = 23, lastLogId = 20798410, lastLogTerm = 21, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.711374    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:18.711431    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:18.711483    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 3] No one is elected, continue the election
I0722 10:03:18.822154    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 4] Sending out an election request (space = 1, part = 4, term = 216, lastLogId = 20798813, lastLogTerm = 214, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.823341    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.823412    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.823470    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 4] No one is elected, continue the election
I0722 10:03:18.880378    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 14] Sending out an election request (space = 1, part = 14, term = 68, lastLogId = 20798752, lastLogTerm = 66, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:18.884397    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:18.884465    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:18.884517    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 14] No one is elected, continue the election
I0722 10:03:19.092811    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 1] Sending out an election request (space = 1, part = 1, term = 158, lastLogId = 20798762, lastLogTerm = 156, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.093767    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.093864    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.093921    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 1] No one is elected, continue the election
I0722 10:03:19.145864    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 5] Sending out an election request (space = 1, part = 5, term = 67, lastLogId = 20798691, lastLogTerm = 65, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.146878    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:19.146934    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:19.146984    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 5] No one is elected, continue the election
I0722 10:03:19.220901    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 15] Sending out an election request (space = 1, part = 15, term = 74, lastLogId = 20798839, lastLogTerm = 71, candidateIP = 7.185.170.3, candidatePort = 44501)
I0722 10:03:19.221112    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 186, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.225337    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.225390    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:19.225395    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:19.225445    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 15] No one is elected, continue the election
E0722 10:03:19.225625    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.225728    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:19.333890    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 10] Sending out an election request (space = 1, part = 10, term = 60, lastLogId = 20798807, lastLogTerm = 58, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.334915    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:19.335016    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:19.335068    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 10] No one is elected, continue the election
I0722 10:03:19.353844    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 7] Sending out an election request (space = 1, part = 7, term = 196, lastLogId = 20798881, lastLogTerm = 194, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.354740    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:19.354820    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:19.354874    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 7] No one is elected, continue the election
I0722 10:03:19.367977    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 4] Sending out an election request (space = 1, part = 4, term = 217, lastLogId = 20798813, lastLogTerm = 214, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.368921    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.368973    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.369021    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 4] No one is elected, continue the election
I0722 10:03:19.395987    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 12] Sending out an election request (space = 1, part = 12, term = 171, lastLogId = 20798381, lastLogTerm = 169, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.396956    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.397014    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.397066    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 12] No one is elected, continue the election
I0722 10:03:19.477200    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 11] Sending out an election request (space = 1, part = 11, term = 203, lastLogId = 20798732, lastLogTerm = 201, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.478094    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.478147    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.478197    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 11] No one is elected, continue the election
I0722 10:03:19.602306    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 13] Sending out an election request (space = 1, part = 13, term = 30, lastLogId = 20798469, lastLogTerm = 28, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.603279    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.603338    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.603390    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 13] No one is elected, continue the election
I0722 10:03:19.888659    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 14] Sending out an election request (space = 1, part = 14, term = 69, lastLogId = 20798752, lastLogTerm = 66, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.889716    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.889787    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.889842    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 14] No one is elected, continue the election
I0722 10:03:19.965764    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 2] Sending out an election request (space = 1, part = 2, term = 41, lastLogId = 20798201, lastLogTerm = 39, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.966877    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.966948    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.967049    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 2] No one is elected, continue the election
I0722 10:03:19.970153    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 9] Sending out an election request (space = 1, part = 9, term = 66, lastLogId = 20798879, lastLogTerm = 63, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:19.970983    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:19.971045    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:19.971102    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 9] No one is elected, continue the election
I0722 10:03:20.282299    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 8] Sending out an election request (space = 1, part = 8, term = 39, lastLogId = 20798343, lastLogTerm = 36, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.283336    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:20.283399    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:20.283453    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 8] No one is elected, continue the election
I0722 10:03:20.476701    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 14] Sending out an election request (space = 1, part = 14, term = 70, lastLogId = 20798752, lastLogTerm = 66, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.477744    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:20.477811    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:20.477866    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 14] No one is elected, continue the election
I0722 10:03:20.515718    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 9] Sending out an election request (space = 1, part = 9, term = 67, lastLogId = 20798879, lastLogTerm = 63, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.516721    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:20.516796    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:20.516855    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 9] No one is elected, continue the election
I0722 10:03:20.528973    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 12] Sending out an election request (space = 1, part = 12, term = 172, lastLogId = 20798381, lastLogTerm = 169, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.529814    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:20.529968    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:20.530030    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 12] No one is elected, continue the election
I0722 10:03:20.544798    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 3] Sending out an election request (space = 1, part = 3, term = 24, lastLogId = 20798410, lastLogTerm = 21, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.545913    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:20.546036    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:20.546126    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 3] No one is elected, continue the election
I0722 10:03:20.593246    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 5] Sending out an election request (space = 1, part = 5, term = 68, lastLogId = 20798691, lastLogTerm = 65, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.594264    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:20.594314    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:20.594367    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 5] No one is elected, continue the election
I0722 10:03:20.634460    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 13] Sending out an election request (space = 1, part = 13, term = 31, lastLogId = 20798469, lastLogTerm = 28, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.635406    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:20.635457    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:20.635506    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 13] No one is elected, continue the election
I0722 10:03:20.752682    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 187, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:20.753840    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:20.753898    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:20.753952    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:21.015848    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 4] Sending out an election request (space = 1, part = 4, term = 218, lastLogId = 20798813, lastLogTerm = 214, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.017064    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.017122    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.017176    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 4] No one is elected, continue the election
I0722 10:03:21.020273    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 15] Sending out an election request (space = 1, part = 15, term = 75, lastLogId = 20798839, lastLogTerm = 71, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.021134    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.021334    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.021396    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 15] No one is elected, continue the election
I0722 10:03:21.038309    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 1] Sending out an election request (space = 1, part = 1, term = 159, lastLogId = 20798762, lastLogTerm = 156, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.039232    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:21.039299    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:21.039392    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 1] No one is elected, continue the election
I0722 10:03:21.051506    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 2] Sending out an election request (space = 1, part = 2, term = 42, lastLogId = 20798201, lastLogTerm = 39, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.052363    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.052426    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.052480    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 2] No one is elected, continue the election
I0722 10:03:21.191686    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 10] Sending out an election request (space = 1, part = 10, term = 61, lastLogId = 20798807, lastLogTerm = 58, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.192746    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.192821    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.192878    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 10] No one is elected, continue the election
I0722 10:03:21.225981    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 11] Sending out an election request (space = 1, part = 11, term = 204, lastLogId = 20798732, lastLogTerm = 201, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.226807    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:21.226867    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:21.226927    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 11] No one is elected, continue the election
I0722 10:03:21.315064    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 7] Sending out an election request (space = 1, part = 7, term = 197, lastLogId = 20798881, lastLogTerm = 194, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.316079    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.316140    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.316193    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 7] No one is elected, continue the election
I0722 10:03:21.362290    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 3] Sending out an election request (space = 1, part = 3, term = 25, lastLogId = 20798410, lastLogTerm = 21, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.363399    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.363454    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.363561    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 3] No one is elected, continue the election
I0722 10:03:21.478790    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 12] Sending out an election request (space = 1, part = 12, term = 173, lastLogId = 20798381, lastLogTerm = 169, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.479813    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:21.480051    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:21.480120    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 12] No one is elected, continue the election
I0722 10:03:21.520267    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 188, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.521260    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:21.521446    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:21.521510    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:21.562500    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 1] Sending out an election request (space = 1, part = 1, term = 160, lastLogId = 20798762, lastLogTerm = 156, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.563494    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.563557    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.563611    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 1] No one is elected, continue the election
I0722 10:03:21.564625    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 14] Sending out an election request (space = 1, part = 14, term = 71, lastLogId = 20798752, lastLogTerm = 66, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.565498    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.565557    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.565611    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 14] No one is elected, continue the election
I0722 10:03:21.589327    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 4] Sending out an election request (space = 1, part = 4, term = 219, lastLogId = 20798813, lastLogTerm = 214, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.590160    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.590219    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.590273    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 4] No one is elected, continue the election
I0722 10:03:21.875979    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 13] Sending out an election request (space = 1, part = 13, term = 32, lastLogId = 20798469, lastLogTerm = 28, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:21.876955    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:21.877012    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:21.877192    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 13] No one is elected, continue the election
I0722 10:03:22.164569    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 189, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.165616    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.165679    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.165733    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:22.167908    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 4] Sending out an election request (space = 1, part = 4, term = 220, lastLogId = 20798813, lastLogTerm = 214, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.168757    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.168823    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 4] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.168879    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 4] No one is elected, continue the election
I0722 10:03:22.181974    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 8] Sending out an election request (space = 1, part = 8, term = 40, lastLogId = 20798343, lastLogTerm = 36, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.182765    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.182824    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.182875    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 8] No one is elected, continue the election
I0722 10:03:22.214972    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 10] Sending out an election request (space = 1, part = 10, term = 62, lastLogId = 20798807, lastLogTerm = 58, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.215883    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.215939    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.215991    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 10] No one is elected, continue the election
I0722 10:03:22.221096    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 11] Sending out an election request (space = 1, part = 11, term = 205, lastLogId = 20798732, lastLogTerm = 201, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.221889    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.221946    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 11] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.221999    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 11] No one is elected, continue the election
I0722 10:03:22.235020    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 2] Sending out an election request (space = 1, part = 2, term = 43, lastLogId = 20798201, lastLogTerm = 39, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.235816    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.235886    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.236013    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 2] No one is elected, continue the election
I0722 10:03:22.239140    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 3] Sending out an election request (space = 1, part = 3, term = 26, lastLogId = 20798410, lastLogTerm = 21, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.239904    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.239970    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.240029    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 3] No one is elected, continue the election
I0722 10:03:22.247104    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 9] Sending out an election request (space = 1, part = 9, term = 68, lastLogId = 20798879, lastLogTerm = 63, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.247786    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.247896    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.247974    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 9] No one is elected, continue the election
I0722 10:03:22.356160    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 15] Sending out an election request (space = 1, part = 15, term = 76, lastLogId = 20798839, lastLogTerm = 71, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.357139    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:22.357210    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 15] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:22.357265    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 15] No one is elected, continue the election
I0722 10:03:22.463424    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 5] Sending out an election request (space = 1, part = 5, term = 69, lastLogId = 20798691, lastLogTerm = 65, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.464440    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:22.464498    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 5] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:22.464551    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 5] No one is elected, continue the election
I0722 10:03:22.589557    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 7] Sending out an election request (space = 1, part = 7, term = 198, lastLogId = 20798881, lastLogTerm = 194, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.590502    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:22.590561    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 7] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:22.590616    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 7] No one is elected, continue the election
I0722 10:03:22.642727    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 12] Sending out an election request (space = 1, part = 12, term = 174, lastLogId = 20798381, lastLogTerm = 169, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.643748    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.643815    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 12] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.643867    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 12] No one is elected, continue the election
I0722 10:03:22.833166    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 8] Sending out an election request (space = 1, part = 8, term = 41, lastLogId = 20798343, lastLogTerm = 36, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.834168    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:22.834225    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 8] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:22.834282    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 8] No one is elected, continue the election
I0722 10:03:22.939283    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 10] Sending out an election request (space = 1, part = 10, term = 63, lastLogId = 20798807, lastLogTerm = 58, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.940254    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.940312    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 10] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.940366    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 10] No one is elected, continue the election
I0722 10:03:22.993466    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 9] Sending out an election request (space = 1, part = 9, term = 69, lastLogId = 20798879, lastLogTerm = 63, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:22.994412    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:22.994464    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 9] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:22.994516    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 9] No one is elected, continue the election
I0722 10:03:23.042621    67 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 3] Sending out an election request (space = 1, part = 3, term = 27, lastLogId = 20798410, lastLogTerm = 21, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:23.043668    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:23.043725    67 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 3] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:23.043792    67 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 3] No one is elected, continue the election
I0722 10:03:23.095599    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 14] Sending out an election request (space = 1, part = 14, term = 72, lastLogId = 20798752, lastLogTerm = 66, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:23.096587    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP1":44501, error code is -5
E0722 10:03:23.096657    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 14] Receive response about askForVote from "7代替IP2":44501, error code is -5
I0722 10:03:23.096714    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 14] No one is elected, continue the election
I0722 10:03:23.224043    68 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 13] Sending out an election request (space = 1, part = 13, term = 33, lastLogId = 20798469, lastLogTerm = 28, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:23.225041    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:23.225103    68 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 13] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:23.225157    68 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 13] No one is elected, continue the election
I0722 10:03:23.238929    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 1] Sending out an election request (space = 1, part = 1, term = 161, lastLogId = 20798762, lastLogTerm = 156, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:23.239869    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:23.239928    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 1] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:23.239985    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 1] No one is elected, continue the election
I0722 10:03:23.248347    66 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 2] Sending out an election request (space = 1, part = 2, term = 44, lastLogId = 20798201, lastLogTerm = 39, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:23.249207    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:23.249274    66 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 2] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:23.249332    66 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 2] No one is elected, continue the election
I0722 10:03:23.379174    65 RaftPart.cpp:1193] [Port: 44501, Space: 1, Part: 6] Sending out an election request (space = 1, part = 6, term = 190, lastLogId = 20798750, lastLogTerm = 183, candidateIP = 7.185.170.3, candidatePort = 44501)
E0722 10:03:23.380173    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP2":44501, error code is -5
E0722 10:03:23.380352    65 RaftPart.cpp:1143] [Port: 44501, Space: 1, Part: 6] Receive response about askForVote from "7代替IP1":44501, error code is -5
I0722 10:03:23.380492    65 RaftPart.cpp:1275] [Port: 44501, Space: 1, Part: 6] No one is elected, continue the election
I0722 10:03:58.176012     1 StorageDaemon.cpp:91] host = "7.185.170.3":44500
I0722 10:03:58.183557     1 MetaClient.cpp:50] Create meta client to "7.185.170.3":45500
E0722 10:03:58.183665     1 GflagsManager.cpp:70] Load gflags json failed
I0722 10:03:58.184574     1 GflagsManager.cpp:140] Prepare to register 12 gflags to meta
W0722 10:03:58.184638     1 FileBasedClusterIdMan.cpp:46] Open file failed, error No such file or directory
I0722 10:03:58.188324    48 MetaClient.cpp:2312] Persisit the cluster Id from metad 1580316102310718212
I0722 10:03:58.188406    48 FileBasedClusterIdMan.cpp:23] Remove the existed file cluster.id
I0722 10:03:58.188503    48 FileBasedClusterIdMan.cpp:36] Persiste clusterId 1580316102310718212 succeeded!
I0722 10:03:58.211298     1 MetaClient.cpp:2806] Register gflags ok 12
I0722 10:03:58.213049     1 MetaClient.cpp:2969] Update config rocksdb_db_options from {"max_subcompactions":"32","max_background_jobs":"64","max_open_files":"100000000","max_background_flushes":"32"} to {"max_subcompactions":"32","max_open_files":"100000000","max_background_jobs":"64","max_background_flushes":"32"}
I0722 10:03:58.213107     1 MetaClient.cpp:2969] Update config rocksdb_column_family_options from {"max_bytes_for_level_base":"536870912","max_write_buffer_number":"10","write_buffer_size":"134217728","min_write_buffer_number_to_merge":"4","level0_file_num_compaction_trigger":"4","target_file_size_base":"134217728","target_file_size_multiplier":"1"} to {"max_bytes_for_level_base":"536870912","target_file_size_multiplier":"1","max_write_buffer_number":"10","min_write_buffer_number_to_merge":"4","write_buffer_size":"134217728","level0_file_num_compaction_trigger":"4","target_file_size_base":"134217728"}
I0722 10:03:58.213137     1 MetaClient.cpp:2969] Update config wal_ttl from 7201 to 7200
I0722 10:03:58.213266     1 MetaClient.cpp:99] Register time task for heartbeat!
I0722 10:03:58.213296     1 StorageServer.cpp:139] Init schema manager
I0722 10:03:58.213317     1 StorageServer.cpp:142] Init index manager
I0722 10:03:58.213328     1 StorageServer.cpp:145] Init kvstore
I0722 10:03:58.213356     1 NebulaStore.cpp:47] Start the raft service...
I0722 10:03:58.214016     1 RaftexService.cpp:65] Init thrift server for raft service, port: 44501
I0722 10:03:58.214182    67 RaftexService.cpp:98] Starting the Raftex Service
I0722 10:03:58.224925    67 RaftexService.cpp:86] Starting the Raftex Service on 44501
I0722 10:03:58.224968    67 RaftexService.cpp:110] Start the Raftex Service successfully
I0722 10:03:58.225114     1 NebulaStore.cpp:75] Scan the local path, and init the spaces_
I0722 10:03:58.225188     1 NebulaStore.cpp:81] Scan path "/data/storage/nebula/1"
I0722 10:03:58.225282     1 RocksEngineConfig.cpp:254] Emplace rocksdb option max_background_jobs=64
I0722 10:03:58.225301     1 RocksEngineConfig.cpp:254] Emplace rocksdb option max_subcompactions=32
I0722 10:03:58.225311     1 RocksEngineConfig.cpp:254] Emplace rocksdb option max_background_flushes=32
I0722 10:03:58.225327     1 RocksEngineConfig.cpp:254] Emplace rocksdb option max_open_files=100000000
I0722 10:03:58.225375     1 RocksEngineConfig.cpp:254] Emplace rocksdb option level0_file_num_compaction_trigger=4
I0722 10:03:58.225392     1 RocksEngineConfig.cpp:254] Emplace rocksdb option target_file_size_multiplier=1
I0722 10:03:58.225404     1 RocksEngineConfig.cpp:254] Emplace rocksdb option target_file_size_base=134217728
I0722 10:03:58.225415     1 RocksEngineConfig.cpp:254] Emplace rocksdb option max_bytes_for_level_base=536870912
I0722 10:03:58.225426     1 RocksEngineConfig.cpp:254] Emplace rocksdb option max_write_buffer_number=10
I0722 10:03:58.225438     1 RocksEngineConfig.cpp:254] Emplace rocksdb option min_write_buffer_number_to_merge=4
I0722 10:03:58.225450     1 RocksEngineConfig.cpp:254] Emplace rocksdb option write_buffer_size=134217728
I0722 10:03:58.225512     1 RocksEngineConfig.cpp:254] Emplace rocksdb option block_size=8192
W0722 10:04:42.371671    45 RaftexService.cpp:181] Cannot find the part 1 in the graph space 1
W0722 10:04:42.374441    45 RaftexService.cpp:181] Cannot find the part 15 in the graph space 1
W0722 10:04:42.421432    45 RaftexService.cpp:181] Cannot find the part 6 in the graph space 1
W0722 10:04:42.457118    45 RaftexService.cpp:181] Cannot find the part 12 in the graph space 1
W0722 10:04:42.516588    45 RaftexService.cpp:181] Cannot find the part 10 in the graph space 1
W0722 10:04:42.530932    45 RaftexService.cpp:181] Cannot find the part 3 in the graph space 1
W0722 10:04:42.604084    45 RaftexService.cpp:181] Cannot find the part 14 in the graph space 1
W0722 10:04:42.795508    45 RaftexService.cpp:181] Cannot find the part 8 in the graph space 1
W0722 10:04:42.819337    45 RaftexService.cpp:181] Cannot find the part 11 in the graph space 1
W0722 10:04:42.843401    45 RaftexService.cpp:181] Cannot find the part 13 in the graph space 1
W0722 10:04:42.911936    45 RaftexService.cpp:181] Cannot find the part 9 in the graph space 1
W0722 10:04:42.925357    45 RaftexService.cpp:181] Cannot find the part 7 in the graph space 1
W0722 10:04:43.002763    45 RaftexService.cpp:181] Cannot find the part 4 in the graph space 1
W0722 10:04:43.103200    45 RaftexService.cpp:181] Cannot find the part 15 in the graph space 1
W0722 10:04:43.157474    45 RaftexService.cpp:181] Cannot find the part 5 in the graph space 1
W0722 10:04:43.196715    45 RaftexService.cpp:181] Cannot find the part 3 in the graph space 1
W0722 10:04:43.233819    45 RaftexService.cpp:181] Cannot find the part 2 in the graph space 1
W0722 10:04:43.346113    45 RaftexService.cpp:181] Cannot find the part 1 in the graph space 1
W0722 10:04:43.392298    45 RaftexService.cpp:181] Cannot find the part 10 in the graph space 1
W0722 10:04:43.631258    45 RaftexService.cpp:181] Cannot find the part 8 in the graph space 1
W0722 10:04:43.720794    45 RaftexService.cpp:181] Cannot find the part 11 in the graph space 1
W0722 10:04:43.929828    45 RaftexService.cpp:181] Cannot find the part 7 in the graph space 1
W0722 10:04:43.999136    45 RaftexService.cpp:181] Cannot find the part 10 in the graph space 1
W0722 10:04:44.028051    45 RaftexService.cpp:181] Cannot find the part 15 in the graph space 1
W0722 10:04:44.095305    45 RaftexService.cpp:181] Cannot find the part 1 in the graph space 1
W0722 10:04:44.213469    45 RaftexService.cpp:181] Cannot find the part 12 in the graph space 1
W0722 10:04:44.243593    45 RaftexService.cpp:181] Cannot find the part 14 in the graph space 1
W0722 10:04:44.315843    45 RaftexService.cpp:181] Cannot find the part 6 in the graph space 1
W0722 10:04:44.343142    45 RaftexService.cpp:181] Cannot find the part 5 in the graph space 1
W0722 10:04:44.461268    45 RaftexService.cpp:181] Cannot find the part 3 in the graph space 1
W0722 10:04:44.497418    45 RaftexService.cpp:181] Cannot find the part 13 in the graph space 1
W0722 10:04:44.546425    45 RaftexService.cpp:181] Cannot find the part 2 in the graph space 1
W0722 10:04:44.652909    45 RaftexService.cpp:181] Cannot find the part 9 in the graph space 1
W0722 10:04:44.667045    45 RaftexService.cpp:181] Cannot find the part 4 in the graph space 1
W0722 10:04:44.727092    45 RaftexService.cpp:181] Cannot find the part 7 in the graph space 1
W0722 10:04:44.784354    45 RaftexService.cpp:181] Cannot find the part 14 in the graph space 1
W0722 10:04:44.843219    45 RaftexService.cpp:181] Cannot find the part 1 in the graph space 1
W0722 10:04:44.908708    45 RaftexService.cpp:181] Cannot find the part 8 in the graph space 1
W0722 10:04:45.167253    45 RaftexService.cpp:181] Cannot find the part 15 in the graph space 1
W0722 10:04:45.184705    45 RaftexService.cpp:181] Cannot find the part 11 in the graph space 1
W0722 10:04:45.373410    45 RaftexService.cpp:181] Cannot find the part 4 in the graph space 1
W0722 10:04:45.514017    45 RaftexService.cpp:181] Cannot find the part 3 in the graph space 1
W0722 10:04:45.554203    45 RaftexService.cpp:181] Cannot find the part 12 in the graph space 1
W0722 10:04:45.639406    45 RaftexService.cpp:181] Cannot find the part 6 in the graph space 1
W0722 10:04:45.656177    45 RaftexService.cpp:181] Cannot find the part 9 in the graph space 1
W0722 10:04:45.698626    45 RaftexService.cpp:181] Cannot find the part 13 in the graph space 1
W0722 10:04:45.713629    45 RaftexService.cpp:181] Cannot find the part 11 in the graph space 1
W0722 10:04:45.716660    45 RaftexService.cpp:181] Cannot find the part 10 in the graph space 1
W0722 10:04:45.958094    45 RaftexService.cpp:181] Cannot find the part 8 in the graph space 1
W0722 10:04:46.082428    45 RaftexService.cpp:181] Cannot find the part 4 in the graph space 1
W0722 10:04:46.145840    45 RaftexService.cpp:181] Cannot find the part 5 in the graph space 1
W0722 10:04:46.169183    45 RaftexService.cpp:181] Cannot find the part 2 in the graph space 1
W0722 10:04:46.182262    45 RaftexService.cpp:181] Cannot find the part 14 in the graph space 1
W0722 10:04:46.345381    45 RaftexService.cpp:181] Cannot find the part 12 in the graph space 1
W0722 10:04:46.356637    45 RaftexService.cpp:181] Cannot find the part 15 in the graph space 1
W0722 10:04:46.372556    45 RaftexService.cpp:181] Cannot find the part 13 in the graph space 1
W0722 10:04:46.509984    45 RaftexService.cpp:181] Cannot find the part 7 in the graph space 1
W0722 10:04:46.738533    45 RaftexService.cpp:181] Cannot find the part 14 in the graph space 1
W0722 10:04:46.759824    45 RaftexService.cpp:181] Cannot find the part 1 in the graph space 1
W0722 10:04:47.027400    45 RaftexService.cpp:181] Cannot find the part 9 in the graph space 1
W0722 10:04:47.147588    45 RaftexService.cpp:181] Cannot find the part 11 in the graph space 1
W0722 10:04:47.233050    45 RaftexService.cpp:181] Cannot find the part 5 in the graph space 1
W0722 10:04:47.332705    45 RaftexService.cpp:181] Cannot find the part 14 in the graph space 1
W0722 10:04:47.345892    45 RaftexService.cpp:181] Cannot find the part 4 in the graph space 1
W0722 10:04:47.379137    45 RaftexService.cpp:181] Cannot find the part 3 in the graph space 1
W0722 10:04:47.441227    45 RaftexService.cpp:181] Cannot find the part 10 in the graph space 1
W0722 10:04:47.499470    45 RaftexService.cpp:181] Cannot find the part 12 in the graph space 1
W0722 10:04:47.578685    45 RaftexService.cpp:181] Cannot find the part 8 in the graph space 1
W0722 10:04:47.619937    45 RaftexService.cpp:181] Cannot find the part 7 in the graph space 1
W0722 10:04:47.633939    45 RaftexService.cpp:181] Cannot find the part 6 in the graph space 1
W0722 10:04:47.635785    45 RaftexService.cpp:181] Cannot find the part 1 in the graph space 1
W0722 10:04:47.813282    45 RaftexService.cpp:181] Cannot find the part 13 in the graph space 1
W0722 10:04:47.934599    45 RaftexService.cpp:181] Cannot find the part 3 in the graph space 1
I0722 10:05:20.388633     1 StorageDaemon.cpp:151] Signal 15(Terminated) received, stopping this server
I0722 10:05:30.267948     1 RocksEngine.cpp:119] open rocksdb on /data/storage/nebula/1/data

[critical27]

我们日志级别现在比较混乱，ERROR未必是真的错，简单办法就看show hosts的leader数量对不对就行了

[yangmeng]

你好, 现在的问题是起不来, 怎么看leader??

[critical27]

起不来是一起来就挂 还是一直是0（有可能在compaction）

[yangmeng]

容器一直再重启, 应该是起不来就

[critical27]

起不来的原因storage日志能看到吧 是不是就是你之前说的配置错了的那个

[yangmeng]

@yangmeng

开始启动, 发现storagederr.log有日志中显示不能选举leader

这就是日志 这应该就是原因

[critical27]

肯定不是这个

[critical27]

而且为啥日志里有signal 15

[yangmeng]

我一般看的storage的这个日志, 不对吗?>

[yangmeng]

麻烦大佬再帮忙定位定位, 这是rockesdb的LOG日志

[yangmeng]

2021/07/22-11:02:06.703066 7f7c128e1980 RocksDB version: 6.7.3
2021/07/22-11:02:06.703166 7f7c128e1980 Git sha rocksdb_build_git_sha:@0@
2021/07/22-11:02:06.703171 7f7c128e1980 Compile date Jul  8 2020
2021/07/22-11:02:06.703177 7f7c128e1980 DB SUMMARY
2021/07/22-11:02:06.742249 7f7c128e1980 CURRENT file:  CURRENT
2021/07/22-11:02:06.742256 7f7c128e1980 IDENTITY file:  IDENTITY
2021/07/22-11:02:06.742264 7f7c128e1980 MANIFEST file:  MANIFEST-961943 size: 56626165 Bytes
2021/07/22-11:02:06.742267 7f7c128e1980 SST files in /data/storage/nebula/1/data dir, Total Num: 44137, files: 550502.sst 550503.sst 550504.sst 550505.sst 550506.sst 550507.sst 550508.sst 550509.sst 550510.sst 
2021/07/22-11:02:06.742270 7f7c128e1980 Write Ahead Log file in /data/storage/nebula/1/data: 961944.log size: 0 ; 
2021/07/22-11:02:06.742365 7f7c128e1980                         Options.error_if_exists: 0
2021/07/22-11:02:06.742368 7f7c128e1980                       Options.create_if_missing: 1
2021/07/22-11:02:06.742370 7f7c128e1980                         Options.paranoid_checks: 1
2021/07/22-11:02:06.742371 7f7c128e1980                                     Options.env: 0x2c0b9a0
2021/07/22-11:02:06.742378 7f7c128e1980                                      Options.fs: Posix File System
2021/07/22-11:02:06.742380 7f7c128e1980                                Options.info_log: 0x7f7c1148b010
2021/07/22-11:02:06.742382 7f7c128e1980                Options.max_file_opening_threads: 16
2021/07/22-11:02:06.742384 7f7c128e1980                              Options.statistics: (nil)
2021/07/22-11:02:06.742386 7f7c128e1980                               Options.use_fsync: 0
2021/07/22-11:02:06.742387 7f7c128e1980                       Options.max_log_file_size: 0
2021/07/22-11:02:06.742389 7f7c128e1980                  Options.max_manifest_file_size: 1073741824
2021/07/22-11:02:06.742391 7f7c128e1980                   Options.log_file_time_to_roll: 0
2021/07/22-11:02:06.742393 7f7c128e1980                       Options.keep_log_file_num: 1000
2021/07/22-11:02:06.742394 7f7c128e1980                    Options.recycle_log_file_num: 0
2021/07/22-11:02:06.742396 7f7c128e1980                         Options.allow_fallocate: 1
2021/07/22-11:02:06.742398 7f7c128e1980                        Options.allow_mmap_reads: 0
2021/07/22-11:02:06.742399 7f7c128e1980                       Options.allow_mmap_writes: 0
2021/07/22-11:02:06.742401 7f7c128e1980                        Options.use_direct_reads: 0
2021/07/22-11:02:06.742406 7f7c128e1980                        Options.use_direct_io_for_flush_and_compaction: 0
2021/07/22-11:02:06.742408 7f7c128e1980          Options.create_missing_column_families: 0
2021/07/22-11:02:06.742409 7f7c128e1980                              Options.db_log_dir: 
2021/07/22-11:02:06.742411 7f7c128e1980                                 Options.wal_dir: /data/storage/nebula/1/data
2021/07/22-11:02:06.742413 7f7c128e1980                Options.table_cache_numshardbits: 6
2021/07/22-11:02:06.742414 7f7c128e1980                      Options.max_subcompactions: 32
2021/07/22-11:02:06.742416 7f7c128e1980                  Options.max_background_flushes: 32
2021/07/22-11:02:06.742418 7f7c128e1980                         Options.WAL_ttl_seconds: 0
2021/07/22-11:02:06.742419 7f7c128e1980                       Options.WAL_size_limit_MB: 0
2021/07/22-11:02:06.742421 7f7c128e1980                        Options.max_write_batch_group_size_bytes: 1048576
2021/07/22-11:02:06.742423 7f7c128e1980             Options.manifest_preallocation_size: 4194304
2021/07/22-11:02:06.742424 7f7c128e1980                     Options.is_fd_close_on_exec: 1
2021/07/22-11:02:06.742426 7f7c128e1980                   Options.advise_random_on_open: 1
2021/07/22-11:02:06.742427 7f7c128e1980                    Options.db_write_buffer_size: 0
2021/07/22-11:02:06.742429 7f7c128e1980                    Options.write_buffer_manager: 0x7f7bfbe173f0
2021/07/22-11:02:06.742430 7f7c128e1980         Options.access_hint_on_compaction_start: 1
2021/07/22-11:02:06.742432 7f7c128e1980  Options.new_table_reader_for_compaction_inputs: 0
2021/07/22-11:02:06.742433 7f7c128e1980           Options.random_access_max_buffer_size: 1048576
2021/07/22-11:02:06.742452 7f7c128e1980                      Options.use_adaptive_mutex: 0
2021/07/22-11:02:06.742455 7f7c128e1980                            Options.rate_limiter: (nil)
2021/07/22-11:02:06.742460 7f7c128e1980     Options.sst_file_manager.rate_bytes_per_sec: 0
2021/07/22-11:02:06.742461 7f7c128e1980                       Options.wal_recovery_mode: 2
2021/07/22-11:02:06.742463 7f7c128e1980                  Options.enable_thread_tracking: 0
2021/07/22-11:02:06.742464 7f7c128e1980                  Options.enable_pipelined_write: 0
2021/07/22-11:02:06.742466 7f7c128e1980                  Options.unordered_write: 0
2021/07/22-11:02:06.742467 7f7c128e1980         Options.allow_concurrent_memtable_write: 1
2021/07/22-11:02:06.742469 7f7c128e1980      Options.enable_write_thread_adaptive_yield: 1
2021/07/22-11:02:06.742470 7f7c128e1980             Options.write_thread_max_yield_usec: 100
2021/07/22-11:02:06.742472 7f7c128e1980            Options.write_thread_slow_yield_usec: 3
2021/07/22-11:02:06.742474 7f7c128e1980                               Options.row_cache: None
2021/07/22-11:02:06.742476 7f7c128e1980                              Options.wal_filter: None
2021/07/22-11:02:06.742478 7f7c128e1980             Options.avoid_flush_during_recovery: 0
2021/07/22-11:02:06.742479 7f7c128e1980             Options.allow_ingest_behind: 0
2021/07/22-11:02:06.742481 7f7c128e1980             Options.preserve_deletes: 0
2021/07/22-11:02:06.742482 7f7c128e1980             Options.two_write_queues: 0
2021/07/22-11:02:06.742484 7f7c128e1980             Options.manual_wal_flush: 0
2021/07/22-11:02:06.742485 7f7c128e1980             Options.atomic_flush: 0
2021/07/22-11:02:06.742487 7f7c128e1980             Options.avoid_unnecessary_blocking_io: 0
2021/07/22-11:02:06.742488 7f7c128e1980                 Options.persist_stats_to_disk: 0
2021/07/22-11:02:06.742490 7f7c128e1980                 Options.write_dbid_to_manifest: 0
2021/07/22-11:02:06.742492 7f7c128e1980                 Options.log_readahead_size: 0
2021/07/22-11:02:06.742493 7f7c128e1980             Options.max_background_jobs: 64
2021/07/22-11:02:06.742495 7f7c128e1980             Options.max_background_compactions: -1
2021/07/22-11:02:06.742496 7f7c128e1980             Options.avoid_flush_during_shutdown: 0
2021/07/22-11:02:06.742498 7f7c128e1980           Options.writable_file_max_buffer_size: 1048576
2021/07/22-11:02:06.742500 7f7c128e1980             Options.delayed_write_rate : 16777216
2021/07/22-11:02:06.742501 7f7c128e1980             Options.max_total_wal_size: 0
2021/07/22-11:02:06.742503 7f7c128e1980             Options.delete_obsolete_files_period_micros: 21600000000
2021/07/22-11:02:06.742504 7f7c128e1980                   Options.stats_dump_period_sec: 600
2021/07/22-11:02:06.742506 7f7c128e1980                 Options.stats_persist_period_sec: 600
2021/07/22-11:02:06.742508 7f7c128e1980                 Options.stats_history_buffer_size: 1048576
2021/07/22-11:02:06.742509 7f7c128e1980                          Options.max_open_files: 65536
2021/07/22-11:02:06.742511 7f7c128e1980                          Options.bytes_per_sync: 0
2021/07/22-11:02:06.742513 7f7c128e1980                      Options.wal_bytes_per_sync: 0
2021/07/22-11:02:06.742514 7f7c128e1980                   Options.strict_bytes_per_sync: 0
2021/07/22-11:02:06.742515 7f7c128e1980       Options.compaction_readahead_size: 0
2021/07/22-11:02:06.742517 7f7c128e1980 Compression algorithms supported:
2021/07/22-11:02:06.742519 7f7c128e1980 	kZSTDNotFinalCompression supported: 1
2021/07/22-11:02:06.742525 7f7c128e1980 	kZSTD supported: 1
2021/07/22-11:02:06.742527 7f7c128e1980 	kXpressCompression supported: 0
2021/07/22-11:02:06.742529 7f7c128e1980 	kLZ4HCCompression supported: 1
2021/07/22-11:02:06.742531 7f7c128e1980 	kLZ4Compression supported: 1
2021/07/22-11:02:06.742533 7f7c128e1980 	kBZip2Compression supported: 1
2021/07/22-11:02:06.742535 7f7c128e1980 	kZlibCompression supported: 1
2021/07/22-11:02:06.742537 7f7c128e1980 	kSnappyCompression supported: 1
2021/07/22-11:02:06.742553 7f7c128e1980 Fast CRC32 supported: Supported on x86
2021/07/22-11:02:06.742873 7f7c128e1980 [version_set.cc:4401] Recovering from manifest file: /data/storage/nebula/1/data/MANIFEST-961943
2021/07/22-11:02:06.742986 7f7c128e1980 [column_family.cc:550] --------------- Options for column family [default]:
2021/07/22-11:02:06.742995 7f7c128e1980               Options.comparator: leveldb.BytewiseComparator
2021/07/22-11:02:06.742997 7f7c128e1980           Options.merge_operator: None
2021/07/22-11:02:06.742998 7f7c128e1980        Options.compaction_filter: None
2021/07/22-11:02:06.743000 7f7c128e1980        Options.compaction_filter_factory: StorageCompactionFilterFactory
2021/07/22-11:02:06.743002 7f7c128e1980         Options.memtable_factory: SkipListFactory
2021/07/22-11:02:06.743004 7f7c128e1980            Options.table_factory: BlockBasedTable
2021/07/22-11:02:06.743069 7f7c128e1980            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f7c114080b0)
  cache_index_and_filter_blocks: 0
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 0
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x7f7bfbe33a90
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 8388608
    num_shard_bits : 8
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 8192
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: rocksdb.BuiltinBloomFilter
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 2
  enable_index_compression: 1
  block_align: 0
2021/07/22-11:02:06.743075 7f7c128e1980        Options.write_buffer_size: 134217728
2021/07/22-11:02:06.743077 7f7c128e1980  Options.max_write_buffer_number: 10
2021/07/22-11:02:06.743082 7f7c128e1980          Options.compression: LZ4
2021/07/22-11:02:06.743083 7f7c128e1980                  Options.bottommost_compression: Disabled
2021/07/22-11:02:06.743085 7f7c128e1980       Options.prefix_extractor: nullptr
2021/07/22-11:02:06.743087 7f7c128e1980   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2021/07/22-11:02:06.743089 7f7c128e1980             Options.num_levels: 7
2021/07/22-11:02:06.743090 7f7c128e1980        Options.min_write_buffer_number_to_merge: 4
2021/07/22-11:02:06.743092 7f7c128e1980     Options.max_write_buffer_number_to_maintain: 0
2021/07/22-11:02:06.743094 7f7c128e1980     Options.max_write_buffer_size_to_maintain: 0
2021/07/22-11:02:06.743095 7f7c128e1980            Options.bottommost_compression_opts.window_bits: -14
2021/07/22-11:02:06.743097 7f7c128e1980                  Options.bottommost_compression_opts.level: 32767
2021/07/22-11:02:06.743099 7f7c128e1980               Options.bottommost_compression_opts.strategy: 0
2021/07/22-11:02:06.743100 7f7c128e1980         Options.bottommost_compression_opts.max_dict_bytes: 0
2021/07/22-11:02:06.743102 7f7c128e1980         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2021/07/22-11:02:06.743104 7f7c128e1980                  Options.bottommost_compression_opts.enabled: false
2021/07/22-11:02:06.743105 7f7c128e1980            Options.compression_opts.window_bits: -14
2021/07/22-11:02:06.743107 7f7c128e1980                  Options.compression_opts.level: 32767
2021/07/22-11:02:06.743109 7f7c128e1980               Options.compression_opts.strategy: 0
2021/07/22-11:02:06.743110 7f7c128e1980         Options.compression_opts.max_dict_bytes: 0
2021/07/22-11:02:06.743112 7f7c128e1980         Options.compression_opts.zstd_max_train_bytes: 0
2021/07/22-11:02:06.743113 7f7c128e1980                  Options.compression_opts.enabled: false
2021/07/22-11:02:06.743125 7f7c128e1980      Options.level0_file_num_compaction_trigger: 4
2021/07/22-11:02:06.743127 7f7c128e1980          Options.level0_slowdown_writes_trigger: 20
2021/07/22-11:02:06.743128 7f7c128e1980              Options.level0_stop_writes_trigger: 36
2021/07/22-11:02:06.743130 7f7c128e1980                   Options.target_file_size_base: 134217728
2021/07/22-11:02:06.743131 7f7c128e1980             Options.target_file_size_multiplier: 1
2021/07/22-11:02:06.743133 7f7c128e1980                Options.max_bytes_for_level_base: 536870912
2021/07/22-11:02:06.743134 7f7c128e1980 Options.level_compaction_dynamic_level_bytes: 0
2021/07/22-11:02:06.743136 7f7c128e1980          Options.max_bytes_for_level_multiplier: 10.000000
2021/07/22-11:02:06.743139 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2021/07/22-11:02:06.743141 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2021/07/22-11:02:06.743143 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2021/07/22-11:02:06.743145 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2021/07/22-11:02:06.743146 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2021/07/22-11:02:06.743148 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2021/07/22-11:02:06.743149 7f7c128e1980 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2021/07/22-11:02:06.743151 7f7c128e1980       Options.max_sequential_skip_in_iterations: 8
2021/07/22-11:02:06.743152 7f7c128e1980                    Options.max_compaction_bytes: 3355443200
2021/07/22-11:02:06.743154 7f7c128e1980                        Options.arena_block_size: 16777216
2021/07/22-11:02:06.743156 7f7c128e1980   Options.soft_pending_compaction_bytes_limit: 68719476736
2021/07/22-11:02:06.743157 7f7c128e1980   Options.hard_pending_compaction_bytes_limit: 274877906944
2021/07/22-11:02:06.743159 7f7c128e1980       Options.rate_limit_delay_max_milliseconds: 100
2021/07/22-11:02:06.743161 7f7c128e1980                Options.disable_auto_compactions: 1
2021/07/22-11:02:06.743163 7f7c128e1980                        Options.compaction_style: kCompactionStyleLevel
2021/07/22-11:02:06.743166 7f7c128e1980                          Options.compaction_pri: kMinOverlappingRatio
2021/07/22-11:02:06.743167 7f7c128e1980 Options.compaction_options_universal.size_ratio: 1
2021/07/22-11:02:06.743169 7f7c128e1980 Options.compaction_options_universal.min_merge_width: 2
2021/07/22-11:02:06.743171 7f7c128e1980 Options.compaction_options_universal.max_merge_width: 4294967295
2021/07/22-11:02:06.743172 7f7c128e1980 Options.compaction_options_universal.max_size_amplification_percent: 200
2021/07/22-11:02:06.743174 7f7c128e1980 Options.compaction_options_universal.compression_size_percent: -1
2021/07/22-11:02:06.743176 7f7c128e1980 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2021/07/22-11:02:06.743178 7f7c128e1980 Options.compaction_options_fifo.max_table_files_size: 1073741824
2021/07/22-11:02:06.743179 7f7c128e1980 Options.compaction_options_fifo.allow_compaction: 0
2021/07/22-11:02:06.743181 7f7c128e1980                   Options.table_properties_collectors: 
2021/07/22-11:02:06.743183 7f7c128e1980                   Options.inplace_update_support: 0
2021/07/22-11:02:06.743184 7f7c128e1980                 Options.inplace_update_num_locks: 10000
2021/07/22-11:02:06.743186 7f7c128e1980               Options.memtable_prefix_bloom_size_ratio: 0.000000
2021/07/22-11:02:06.743188 7f7c128e1980               Options.memtable_whole_key_filtering: 0
2021/07/22-11:02:06.743190 7f7c128e1980   Options.memtable_huge_page_size: 0
2021/07/22-11:02:06.743191 7f7c128e1980                           Options.bloom_locality: 0
2021/07/22-11:02:06.743193 7f7c128e1980                    Options.max_successive_merges: 0
2021/07/22-11:02:06.743194 7f7c128e1980                Options.optimize_filters_for_hits: 0
2021/07/22-11:02:06.743196 7f7c128e1980                Options.paranoid_file_checks: 0
2021/07/22-11:02:06.743197 7f7c128e1980                Options.force_consistency_checks: 0
2021/07/22-11:02:06.743206 7f7c128e1980                Options.report_bg_io_stats: 0
2021/07/22-11:02:06.743207 7f7c128e1980                               Options.ttl: 2592000
2021/07/22-11:02:06.743209 7f7c128e1980          Options.periodic_compaction_seconds: 2592000
2021/07/22-11:02:07.227002 7f7c128e1980 [version_set.cc:4544] Recovered from manifest file:/data/storage/nebula/1/data/MANIFEST-961943 succeeded,manifest_file_number is 961943, next_file_number is 961945, last_sequence is 40216390484, log_number is 961942,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
2021/07/22-11:02:07.227025 7f7c128e1980 [version_set.cc:4560] Column family [default] (ID 0), log number is 961942
2021/07/22-11:02:07.392279 7f7c128e1980 EVENT_LOG_v1 {"time_micros": 1626922927392272, "job": 1, "event": "recovery_started", "log_files": [961944]}
2021/07/22-11:02:07.392297 7f7c128e1980 [db_impl/db_impl_open.cc:747] Recovering log #961944 mode 2
2021/07/22-11:02:07.393354 7f7c128e1980 [version_set.cc:3814] Creating manifest 961946
2021/07/22-11:02:07.720660 7f7c128e1980 EVENT_LOG_v1 {"time_micros": 1626922927720653, "job": 1, "event": "recovery_finished"}
2021/07/22-11:02:07.721476 7f7c128e1980 [column_family.cc:926] [default] Increasing compaction threads because we have 27136 level-0 files 
2021/07/22-11:02:07.856167 7f7bed3ff700 (Original Log Time 2021/07/22-11:02:07.854201) [db_impl/db_impl_compaction_flush.cc:2609] Compaction nothing to do
2021/07/22-11:02:08.001526 7f7c128e1980 DB pointer 0x7f7bfb063000
2021/07/22-11:02:08.005192 7f7bb0dfe700 [db_impl/db_impl.cc:849] ------- DUMPING STATS -------
2021/07/22-11:02:08.005285 7f7bb0dfe700 [db_impl/db_impl.cc:851] 
** DB Stats **
Uptime(secs): 1.3 total, 1.3 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0  27136/0   554.20 GB 6784.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
  L1      6/0   456.14 MB   0.9      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
  L2     51/0    5.87 GB   1.2      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
  L3    494/0   52.72 GB   1.1      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
  L4   4504/0   500.47 GB   1.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
  L5  11946/0    1.49 TB   0.3      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Sum  44137/0    2.58 TB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [default] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 1.3 total, 1.3 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [default] **

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0  27136/0   554.20 GB 6784.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0

[critical27]

你贴下INFO日志的最后部分 rocksdb看起来就是在做compaction而已

[yangmeng]

那就是最新的INFO的了, 稍等, 我取下日志

[yangmeng]

INFO就这点日志, 直接给你截图了, 对了我们现在是的点边一共200亿, 数据是三副本, 每台机器2.4Tdata数据, 还建立和6个索引

[yangmeng]

@critical27 大佬, 这个问题有进展吗? 我刚刚把我早上关闭前做的快照也恢复了一下, 快照都起不来, 还是这个错误

[critical27]

我这会没啥空看 你那边能排除环境的原因吗 能查出来是谁发的15信号吗？这个信号肯定不是平白无故来的，我觉得是跟docker环境有关。
你要么不要挂载到docker里试试

[yangmeng]

应该是我的启动check时间太短了, 15应该是这个发的, kill -15 …

[critical27]

因为刚启动的时候在compaction 你看你L0都几万个文件了

不过好奇为啥这种compaction就没有出现你fd爆掉的情况