- nebula 版本：nebula-graph-3.4.0
- 部署方式：分布式 三台服务器
- 安装方式：rpm
- 硬件信息
- CPU：Intel(R) Xeon(R) Gold 5320 CPU @ 2.20GHz
硬盘：Disk /dev/sda: 1999.8 GB, 1999844147200 bytes, 3905945600 sectors
问题描述：
三台机器中，其中一台重启后在一分钟左右就会显示offline，并且其占据cpu异常高，几乎在300%左右
- CPU：Intel(R) Xeon(R) Gold 5320 CPU @ 2.20GHz
没有报错日志，在storgaed的日志中显示：
I20231121 14:49:40.887923 64175 NebulaStore.cpp:422] [Space: 749, Part: 57] has existed!
I20231121 14:49:40.887933 64175 NebulaStore.cpp:422] [Space: 749, Part: 58] has existed!
I20231121 14:49:40.887943 64175 NebulaStore.cpp:422] [Space: 749, Part: 59] has existed!
I20231121 14:49:40.887951 64175 NebulaStore.cpp:422] [Space: 749, Part: 60] has existed!
I20231121 14:49:40.887960 64175 NebulaStore.cpp:370] Data space 751 has existed!
I20231121 14:49:40.887979 64175 NebulaStore.cpp:422] [Space: 751, Part: 1] has existed!
I20231121 14:49:40.887991 64175 NebulaStore.cpp:422] [Space: 751, Part: 2] has existed!
I20231121 14:49:40.888008 64175 NebulaStore.cpp:422] [Space: 751, Part: 3] has existed!
I20231121 14:49:40.888018 64175 NebulaStore.cpp:422] [Space: 751, Part: 4] has existed!
I20231121 14:49:40.888029 64175 NebulaStore.cpp:422] [Space: 751, Part: 5] has existed!
I20231121 14:49:40.888039 64175 NebulaStore.cpp:422] [Space: 751, Part: 6] has existed!
I20231121 14:49:40.888049 64175 NebulaStore.cpp:422] [Space: 751, Part: 7] has existed!
I20231121 14:49:40.888058 64175 NebulaStore.cpp:422] [Space: 751, Part: 8] has existed!
I20231121 14:49:40.888068 64175 NebulaStore.cpp:422] [Space: 751, Part: 9] has existed!
I20231121 14:49:40.888078 64175 NebulaStore.cpp:422] [Space: 751, Part: 10] has existed!
I20231121 14:49:40.888087 64175 NebulaStore.cpp:422] [Space: 751, Part: 11] has existed!
I20231121 14:49:40.888098 64175 NebulaStore.cpp:422] [Space: 751, Part: 12] has existed!
I20231121 14:49:40.888106 64175 NebulaStore.cpp:422] [Space: 751, Part: 13] has existed!
I20231121 14:49:40.888115 64175 NebulaStore.cpp:422] [Space: 751, Part: 14] has existed!
I20231121 14:49:40.888129 64175 NebulaStore.cpp:422] [Space: 751, Part: 15] has existed!
I20231121 14:49:40.888139 64175 NebulaStore.cpp:422] [Space: 751, Part: 16] has existed!
I20231121 14:49:40.888149 64175 NebulaStore.cpp:422] [Space: 751, Part: 17] has existed!
I20231121 14:49:40.888157 64175 NebulaStore.cpp:422] [Space: 751, Part: 18] has existed!
I20231121 14:49:40.888170 64175 NebulaStore.cpp:422] [Space: 751, Part: 19] has existed!
I20231121 14:49:40.888181 64175 NebulaStore.cpp:422] [Space: 751, Part: 20] has existed!
I20231121 14:49:40.888190 64175 NebulaStore.cpp:422] [Space: 751, Part: 21] has existed!
I20231121 14:49:40.888199 64175 NebulaStore.cpp:422] [Space: 751, Part: 22] has existed!
I20231121 14:49:40.888208 64175 NebulaStore.cpp:422] [Space: 751, Part: 23] has existed!
I20231121 14:49:40.888218 64175 NebulaStore.cpp:422] [Space: 751, Part: 24] has existed!
I20231121 14:49:40.888228 64175 NebulaStore.cpp:422] [Space: 751, Part: 25] has existed!
I20231121 14:49:40.888237 64175 NebulaStore.cpp:422] [Space: 751, Part: 26] has existed!
I20231121 14:49:40.888249 64175 NebulaStore.cpp:422] [Space: 751, Part: 27] has existed!
I20231121 14:49:40.888258 64175 NebulaStore.cpp:422] [Space: 751, Part: 28] has existed!
I20231121 14:49:40.888267 64175 NebulaStore.cpp:422] [Space: 751, Part: 29] has existed!
I20231121 14:49:40.888276 64175 NebulaStore.cpp:422] [Space: 751, Part: 30] has existed!
I20231121 14:49:40.888288 64175 NebulaStore.cpp:422] [Space: 751, Part: 31] has existed!
I20231121 14:49:40.888298 64175 NebulaStore.cpp:422] [Space: 751, Part: 32] has existed!
I20231121 14:49:40.888309 64175 NebulaStore.cpp:422] [Space: 751, Part: 33] has existed!
I20231121 14:49:40.888321 64175 NebulaStore.cpp:422] [Space: 751, Part: 34] has existed!
I20231121 14:49:40.888334 64175 NebulaStore.cpp:422] [Space: 751, Part: 35] has existed!
I20231121 14:49:40.888345 64175 NebulaStore.cpp:422] [Space: 751, Part: 36] has existed!
I20231121 14:49:40.888355 64175 NebulaStore.cpp:422] [Space: 751, Part: 37] has existed!
I20231121 14:49:40.888367 64175 NebulaStore.cpp:422] [Space: 751, Part: 38] has existed!
I20231121 14:49:40.888377 64175 NebulaStore.cpp:422] [Space: 751, Part: 39] has existed!
I20231121 14:49:40.888389 64175 NebulaStore.cpp:422] [Space: 751, Part: 40] has existed!
I20231121 14:49:40.888401 64175 NebulaStore.cpp:422] [Space: 751, Part: 41] has existed!
I20231121 14:49:40.888409 64175 NebulaStore.cpp:422] [Space: 751, Part: 42] has existed!
I20231121 14:49:40.888418 64175 NebulaStore.cpp:422] [Space: 751, Part: 43] has existed!
I20231121 14:49:40.888428 64175 NebulaStore.cpp:422] [Space: 751, Part: 44] has existed!
I20231121 14:49:40.888437 64175 NebulaStore.cpp:422] [Space: 751, Part: 45] has existed!
I20231121 14:49:40.888446 64175 NebulaStore.cpp:422] [Space: 751, Part: 46] has existed!
I20231121 14:49:40.888455 64175 NebulaStore.cpp:422] [Space: 751, Part: 47] has existed!
I20231121 14:49:40.888465 64175 NebulaStore.cpp:422] [Space: 751, Part: 48] has existed!
I20231121 14:49:40.888474 64175 NebulaStore.cpp:422] [Space: 751, Part: 49] has existed!
I20231121 14:49:40.888484 64175 NebulaStore.cpp:422] [Space: 751, Part: 50] has existed!
I20231121 14:49:40.888492 64175 NebulaStore.cpp:422] [Space: 751, Part: 51] has existed!
I20231121 14:49:40.888502 64175 NebulaStore.cpp:422] [Space: 751, Part: 52] has existed!
I20231121 14:49:40.888511 64175 NebulaStore.cpp:422] [Space: 751, Part: 53] has existed!
I20231121 14:49:40.888520 64175 NebulaStore.cpp:422] [Space: 751, Part: 54] has existed!
I20231121 14:49:40.888530 64175 NebulaStore.cpp:422] [Space: 751, Part: 55] has existed!
I20231121 14:49:40.888538 64175 NebulaStore.cpp:422] [Space: 751, Part: 56] has existed!
I20231121 14:49:40.888547 64175 NebulaStore.cpp:422] [Space: 751, Part: 57] has existed!
I20231121 14:49:40.888557 64175 NebulaStore.cpp:422] [Space: 751, Part: 58] has existed!
I20231121 14:49:40.888566 64175 NebulaStore.cpp:422] [Space: 751, Part: 59] has existed!
I20231121 14:49:40.888576 64175 NebulaStore.cpp:422] [Space: 751, Part: 60] has existed!
I20231121 14:49:40.888584 64175 NebulaStore.cpp:370] Data space 752 has existed!
I20231121 14:49:40.888609 64175 NebulaStore.cpp:422] [Space: 752, Part: 1] has existed!
I20231121 14:49:40.888619 64175 NebulaStore.cpp:422] [Space: 752, Part: 2] has existed!
I20231121 14:49:40.888629 64175 NebulaStore.cpp:422] [Space: 752, Part: 3] has existed!
I20231121 14:49:40.888641 64175 NebulaStore.cpp:422] [Space: 752, Part: 4] has existed!
I20231121 14:49:40.888650 64175 NebulaStore.cpp:422] [Space: 752, Part: 5] has existed!
I20231121 14:49:40.888660 64175 NebulaStore.cpp:422] [Space: 752, Part: 6] has existed!
I20231121 14:49:40.888669 64175 NebulaStore.cpp:422] [Space: 752, Part: 7] has existed!
I20231121 14:49:40.888679 64175 NebulaStore.cpp:422] [Space: 752, Part: 8] has existed!
I20231121 14:49:40.888689 64175 NebulaStore.cpp:422] [Space: 752, Part: 9] has existed!
I20231121 14:49:40.888700 64175 NebulaStore.cpp:422] [Space: 752, Part: 10] has existed!
I20231121 14:49:40.888708 64175 NebulaStore.cpp:422] [Space: 752, Part: 11] has existed!
I20231121 14:49:40.888720 64175 NebulaStore.cpp:422] [Space: 752, Part: 12] has existed!
I20231121 14:49:40.888729 64175 NebulaStore.cpp:422] [Space: 752, Part: 13] has existed!
I20231121 14:49:40.888741 64175 NebulaStore.cpp:422] [Space: 752, Part: 14] has existed!
I20231121 14:49:40.888763 64175 NebulaStore.cpp:422] [Space: 752, Part: 15] has existed!
I20231121 14:49:40.888773 64175 NebulaStore.cpp:422] [Space: 752, Part: 16] has existed!
I20231121 14:49:40.888782 64175 NebulaStore.cpp:422] [Space: 752, Part: 17] has existed!
I20231121 14:49:40.888792 64175 NebulaStore.cpp:422] [Space: 752, Part: 18] has existed!
I20231121 14:49:40.888801 64175 NebulaStore.cpp:422] [Space: 752, Part: 19] has existed!
I20231121 14:49:40.888811 64175 NebulaStore.cpp:422] [Space: 752, Part: 20] has existed!
I20231121 14:49:40.888820 64175 NebulaStore.cpp:422] [Space: 752, Part: 21] has existed!
I20231121 14:49:40.888829 64175 NebulaStore.cpp:422] [Space: 752, Part: 22] has existed!
I20231121 14:49:40.888842 64175 NebulaStore.cpp:422] [Space: 752, Part: 23] has existed!
I20231121 14:49:40.888852 64175 NebulaStore.cpp:422] [Space: 752, Part: 24] has existed!
I20231121 14:49:40.888862 64175 NebulaStore.cpp:422] [Space: 752, Part: 25] has existed!
I20231121 14:49:40.888871 64175 NebulaStore.cpp:422] [Space: 752, Part: 26] has existed!
I20231121 14:49:40.888882 64175 NebulaStore.cpp:422] [Space: 752, Part: 27] has existed!
I20231121 14:49:40.888892 64175 NebulaStore.cpp:422] [Space: 752, Part: 28] has existed!
I20231121 14:49:40.888901 64175 NebulaStore.cpp:422] [Space: 752, Part: 29] has existed!
I20231121 14:49:40.888913 64175 NebulaStore.cpp:422] [Space: 752, Part: 30] has existed!
I20231121 14:49:40.888922 64175 NebulaStore.cpp:422] [Space: 752, Part: 31] has existed!
I20231121 14:49:40.888931 64175 NebulaStore.cpp:422] [Space: 752, Part: 32] has existed!
I20231121 14:49:40.888940 64175 NebulaStore.cpp:422] [Space: 752, Part: 33] has existed!
I20231121 14:49:40.888950 64175 NebulaStore.cpp:422] [Space: 752, Part: 34] has existed!
I20231121 14:49:40.888959 64175 NebulaStore.cpp:422] [Space: 752, Part: 35] has existed!
I20231121 14:49:40.888968 64175 NebulaStore.cpp:422] [Space: 752, Part: 36] has existed!
I20231121 14:49:40.888978 64175 NebulaStore.cpp:422] [Space: 752, Part: 37] has existed!
I20231121 14:49:40.888988 64175 NebulaStore.cpp:422] [Space: 752, Part: 38] has existed!
I20231121 14:49:40.888996 64175 NebulaStore.cpp:422] [Space: 752, Part: 39] has existed!
I20231121 14:49:40.889006 64175 NebulaStore.cpp:422] [Space: 752, Part: 40] has existed!
I20231121 14:49:40.889017 64175 NebulaStore.cpp:422] [Space: 752, Part: 41] has existed!
I20231121 14:49:40.889027 64175 NebulaStore.cpp:422] [Space: 752, Part: 42] has existed!
I20231121 14:49:40.889036 64175 NebulaStore.cpp:422] [Space: 752, Part: 43] has existed!
I20231121 14:49:40.889045 64175 NebulaStore.cpp:422] [Space: 752, Part: 44] has existed!
I20231121 14:49:40.889055 64175 NebulaStore.cpp:422] [Space: 752, Part: 45] has existed!
I20231121 14:49:40.889066 64175 NebulaStore.cpp:422] [Space: 752, Part: 46] has existed!
I20231121 14:49:40.889075 64175 NebulaStore.cpp:422] [Space: 752, Part: 47] has existed!
I20231121 14:49:40.889086 64175 NebulaStore.cpp:422] [Space: 752, Part: 48] has existed!
I20231121 14:49:40.889094 64175 NebulaStore.cpp:422] [Space: 752, Part: 49] has existed!
I20231121 14:49:40.889104 64175 NebulaStore.cpp:422] [Space: 752, Part: 50] has existed!
I20231121 14:49:40.889113 64175 NebulaStore.cpp:422] [Space: 752, Part: 51] has existed!
I20231121 14:49:40.889122 64175 NebulaStore.cpp:422] [Space: 752, Part: 52] has existed!
I20231121 14:49:40.889132 64175 NebulaStore.cpp:422] [Space: 752, Part: 53] has existed!
I20231121 14:49:40.889142 64175 NebulaStore.cpp:422] [Space: 752, Part: 54] has existed!
I20231121 14:49:40.889150 64175 NebulaStore.cpp:422] [Space: 752, Part: 55] has existed!
I20231121 14:49:40.889159 64175 NebulaStore.cpp:422] [Space: 752, Part: 56] has existed!
I20231121 14:49:40.889169 64175 NebulaStore.cpp:422] [Space: 752, Part: 57] has existed!
I20231121 14:49:40.889178 64175 NebulaStore.cpp:422] [Space: 752, Part: 58] has existed!
I20231121 14:49:40.889189 64175 NebulaStore.cpp:422] [Space: 752, Part: 59] has existed!
I20231121 14:49:40.889197 64175 NebulaStore.cpp:422] [Space: 752, Part: 60] has existed!
I20231121 14:49:40.889714 64175 NebulaStore.cpp:79] Register handler...
I20231121 14:49:40.889724 64175 StorageServer.cpp:253] Init LogMonitor
I20231121 14:49:40.889940 64175 StorageServer.cpp:120] Starting Storage HTTP Service
I20231121 14:49:40.890298 64175 StorageServer.cpp:124] Http Thread Pool started
I20231121 14:49:40.896775 64995 WebService.cpp:124] Web service started on HTTP[19779]
I20231121 14:49:40.897070 64175 RocksEngineConfig.cpp:371] Emplace rocksdb option max_background_jobs=32
I20231121 14:49:40.897109 64175 RocksEngineConfig.cpp:371] Emplace rocksdb option max_subcompactions=32
I20231121 14:49:40.897395 64175 RocksEngineConfig.cpp:371] Emplace rocksdb option max_bytes_for_level_base=268435456
I20231121 14:49:40.897415 64175 RocksEngineConfig.cpp:371] Emplace rocksdb option max_write_buffer_number=6
I20231121 14:49:40.897425 64175 RocksEngineConfig.cpp:371] Emplace rocksdb option write_buffer_size=67108864
I20231121 14:49:40.897843 64175 RocksEngineConfig.cpp:371] Emplace rocksdb option block_size=8192
I20231121 14:49:40.918318 64175 RocksEngine.cpp:107] open rocksdb on /usr/local/nebula/data/storage/nebula/0/data
I20231121 14:49:40.918416 64664 EventListener.h:21] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I20231121 14:49:40.918509 64175 AdminTaskManager.cpp:22] max concurrent subtasks: 10
I20231121 14:49:40.918684 64175 AdminTaskManager.cpp:40] exit AdminTaskManager::init()
I20231121 14:49:40.918903 65016 AdminTaskManager.cpp:224] waiting for incoming task
I20231121 14:49:40.921456 64664 EventListener.h:35] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I20231121 14:49:41.468127 64175 MemoryUtils.cpp:171] MemoryTracker set static ratio: 0.8
I20231121 14:52:22.073273 64639 MetaClient.cpp:3259] Load leader of "192.168.0.186":9779 in 5 space
I20231121 14:52:22.073366 64639 MetaClient.cpp:3259] Load leader of "192.168.0.187":9779 in 0 space
I20231121 14:52:22.074791 64639 MetaClient.cpp:3259] Load leader of "192.168.0.188":9779 in 19 space
I20231121 14:52:22.074815 64639 MetaClient.cpp:3265] Load leader ok
I20231121 14:58:18.943320 64639 MetaClient.cpp:3259] Load leader of "192.168.0.186":9779 in 5 space
I20231121 14:58:18.943526 64639 MetaClient.cpp:3259] Load leader of "192.168.0.187":9779 in 0 space
I20231121 14:58:18.944654 64639 MetaClient.cpp:3259] Load leader of "192.168.0.188":9779 in 19 space
I20231121 14:58:18.944676 64639 MetaClient.cpp:3265] Load leader ok
I20231121 15:02:36.159725 64639 MetaClient.cpp:3259] Load leader of "192.168.0.186":9779 in 5 space
I20231121 15:02:36.159839 64639 MetaClient.cpp:3259] Load leader of "192.168.0.187":9779 in 0 space
I20231121 15:02:36.161037 64639 MetaClient.cpp:3259] Load leader of "192.168.0.188":9779 in 19 space
I20231121 15:02:36.161058 64639 MetaClient.cpp:3265] Load leader ok
I20231121 15:06:18.168613 64639 MetaClient.cpp:3259] Load leader of "192.168.0.186":9779 in 5 space
I20231121 15:06:18.168742 64639 MetaClient.cpp:3259] Load leader of "192.168.0.187":9779 in 0 space
I20231121 15:06:18.170166 64639 MetaClient.cpp:3259] Load leader of "192.168.0.188":9779 in 19 space
I20231121 15:06:18.170185 64639 MetaClient.cpp:3265] Load leader ok
最后烦请删掉本模版和问题无关的信息之后，再提交提问，Thx