dump tool统计数据不完全

YOUSOYOUSO · 2020 年11 月 28 日 03:08

nebula 版本：
1.1.0
部署方式（分布式 / 单机 / Docker / DBaaS）：
分布式 3节点

=====================================================================
| ID | Name | Partition number | Replica Factor | Charset | Collate |
=====================================================================
| 2  | nba  | 10               | 1              |         |         |
---------------------------------------------------------------------

问题的具体描述
1.0.1版本升级到1.1.0后，dump tool 无法统计正确的数据量

采用的图空间为nba，其中player点有12个

首先排除过因为没有统计多节点数据求和的原因，dump 命令如下，统计了3个节点的数量:

/usr/local/nebula/bin/db_dump --space=nba --mode=stat --db_path=/data/nebula/storage/nebula/ --meta_server=ip1:45500,ip2:45500,ip3:45500 --limit 0

结果：（写这个贴子的时间是11.28日，测出来player有5个，但是11.27日测出来只有3个，存在变化）

然后尝试用 dump_tool统计不对 - #4，来自 splendor023 中的方法解决，发现job submit flush 执行失败微信图片_20201127231310

以下为show host的结果：
企业微信截图_16056875394731

日志在楼下贴出

YOUSOYOUSO · 2020 年11 月 28 日 03:16

节点1 storage

I1127 20:34:28.171209 49880 RaftPart.cpp:420] [Port: 44501, Space: 7, Part: 12] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.171597 49880 RaftPart.cpp:440] [Port: 44501, Space: 7, Part: 12] I am Follower, just wait for the new leader!
I1127 20:34:28.171213 49888 RaftPart.cpp:1562] [Port: 44501, Space: 510, Part: 2] Local is missing logs from id 4553405. Need to catch up
I1127 20:34:28.171612 49923 RaftPart.cpp:420] [Port: 44501, Space: 6, Part: 12] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.171490 49878 RaftPart.cpp:420] [Port: 44501, Space: 6, Part: 11] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.171648 49878 RaftPart.cpp:440] [Port: 44501, Space: 6, Part: 11] I am Follower, just wait for the new leader!
I1127 20:34:28.171083 49907 RaftPart.cpp:420] [Port: 44501, Space: 6, Part: 13] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.171039 49901 RaftPart.cpp:1562] [Port: 44501, Space: 6, Part: 10] Local is missing logs from id 7131681. Need to catch up
I1127 20:34:28.171063 49899 RaftPart.cpp:440] [Port: 44501, Space: 6, Part: 8] I am Follower, just wait for the new leader!
I1127 20:34:28.171612 49881 RaftPart.cpp:420] [Port: 44501, Space: 7, Part: 10] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.171747 49881 RaftPart.cpp:440] [Port: 44501, Space: 7, Part: 10] I am Follower, just wait for the new leader!
I1127 20:34:28.171494 49884 RaftPart.cpp:440] [Port: 44501, Space: 7, Part: 8] I am Follower, just wait for the new leader!
I1127 20:34:28.171284 49909 RaftPart.cpp:440] [Port: 44501, Space: 7, Part: 11] I am Follower, just wait for the new leader!
I1127 20:34:28.171691 49907 RaftPart.cpp:440] [Port: 44501, Space: 6, Part: 13] I am Follower, just wait for the new leader!
I1127 20:34:28.171633 49923 RaftPart.cpp:440] [Port: 44501, Space: 6, Part: 12] I am Follower, just wait for the new leader!
I1127 20:34:28.171952 49923 RaftPart.cpp:420] [Port: 44501, Space: 510, Part: 2] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.171967 49923 RaftPart.cpp:440] [Port: 44501, Space: 510, Part: 2] I am Follower, just wait for the new leader!
I1127 20:34:28.172009 49907 RaftPart.cpp:420] [Port: 44501, Space: 6, Part: 10] Commit transfer leader to [172.21.2.224:44501]
I1127 20:34:28.172021 49907 RaftPart.cpp:440] [Port: 44501, Space: 6, Part: 10] I am Follower, just wait for the new leader!
I1127 20:34:57.551555 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:34:57.601110 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:34:57.601943 50348 CompactionFilter.h:67] Do default minor compaction!
I1127 20:34:57.609987 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:34:57.628213 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:34:57.635787 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:44:57.732228 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:44:57.741768 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.810734 50348 CompactionFilter.h:67] Do default minor compaction!
I1127 20:54:57.820163 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.829455 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:57.839838 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.841691 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:57.855373 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.859477 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:57.868343 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.879369 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:57.888119 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.889662 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:57.903383 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:57.905443 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:57.915412 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:04:57.934003 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:04:57.947203 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:04:58.071077 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:04:59.566251 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:58.085629 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:58.140583 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:58.141968 50348 CompactionFilter.h:67] Do default minor compaction!
I1127 21:14:58.158078 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:58.203285 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:58.215054 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:24:58.298348 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:24:58.306408 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.376821 50348 CompactionFilter.h:67] Do default minor compaction!
I1127 21:34:58.389410 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.397181 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:58.408205 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.410410 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:58.422384 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.432965 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:58.440915 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.449431 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:58.457113 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.458745 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:58.467065 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:58.468475 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:58.477114 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:44:58.499670 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:44:58.507863 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:44:58.600217 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:45:00.086544 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:54:58.610041 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:54:58.654561 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:54:58.655376 50348 CompactionFilter.h:67] Do default minor compaction!
I1127 21:54:58.666657 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:54:58.692093 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:54:58.700454 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:04:58.795989 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:04:58.804384 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.871181 50348 CompactionFilter.h:67] Do default minor compaction!
I1127 22:14:58.881731 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.894639 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:14:58.909330 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.910773 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:14:58.920868 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.930408 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:14:58.943339 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.957882 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:14:58.968703 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.969130 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:14:58.977538 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:14:58.980818 50348 CompactionFilter.h:57] Do full/manual compaction!
I1127 22:14:58.990885 50348 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1

节点1 meta

I1127 16:02:32.579252 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 16:42:32.642498 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 17:22:32.740332 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 18:02:32.779022 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 18:42:32.824730 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 19:22:32.878437 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:02:32.928798 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:42:32.972738 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:22:33.024025 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:02:33.073586 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:42:33.123648 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 23:22:33.176213 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1128 00:02:33.227685 49911 EventListner.h:17] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1

YOUSOYOUSO · 2020 年11 月 28 日 03:30

节点2storage

rejected
I1127 20:34:27.547495 51766 RaftPart.cpp:1292] [Port: 44501, Space: 647, Part: 2] Recieved a VOTING request: space = 647, partition = 2, candidateAddr = 172.21.2.160:44501, term = 226009, lastLogId = 1937252, lastLogTerm = 226008
I1127 20:34:27.547513 51766 RaftPart.cpp:1325] [Port: 44501, Space: 647, Part: 2] The partition currently is a Follower, lastLogId 1937254, lastLogTerm 226009, committedLogId 1937253, term 226009
I1127 20:34:27.547523 51766 RaftPart.cpp:1339] [Port: 44501, Space: 647, Part: 2] The partition currently is on term 226009. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547612 51766 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 9] Recieved a VOTING request: space = 6, partition = 9, candidateAddr = 172.21.2.160:44501, term = 225800, lastLogId = 7131747, lastLogTerm = 225799
I1127 20:34:27.547621 51766 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 9] The partition currently is a Follower, lastLogId 7131749, lastLogTerm 225800, committedLogId 7131748, term 225800
I1127 20:34:27.547627 51766 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 9] The partition currently is on term 225800. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547680 51766 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 11] Recieved a VOTING request: space = 6, partition = 11, candidateAddr = 172.21.2.160:44501, term = 226334, lastLogId = 7131702, lastLogTerm = 226333
I1127 20:34:27.547688 51766 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 11] The partition currently is a Follower, lastLogId 7131704, lastLogTerm 226334, committedLogId 7131703, term 226334
I1127 20:34:27.547694 51766 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 11] The partition currently is on term 226334. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547752 51766 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 13] Recieved a VOTING request: space = 6, partition = 13, candidateAddr = 172.21.2.160:44501, term = 226490, lastLogId = 7131664, lastLogTerm = 226489
I1127 20:34:27.547760 51766 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 13] The partition currently is a Follower, lastLogId 7131666, lastLogTerm 226490, committedLogId 7131665, term 226490
I1127 20:34:27.547798 51766 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 13] The partition currently is on term 226490. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:44:15.911092 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:15.911232 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 20:44:15.923097 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:44:15.923386 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:15.923455 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:44:15.934429 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:44:15.960292 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:15.960444 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 20:44:16.139314 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:15.989487 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:15.989622 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.000249 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.001225 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.001279 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.010658 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.012369 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.012408 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 20:54:16.021870 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.042199 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.042340 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.051774 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.053483 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.053535 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.063870 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.065735 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.065783 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.077724 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.107802 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.107904 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.118726 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
E1127 20:57:43.633843 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_cell_level:uint32]!
E1127 20:57:43.633958 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_cover_cell_num:uint32]!
E1127 20:57:43.633975 52801 GetFlagsHandler.cpp:130] Don't support converting the type [min_cell_level:uint32]!
E1127 20:57:43.633992 52801 GetFlagsHandler.cpp:130] Don't support converting the type [histogram_max:uint32]!
E1127 20:57:43.634006 52801 GetFlagsHandler.cpp:130] Don't support converting the type [histogram_min:uint32]!
E1127 20:57:43.634064 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_appendlog_batch_size:uint32]!
E1127 20:57:43.634093 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_outstanding_requests:uint32]!
E1127 20:57:43.634106 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_batch_size:uint32]!
E1127 20:57:43.634121 52801 GetFlagsHandler.cpp:130] Don't support converting the type [raft_heartbeat_interval_secs:uint32]!
E1127 20:57:43.634135 52801 GetFlagsHandler.cpp:130] Don't support converting the type [raft_snapshot_timeout:uint64]!
I1127 20:59:15.412916 52803 StorageHttpAdminHandler.cpp:55] do compact at space=nba
I1127 20:59:15.413025 52803 NebulaStore.cpp:694] Space 2 start compaction.
I1127 20:59:15.425961 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 2 files into 0, base level is 0, output level is 1
I1127 20:59:15.426067 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:59:15.438408 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 2 files into 1, base level is 0, output level is 1
I1127 20:59:15.438597 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 0, base level is 1, output level is 1
I1127 20:59:15.438627 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:59:15.446552 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 1, base level is 1, output level is 1
I1127 20:59:15.446738 52803 NebulaStore.cpp:708] Space 2 compaction done.
I1127 21:14:16.225504 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:14:16.230141 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:16.282191 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:50.682337 52800 StorageHttpAdminHandler.cpp:55] do compact at space=nba
I1127 21:14:50.682471 52800 NebulaStore.cpp:694] Space 2 start compaction.
I1127 21:14:50.697350 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 4 files into 0, base level is 0, output level is 1
I1127 21:14:50.697468 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:50.705673 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 4 files into 1, base level is 0, output level is 1
I1127 21:14:50.705955 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 0, base level is 1, output level is 1
I1127 21:14:50.705986 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:50.717839 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 1, base level is 1, output level is 1
I1127 21:14:50.718035 52800 NebulaStore.cpp:708] Space 2 compaction done.
I1127 21:24:16.411823 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:16.412014 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 21:24:16.428938 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:24:16.429251 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:16.429339 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:24:16.439769 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:24:16.461925 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:16.462038 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 21:24:16.632989 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.495034 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.495163 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:16.505901 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.507867 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.507931 52453 CompactionFilter.h:57] Do full/manual compaction!

节点2 meta 日志

127 20:34:27.547199 51794 RaftPart.cpp:1325] [Port: 44501, Space: 7, Part: 13] The partition currently is a Follower, lastLogId 7128033, lastLogTerm 225910, committedLogId 7128032, term 225910
I1127 20:34:27.547206 51794 RaftPart.cpp:1339] [Port: 44501, Space: 7, Part: 13] The partition currently is on term 225910. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547179 51766 RaftPart.cpp:1325] [Port: 44501, Space: 7, Part: 9] The partition currently is a Follower, lastLogId 7128245, lastLogTerm 226381, committedLogId 7128244, term 226381
I1127 20:34:27.547232 51766 RaftPart.cpp:1339] [Port: 44501, Space: 7, Part: 9] The partition currently is on term 226381. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547495 51766 RaftPart.cpp:1292] [Port: 44501, Space: 647, Part: 2] Recieved a VOTING request: space = 647, partition = 2, candidateAddr = 172.21.2.160:44501, term = 226009, lastLogId = 1937252, lastLogTerm = 226008
I1127 20:34:27.547513 51766 RaftPart.cpp:1325] [Port: 44501, Space: 647, Part: 2] The partition currently is a Follower, lastLogId 1937254, lastLogTerm 226009, committedLogId 1937253, term 226009
I1127 20:34:27.547523 51766 RaftPart.cpp:1339] [Port: 44501, Space: 647, Part: 2] The partition currently is on term 226009. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547612 51766 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 9] Recieved a VOTING request: space = 6, partition = 9, candidateAddr = 172.21.2.160:44501, term = 225800, lastLogId = 7131747, lastLogTerm = 225799
I1127 20:34:27.547621 51766 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 9] The partition currently is a Follower, lastLogId 7131749, lastLogTerm 225800, committedLogId 7131748, term 225800
I1127 20:34:27.547627 51766 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 9] The partition currently is on term 225800. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547680 51766 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 11] Recieved a VOTING request: space = 6, partition = 11, candidateAddr = 172.21.2.160:44501, term = 226334, lastLogId = 7131702, lastLogTerm = 226333
I1127 20:34:27.547688 51766 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 11] The partition currently is a Follower, lastLogId 7131704, lastLogTerm 226334, committedLogId 7131703, term 226334
I1127 20:34:27.547694 51766 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 11] The partition currently is on term 226334. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547752 51766 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 13] Recieved a VOTING request: space = 6, partition = 13, candidateAddr = 172.21.2.160:44501, term = 226490, lastLogId = 7131664, lastLogTerm = 226489
I1127 20:34:27.547760 51766 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 13] The partition currently is a Follower, lastLogId 7131666, lastLogTerm 226490, committedLogId 7131665, term 226490
I1127 20:34:27.547798 51766 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 13] The partition currently is on term 226490. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:44:15.911092 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:15.911232 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 20:44:15.923097 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:44:15.923386 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:15.923455 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:44:15.934429 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:44:15.960292 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:15.960444 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 20:44:16.139314 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:15.989487 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:15.989622 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.000249 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.001225 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.001279 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.010658 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.012369 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.012408 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 20:54:16.021870 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.042199 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.042340 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.051774 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.053483 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.053535 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.063870 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.065735 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.065783 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.077724 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:16.107802 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:16.107904 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:16.118726 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
E1127 20:57:43.633843 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_cell_level:uint32]!
E1127 20:57:43.633958 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_cover_cell_num:uint32]!
E1127 20:57:43.633975 52801 GetFlagsHandler.cpp:130] Don't support converting the type [min_cell_level:uint32]!
E1127 20:57:43.633992 52801 GetFlagsHandler.cpp:130] Don't support converting the type [histogram_max:uint32]!
E1127 20:57:43.634006 52801 GetFlagsHandler.cpp:130] Don't support converting the type [histogram_min:uint32]!
E1127 20:57:43.634064 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_appendlog_batch_size:uint32]!
E1127 20:57:43.634093 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_outstanding_requests:uint32]!
E1127 20:57:43.634106 52801 GetFlagsHandler.cpp:130] Don't support converting the type [max_batch_size:uint32]!
E1127 20:57:43.634121 52801 GetFlagsHandler.cpp:130] Don't support converting the type [raft_heartbeat_interval_secs:uint32]!
E1127 20:57:43.634135 52801 GetFlagsHandler.cpp:130] Don't support converting the type [raft_snapshot_timeout:uint64]!
I1127 20:59:15.412916 52803 StorageHttpAdminHandler.cpp:55] do compact at space=nba
I1127 20:59:15.413025 52803 NebulaStore.cpp:694] Space 2 start compaction.
I1127 20:59:15.425961 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 2 files into 0, base level is 0, output level is 1
I1127 20:59:15.426067 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:59:15.438408 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 2 files into 1, base level is 0, output level is 1
I1127 20:59:15.438597 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 0, base level is 1, output level is 1
I1127 20:59:15.438627 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:59:15.446552 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 1, base level is 1, output level is 1
I1127 20:59:15.446738 52803 NebulaStore.cpp:708] Space 2 compaction done.
I1127 21:14:16.225504 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:14:16.230141 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:16.282191 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:50.682337 52800 StorageHttpAdminHandler.cpp:55] do compact at space=nba
I1127 21:14:50.682471 52800 NebulaStore.cpp:694] Space 2 start compaction.
I1127 21:14:50.697350 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 4 files into 0, base level is 0, output level is 1
I1127 21:14:50.697468 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:50.705673 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 4 files into 1, base level is 0, output level is 1
I1127 21:14:50.705955 52453 EventListner.h:23] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 0, base level is 1, output level is 1
I1127 21:14:50.705986 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:50.717839 52453 EventListner.h:33] Rocksdb compact column family: default because of 9, status: OK, compacted 1 files into 1, base level is 1, output level is 1
I1127 21:14:50.718035 52800 NebulaStore.cpp:708] Space 2 compaction done.
I1127 21:24:16.411823 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:16.412014 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 21:24:16.428938 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:24:16.429251 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:16.429339 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:24:16.439769 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:24:16.461925 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:16.462038 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 21:24:16.632989 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.495034 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.495163 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:16.505901 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.507867 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.507931 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:16.519022 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.521843 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.521900 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 21:34:16.530786 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.550091 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.550253 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:16.559305 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.579191 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.579337 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:16.589655 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:16.598634 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:16.598722 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:16.608393 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:54:16.705433 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:54:16.705590 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:54:16.752852 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:54:16.776422 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:54:16.776538 52453 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:54:16.786891 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:04:16.856353 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 22:04:16.856757 52453 CompactionFilter.h:67] Do default minor compaction!
I1127 22:04:16.868494 52453 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 22:04:16.870556 52453 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 22:04:16.870615 52453 CompactionFilter.h:57] Do full/manual compaction!

YOUSOYOUSO · 2020 年11 月 28 日 03:42

节点3 storage日志

27 20:34:27.547608 66272 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 9] The partition currently is on term 225800. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547624 66272 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 11] Recieved a VOTING request: space = 6, partition = 11, candidateAddr = 172.21.2.160:44501, term = 226334, lastLogId = 7131702, lastLogTerm = 226333
I1127 20:34:27.547631 66272 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 11] The partition currently is a Leader, lastLogId 7131704, lastLogTerm 226334, committedLogId 7131704, term 226334
I1127 20:34:27.547637 66272 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 11] The partition currently is on term 226334. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:27.547637 66234 RaftPart.cpp:1292] [Port: 44501, Space: 6, Part: 13] Recieved a VOTING request: space = 6, partition = 13, candidateAddr = 172.21.2.160:44501, term = 226490, lastLogId = 7131664, lastLogTerm = 226489
I1127 20:34:27.547663 66234 RaftPart.cpp:1325] [Port: 44501, Space: 6, Part: 13] The partition currently is a Leader, lastLogId 7131666, lastLogTerm 226490, committedLogId 7131666, term 226490
I1127 20:34:27.547680 66234 RaftPart.cpp:1339] [Port: 44501, Space: 6, Part: 13] The partition currently is on term 226490. The term proposed by the candidate is no greater, so it will be rejected
I1127 20:34:30.168326 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:34:30.168486 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:34:30.215831 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:34:30.216768 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:34:30.216804 66464 CompactionFilter.h:67] Do default minor compaction!
I1127 20:34:30.234757 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:34:30.235097 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:34:30.235128 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:34:30.250910 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:34:30.251221 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:34:30.251252 66464 CompactionFilter.h:67] Do default minor compaction!
I1127 20:34:30.266932 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:44:30.397866 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:44:30.398394 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:44:30.406949 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:30.416443 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:30.416600 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:30.432543 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:30.487881 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:30.487967 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:30.497650 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 20:54:30.499848 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 20:54:30.499925 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 20:54:30.509795 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:04:30.546866 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:04:30.547030 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:04:30.557162 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:04:30.578610 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:04:30.578737 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:04:30.588699 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:04:30.590533 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:04:30.590574 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:04:30.599129 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:04:30.617384 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:04:30.617523 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:04:32.078882 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:30.641589 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:14:30.641780 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:30.695899 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:30.696987 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:14:30.697033 66464 CompactionFilter.h:67] Do default minor compaction!
I1127 21:14:30.708671 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:30.709599 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:14:30.709641 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:14:30.718299 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:14:30.719540 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:14:30.719621 66464 CompactionFilter.h:67] Do default minor compaction!
I1127 21:14:30.733894 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:24:30.864014 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:24:30.864183 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:24:30.877008 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:30.883213 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:30.883453 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:30.897343 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:30.946316 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:30.946424 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:30.954128 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:34:30.955543 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:34:30.955598 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:34:30.963621 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:44:31.002156 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I1127 21:44:31.002396 66464 CompactionFilter.h:57] Do full/manual compaction!
I1127 21:44:31.012969 66464 EventListner.h:33] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I1127 21:44:31.032950 66464 EventListner.h:23] Rocksdb compact column family: default because of 1, status: OK, compacted 5 files into 0, base level is 0, output level is

节点3 meta

I1126 01:42:19.249331 66174 InMemoryLogBuffer.h:23] [Port: 45501, Space: 0, Part: 0] InMemoryLogBuffer ctor, firstLogId 21753867
I1126 09:52:55.419420 66179 FileBasedWal.cpp:760] [Port: 45501, Space: 0, Part: 0] Clean wals number 1
I1127 10:37:57.517585 66174 InMemoryLogBuffer.h:27] [Port: 45501, Space: 0, Part: 0] InMemoryLogBuffer dtor, firstLogId 21630253
I1127 10:37:57.522728 66174 InMemoryLogBuffer.h:23] [Port: 45501, Space: 0, Part: 0] InMemoryLogBuffer ctor, firstLogId 21876576
I1127 22:08:52.873324 66376 GetTagIndexProcessor.cpp:27] Get Tag Index SpaceID: 2 Index Name: index_player
I1127 22:20:04.728312 66376 GetTagIndexProcessor.cpp:27] Get Tag Index SpaceID: 2 Index Name: index_player

tom-chensf · 2020 年11 月 28 日 10:45

/usr/local/nebula/bin/db_dump --space=nba --mode=stat --db_path=/data/nebula/storage/nebula/ --meta_server=ip1:45500,ip2:45500,ip3:45500 --limit 0

到 /usr/local/nebula/etc/nebula-storage.conf 确认一下目录是否都对得上，如果对不上就重新统计一下谢谢

YOUSOYOUSO · 2020 年11 月 29 日 08:37

是对的上的，尝试过重启，重新统计之后还是不准确。而且有一个情况就是比如说今天用dump统计是5个player，昨天统计是3个player，存在变化而且不准，但是用lookup查索引查出来的还是12条没有变化

yee · 2020 年11 月 30 日 01:54

dump_tool 只是读取本地 rocksdb 的数据文件，只在一台节点上设置 storage 节点的 ip 来使用是不正确的。

你的 space 是单副本3结点，需要去3台 storage 的结点上分别用 dump tool 统计后求和才能得到正确的结果。

YOUSOYOUSO · 2020 年11 月 30 日 11:56

分别统计求和后是对的
所以，您的意思是下列命令中
/usr/local/nebula/bin/db_dump --space=nba --mode=stat --db_path=/data/nebula/storage/nebula/ --meta_server=ip1:45500,ip2:45500,ip3:45500 --limit 0
这样的命令中 --meta_server指定了3节点的ip，但是统计的仍然是当前ip节点的本地数据是吗？（我记得之前也提过dump的问题，当时给的解决方案是–meta_server指定3个节点的ip就解决了，现在不适用了吗）
那请问job 执行失败是什么原因呢

yee · 2020 年11 月 30 日 12:55

这里要看 storage 是几副本，如果是 3结点3副本，只在一台机器上 dump 就可以，因为每台结点上都含有全量的数据，但是你这里是 1 副本三结点，那么所有数据被分散在了三个机器上，所以要统计三个机器。 nebula 2.0 提供了更简单的统计方式，SHOW STATS 可以统计 space 下的所有点边数据，欢迎关注使用。
这里需要 @liuyu85cn 帮忙看看日志查下 flush job fail 的原因

liuyu85cn · 2020 年12 月 1 日 01:58

job 执行失败大概率是 storage 侧的 http 端口被防火墙给 block 了, 可以手动验证下吗?

curl ‘http://xxx.xxx.xxx.xxx:xxxx/admin?space=xxxx&op=flush’

littlemengxin · 2021 年3 月 3 日 10:25

请问下docker-compose部署时如何使用dump_tool，是进入到对应的storage容器里操作吗？我进去后到bin目录下没有db_dump，只有nebula-storaged

Shylock-Hg · 2021 年3 月 3 日 10:37

什么版本呢，可能没打包

steam · 2021 年3 月 3 日 10:37

dump_tool 工具之前是没有镜像的，所以在 Docker 容器里找不到它，具体的需要 @yee 来确认下

littlemengxin · 2021 年3 月 4 日 01:14

v1.2.0

littlemengxin · 2021 年3 月 4 日 01:18

那我还有其他的办法使用dump_tool么

yee · 2021 年3 月 4 日 02:03

可以在本地安装 dump_tool，然后把 storage 的 data_path 映射到 host，在本地运行 dump_tool。稍微麻烦了一点

littlemengxin · 2021 年3 月 4 日 02:50

有什么方式可以单独简易地安装dump_tool 呢

littlemengxin · 2021 年3 月 4 日 02:56

如上

yee · 2021 年3 月 4 日 04:05

这个目前确实没有单独为 dump_tool 打包，只能通过 release 中的 nebula rpm 安装。

@steam 提个需求，单独给工具打包，至少先打包一个 docker 镜像。

cc @jievince