-
nebula 版本:3.2.1
-
部署方式:分布式
-
安装方式:nebula-operator
-
是否为线上版本:N
-
硬件信息
- 磁盘 HDD
- CPU、内存信息
-
问题的具体描述
用exchange导入sst数据,match和lookup统计的数据不一致
-
相关的 meta / storage / graph info 日志信息(尽量使用文本形式方便检索)
I20230111 07:50:22.366868 158 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:50:24.984644 158 AdminJobProcessor.cpp:27] process() op = ADD, type = INGEST, paras.size()=0
I20230111 07:50:26.893770 151 JobManager.cpp:232] jobFinished, spaceId=963, jobId=964, result=FINISHED
I20230111 07:50:26.978829 151 JobManager.cpp:218] cleanJob 964
I20230111 07:50:31.781241 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-graphd-0.nebula-graphd-svc.nebula-operator-system.svc.cluster.local":9669, role = GRAPH
I20230111 07:50:31.847091 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:51:57.824637 151 AdminJobProcessor.cpp:27] process() op = SHOW, paras.size()=1 964
I20230111 07:51:57.939924 143 CreateTagIndexProcessor.cpp:205] Create Tag Index entity_区域_index_id, tagIndex 965
I20230111 07:51:58.091708 143 CreateTagIndexProcessor.cpp:205] Create Tag Index entity_区域_index, tagIndex 966
I20230111 07:51:58.139516 143 CreateTagIndexProcessor.cpp:205] Create Tag Index entity_区域_index_name, tagIndex 967
I20230111 07:52:02.520654 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-graphd-0.nebula-graphd-svc.nebula-operator-system.svc.cluster.local":9669, role = GRAPH
I20230111 07:52:02.556874 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:02.659067 151 SessionManagerProcessor.cpp:130] resp list session: 1673407782682115
I20230111 07:52:02.659703 151 SessionManagerProcessor.cpp:130] resp list session: 1673407782814483
I20230111 07:52:02.660087 151 SessionManagerProcessor.cpp:130] resp list session: 1673404756787246
I20230111 07:52:02.660302 151 SessionManagerProcessor.cpp:130] resp list session: 1673407782780991
I20230111 07:52:02.660511 151 SessionManagerProcessor.cpp:130] resp list session: 1673418232518213
I20230111 07:52:02.660706 151 SessionManagerProcessor.cpp:130] resp list session: 1673403462438500
I20230111 07:52:02.660897 151 SessionManagerProcessor.cpp:130] resp list session: 1673398961158271
I20230111 07:52:02.661080 151 SessionManagerProcessor.cpp:130] resp list session: 1673397330413716
I20230111 07:52:02.661276 151 SessionManagerProcessor.cpp:130] resp list session: 1673406520648875
I20230111 07:52:02.661474 151 SessionManagerProcessor.cpp:130] resp list session: 1673406622023099
I20230111 07:52:02.661685 151 SessionManagerProcessor.cpp:130] resp list session: 1673407782614489
I20230111 07:52:02.664109 143 SessionManagerProcessor.cpp:130] resp list session: 1673407782682115
I20230111 07:52:02.664691 143 SessionManagerProcessor.cpp:130] resp list session: 1673407782814483
I20230111 07:52:02.665326 143 SessionManagerProcessor.cpp:130] resp list session: 1673404756787246
I20230111 07:52:02.665552 143 SessionManagerProcessor.cpp:130] resp list session: 1673407782780991
I20230111 07:52:02.665807 143 SessionManagerProcessor.cpp:130] resp list session: 1673418232518213
I20230111 07:52:02.666090 143 SessionManagerProcessor.cpp:130] resp list session: 1673403462438500
I20230111 07:52:02.666314 143 SessionManagerProcessor.cpp:130] resp list session: 1673398961158271
I20230111 07:52:02.666574 143 SessionManagerProcessor.cpp:130] resp list session: 1673397330413716
I20230111 07:52:02.666823 143 SessionManagerProcessor.cpp:130] resp list session: 1673406520648875
I20230111 07:52:02.667165 143 SessionManagerProcessor.cpp:130] resp list session: 1673406622023099
I20230111 07:52:02.667424 143 SessionManagerProcessor.cpp:130] resp list session: 1673407782614489
I20230111 07:52:03.114717 143 AdminJobProcessor.cpp:27] process() op = SHOW, paras.size()=1 964
I20230111 07:52:03.307013 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:03.343772 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:03.402369 151 SessionManagerProcessor.cpp:130] resp list session: 1673407782682115
I20230111 07:52:03.402967 151 SessionManagerProcessor.cpp:130] resp list session: 1673407782814483
I20230111 07:52:03.403409 151 SessionManagerProcessor.cpp:130] resp list session: 1673404756787246
I20230111 07:52:03.407150 143 SessionManagerProcessor.cpp:130] resp list session: 1673407782614489
I20230111 07:52:12.821110 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-graphd-0.nebula-graphd-svc.nebula-operator-system.svc.cluster.local":9669, role = GRAPH
I20230111 07:52:12.844727 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:13.535571 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:13.555899 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:18.508683 143 AdminJobProcessor.cpp:27] process() op = ADD, type = REBUILD_TAG_INDEX, paras.size()=0
I20230111 07:52:19.974772 143 JobManager.cpp:232] jobFinished, spaceId=963, jobId=965, result=FINISHED
I20230111 07:52:20.004889 143 JobManager.cpp:218] cleanJob 965
I20230111 07:52:22.988436 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-graphd-0.nebula-graphd-svc.nebula-operator-system.svc.cluster.local":9669, role = GRAPH
I20230111 07:52:23.129724 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:23.387216 143 AdminJobProcessor.cpp:27] process() op = ADD, type = REBUILD_TAG_INDEX, paras.size()=0
I20230111 07:52:23.624454 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:23.653973 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:24.087432 151 JobManager.cpp:232] jobFinished, spaceId=963, jobId=966, result=FINISHED
I20230111 07:52:24.117507 151 JobManager.cpp:218] cleanJob 966
I20230111 07:52:33.062973 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-graphd-0.nebula-graphd-svc.nebula-operator-system.svc.cluster.local":9669, role = GRAPH
I20230111 07:52:33.162338 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:33.683215 143 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:33.705001 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:43.199115 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-graphd-0.nebula-graphd-svc.nebula-operator-system.svc.cluster.local":9669, role = GRAPH
I20230111 07:52:43.248176 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:52:43.753445 151 HBProcessor.cpp:33] Receive heartbeat from "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779, role = STORAGE
I20230111 07:40:28.513342 622 AdminTaskManager.cpp:318] subtask of task(962, 0) finished, unfinished task 0
I20230111 07:40:28.513749 622 StatsTask.cpp:285] task(962, 0) finished, rc=[SUCCEEDED]
I20230111 07:40:28.514837 517 AdminTaskManager.cpp:92] reportTaskFinish(), job=962, task=0, rc=SUCCEEDED
I20230111 07:40:28.522781 663 AdminTaskManager.cpp:329] task(962, 0) runSubTask() exit
I20230111 07:40:28.687069 517 AdminTaskManager.cpp:134] reportTaskFinish(), job=962, task=0, rc=SUCCEEDED
I20230111 07:49:31.119171 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 38 space
I20230111 07:49:31.119998 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:49:31.120347 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:49:31.120558 73 MetaClient.cpp:3100] Load leader ok
I20230111 07:49:31.123956 73 NebulaStore.cpp:387] Create data space 963
I20230111 07:49:31.136612 73 RocksEngineConfig.cpp:366] Emplace rocksdb option max_background_jobs=4
I20230111 07:49:31.137089 73 RocksEngineConfig.cpp:366] Emplace rocksdb option max_subcompactions=4
I20230111 07:49:31.137789 73 RocksEngineConfig.cpp:366] Emplace rocksdb option max_bytes_for_level_base=268435456
I20230111 07:49:31.138034 73 RocksEngineConfig.cpp:366] Emplace rocksdb option max_write_buffer_number=4
I20230111 07:49:31.138249 73 RocksEngineConfig.cpp:366] Emplace rocksdb option write_buffer_size=67108864
I20230111 07:49:31.138465 73 RocksEngineConfig.cpp:366] Emplace rocksdb option disable_auto_compactions=false
I20230111 07:49:31.139036 73 RocksEngineConfig.cpp:366] Emplace rocksdb option block_size=8192
I20230111 07:49:31.620532 73 RocksEngine.cpp:97] open rocksdb on /usr/local/nebula/data/storage/nebula/963/data
I20230111 07:49:31.632385 73 NebulaStore.cpp:459] Space 963, part 1 has been added, asLearner 0
I20230111 07:49:31.640005 73 NebulaStore.cpp:459] Space 963, part 3 has been added, asLearner 0
I20230111 07:49:31.648278 73 NebulaStore.cpp:459] Space 963, part 2 has been added, asLearner 0
I20230111 07:49:41.863689 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 38 space
I20230111 07:49:41.864710 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 37 space
I20230111 07:49:41.865329 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:49:41.865731 73 MetaClient.cpp:3100] Load leader ok
I20230111 07:49:52.120617 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 38 space
I20230111 07:49:52.121327 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 37 space
I20230111 07:49:52.121760 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:49:52.122061 73 MetaClient.cpp:3100] Load leader ok
I20230111 07:50:25.187016 41 AdminTask.cpp:21] createAdminTask (964, 2)
I20230111 07:50:25.188385 41 AdminTaskManager.cpp:158] enqueue task(964, 2)
I20230111 07:50:25.188411 516 AdminTaskManager.cpp:239] dequeue task(964, 2)
I20230111 07:50:25.189539 516 AdminTaskManager.cpp:282] run task(964, 2), 1 subtasks in 1 thread
I20230111 07:50:25.189848 516 AdminTaskManager.cpp:227] waiting for incoming task
I20230111 07:50:25.199246 655 IngestTask.cpp:38] Ingest files: 1
I20230111 07:50:25.930128 655 IngestTask.cpp:38] Ingest files: 1
I20230111 07:50:26.308045 655 IngestTask.cpp:38] Ingest files: 1
I20230111 07:50:26.625106 82 EventListener.h:21] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 4 files into 0, base level is 0, output level is 1
I20230111 07:50:26.626081 82 CompactionFilter.h:82] Do full/manual compaction!
I20230111 07:50:26.626474 655 AdminTaskManager.cpp:318] subtask of task(964, 2) finished, unfinished task 0
I20230111 07:50:26.626803 655 AdminTask.h:129] task(964, 2) finished, rc=[SUCCEEDED]
I20230111 07:50:26.627553 517 AdminTaskManager.cpp:92] reportTaskFinish(), job=964, task=2, rc=SUCCEEDED
I20230111 07:50:26.742794 517 AdminTaskManager.cpp:134] reportTaskFinish(), job=964, task=2, rc=SUCCEEDED
I20230111 07:50:26.962750 82 EventListener.h:35] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 4 files into 1, base level is 0, output level is 1
I20230111 07:52:03.527298 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 38 space
I20230111 07:52:03.528092 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 37 space
I20230111 07:52:03.528678 73 MetaClient.cpp:3094] Load leader of "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:52:03.528908 73 MetaClient.cpp:3100] Load leader ok
I20230111 07:49:30.678261 127 MetaClient.cpp:3100] Load leader ok
I20230111 07:49:43.513593 57 GraphService.cpp:76] Authenticating user root from 10.72.55.201:13398
I20230111 07:49:43.598811 65 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:49:51.511616 127 MetaClient.cpp:3094] Load leader of "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 38 space
I20230111 07:49:51.511993 127 MetaClient.cpp:3094] Load leader of "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 37 space
I20230111 07:49:51.512439 127 MetaClient.cpp:3094] Load leader of "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:49:51.512606 127 MetaClient.cpp:3100] Load leader ok
I20230111 07:50:22.535207 51 GraphService.cpp:76] Authenticating user root from 172.18.137.40:41856
I20230111 07:50:24.983943 51 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:51:57.769986 51 GraphService.cpp:76] Authenticating user root from 10.72.55.201:1153
I20230111 07:51:57.824048 65 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:51:57.835579 57 GraphService.cpp:76] Authenticating user root from 10.72.55.201:1153
I20230111 07:51:57.909845 65 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:02.806962 127 MetaClient.cpp:3094] Load leader of "nebula-storaged-0.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 38 space
I20230111 07:52:02.807410 127 MetaClient.cpp:3094] Load leader of "nebula-storaged-1.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 37 space
I20230111 07:52:02.808046 127 MetaClient.cpp:3094] Load leader of "nebula-storaged-2.nebula-storaged-headless.nebula-operator-system.svc.cluster.local":9779 in 36 space
I20230111 07:52:02.808287 127 MetaClient.cpp:3100] Load leader ok
I20230111 07:52:03.054978 65 GraphService.cpp:76] Authenticating user root from 10.72.55.201:13398
I20230111 07:52:03.113878 65 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:03.122788 57 GraphService.cpp:76] Authenticating user root from 10.72.55.201:13398
I20230111 07:52:03.169087 65 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:18.169889 45 GraphService.cpp:76] Authenticating user root from 10.72.55.201:1153
I20230111 07:52:18.230082 51 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:18.232323 57 GraphService.cpp:76] Authenticating user root from 10.72.55.201:1153
I20230111 07:52:18.422967 65 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:18.426298 65 GraphService.cpp:76] Authenticating user root from 10.72.55.201:1153
I20230111 07:52:18.508066 45 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:23.175282 45 GraphService.cpp:76] Authenticating user root from 10.72.55.201:13398
I20230111 07:52:23.197777 51 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:23.199769 57 GraphService.cpp:76] Authenticating user root from 10.72.55.201:13398
I20230111 07:52:23.322307 57 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:52:23.324522 65 GraphService.cpp:76] Authenticating user root from 10.72.55.201:13398
I20230111 07:52:23.386610 57 SwitchSpaceExecutor.cpp:37] Graph switched to `place_ws_a83b1895b6c14cf1', space id: 963
I20230111 07:55:28.211108 45 SwitchSpaceExecutor.cpp:37] Graph switched to `demo02', space id: 943