nebula cypher 机器oom

yee · 2022 年12 月 20 日 02:35

请问 TIME.date 这个属性上有没有建立索引？如果建立了索引，可以考虑将第一个 optional match 做下改写，通过两边向中间拓展的方式来节省部分探索时的内存开销，因为现在 nebula 还不支持 CBO 的优化器，其中一些出度比较大的点类型还没有做分析，目前还需要依赖手工做些调优。比如：

match (m:`USER`) where id(m) in ["1510615318"]  
optional match (m)-[r1:CALL_TO]-(x:MOBILE),
               (t1:`TIME`)-[:APPLY_ON]-(a1:APPL)<-[:APPLY_FOR]-(x) 
where r1.first_callmark_on<=20220102 and t1.`TIME`.`date` < '2022-01-02'
with m,collect(distinct x) as col_appl_1st_v4 
unwind case when size(col_appl_1st_v4) == 0 then [null] else col_appl_1st_v4 end as x 
optional match (x)-[r2:CALL_TO]-(n:`USER`) 
where r2.first_callmark_on<=20220102 and not (m==n) 
with m,col_appl_1st_v4,collect(distinct n) as col_user_2nd_v4
with m,col_appl_1st_v4,col_user_2nd_v4,filter(n in col_user_2nd_v4 where "MOBILE" in labels(n)) as col_mobile_2nd_v4
return m

dillon.wang · 2022 年12 月 20 日 03:13

没有创建索引

dillon.wang · 2022 年12 月 20 日 03:14

顺便请教下
nebula-cypher

match (m:`USER`) where id(m) in ["1510615318"]  
optional match (m)-[r1:CALL_TO]-(x:MOBILE)-[:APPLY_FOR]->(a1:APPL)-[:APPLY_ON]-(t1:`TIME`) 
where r1.first_callmark_on<=20220102 and t1.`TIME`.`date` < '2022-01-02'
with m,collect(distinct x) as col_appl_1st_v4 
unwind case when size(col_appl_1st_v4) == 0 then [null] else col_appl_1st_v4 end as x 
match (x)-[r2:CALL_TO]-(n:`USER`) 
where r2.first_callmark_on<=20220102 and id(n)<>'1510615318'
with m,col_appl_1st_v4,collect(distinct n) as col_user_2nd_v4
with m,col_appl_1st_v4,col_user_2nd_v4,filter(n in col_user_2nd_v4 
WHERE "MOBILE" in labels(n)) as col_mobile_2nd_v4
return size(col_appl_1st_v4) as n_appl_1st_v4,size(col_user_2nd_v4) as n_user_2nd_v4

这个cypher这个where这里应该怎么写呢 WHERE “MOBILE” in labels(n)) as col_mobile_2nd_v4
mobile是标签

dillon.wang · 2022 年12 月 20 日 03:20

nebula-3.3.0
Log file created at: 2022/12/20 11:00:14
Running on machine: VM-2-3-centos
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
I20221220 11:00:14.478646 30350 StorageDaemon.cpp:132] localhost = "ngraph01":9779
I20221220 11:00:14.480192 30350 StorageDaemon.cpp:147] data path= /data1/nebula/data
I20221220 11:00:14.490650 30350 MetaClient.cpp:80] Create meta client to "ngraph02":9559
I20221220 11:00:14.490674 30350 MetaClient.cpp:81] root path: /usr/local/nebula, data path size: 1
I20221220 11:00:14.491171 30350 FileBasedClusterIdMan.cpp:53] Get clusterId: 4297727418023546535
I20221220 11:00:14.501927 30392 ThriftClientManager-inl.h:67] resolve "ngraph02":9559 as 
I20221220 11:00:15.510512 30392 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.512212 30399 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.513120 30400 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.514724 30401 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.516227 30402 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.517032 30403 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.517848 30404 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.519878 30405 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.520715 30406 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.521847 30407 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.523051 30408 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.538698 30409 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.539547 30410 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.540432 30411 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.541421 30412 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.542029 30413 ThriftClientManager-inl.h:67] resolve "ngraph03":9559 as 
I20221220 11:00:15.547791 30350 MetaClient.cpp:3108] Load leader of "ngraph01":9779 in 0 space
I20221220 11:00:15.547806 30350 MetaClient.cpp:3108] Load leader of "ngraph02":9779 in 0 space
I20221220 11:00:15.547811 30350 MetaClient.cpp:3108] Load leader of "ngraph03":9779 in 3 space
I20221220 11:00:15.547816 30350 MetaClient.cpp:3114] Load leader ok
I20221220 11:00:15.549381 30350 MetaClient.cpp:162] Register time task for heartbeat!
I20221220 11:00:15.549412 30350 StorageServer.cpp:219] Init schema manager
I20221220 11:00:15.549418 30350 StorageServer.cpp:222] Init index manager
I20221220 11:00:15.549423 30350 StorageServer.cpp:225] Init kvstore
I20221220 11:00:15.549448 30350 NebulaStore.cpp:51] Start the raft service...
I20221220 11:00:15.550112 30350 NebulaSnapshotManager.cpp:25] Send snapshot is rate limited to 10485760 for each part by default
I20221220 11:00:15.565250 30350 RaftexService.cpp:46] Start raft service on 9780
I20221220 11:00:15.565316 30350 NebulaStore.cpp:85] Scan the local path, and init the spaces_
I20221220 11:00:15.565482 30350 NebulaStore.cpp:92] Scan path "/data1/nebula/data/nebula/0"
I20221220 11:00:15.565501 30350 NebulaStore.cpp:92] Scan path "/data1/nebula/data/nebula/201"
I20221220 11:00:15.565789 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_bytes_for_level_base=268435456
I20221220 11:00:15.565806 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_write_buffer_number=4
I20221220 11:00:15.565810 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option write_buffer_size=67108864
I20221220 11:00:15.566022 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option block_size=8192
I20221220 11:00:15.578025 30421 EventListener.h:21] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I20221220 11:00:15.578109 30421 CompactionFilter.h:82] Do full/manual compaction!
I20221220 11:00:15.578330 30350 RocksEngine.cpp:97] open rocksdb on /data1/nebula/data/nebula/201/data
I20221220 11:00:15.578428 30350 NebulaStore.cpp:196] Load space 201 from disk
I20221220 11:00:15.578437 30350 NebulaStore.cpp:205] Need to open 10 parts of space 201
I20221220 11:00:15.579834 30421 EventListener.h:35] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I20221220 11:00:15.580260 30415 NebulaStore.cpp:228] Load part 201, 1 from disk
I20221220 11:00:15.580287 30417 NebulaStore.cpp:228] Load part 201, 3 from disk
I20221220 11:00:15.580466 30416 NebulaStore.cpp:228] Load part 201, 2 from disk
I20221220 11:00:15.730691 30415 NebulaStore.cpp:228] Load part 201, 5 from disk
I20221220 11:00:15.731730 30418 NebulaStore.cpp:228] Load part 201, 4 from disk
I20221220 11:00:15.760711 30417 NebulaStore.cpp:228] Load part 201, 7 from disk
I20221220 11:00:15.774222 30416 NebulaStore.cpp:228] Load part 201, 6 from disk
I20221220 11:00:15.880666 30418 NebulaStore.cpp:228] Load part 201, 8 from disk
I20221220 11:00:15.909631 30415 NebulaStore.cpp:228] Load part 201, 9 from disk
I20221220 11:00:15.948480 30416 NebulaStore.cpp:228] Load part 201, 10 from disk
I20221220 11:00:15.948522 30350 NebulaStore.cpp:262] Load space 201 complete
I20221220 11:00:15.948545 30350 NebulaStore.cpp:92] Scan path "/data1/nebula/data/nebula/20"
I20221220 11:00:15.948618 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_bytes_for_level_base=268435456
I20221220 11:00:15.948626 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_write_buffer_number=4
I20221220 11:00:15.948628 30392 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as "10.3.2.10":9780
I20221220 11:00:15.948629 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option write_buffer_size=67108864
I20221220 11:00:15.948766 30392 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as "10.3.2.17":9780
I20221220 11:00:15.948778 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option block_size=8192
I20221220 11:00:15.969300 30421 EventListener.h:21] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I20221220 11:00:15.969345 30421 CompactionFilter.h:82] Do full/manual compaction!
I20221220 11:00:15.969563 30350 RocksEngine.cpp:97] open rocksdb on /data1/nebula/data/nebula/20/data
I20221220 11:00:15.969822 30350 NebulaStore.cpp:196] Load space 20 from disk
I20221220 11:00:15.969831 30350 NebulaStore.cpp:205] Need to open 60 parts of space 20
I20221220 11:00:15.971231 30421 EventListener.h:35] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I20221220 11:00:15.971379 30418 NebulaStore.cpp:228] Load part 20, 2 from disk
I20221220 11:00:15.971407 30417 NebulaStore.cpp:228] Load part 20, 1 from disk
I20221220 11:00:15.972760 30417 NebulaStore.cpp:228] Load part 20, 5 from disk
I20221220 11:00:15.973291 30418 NebulaStore.cpp:228] Load part 20, 6 from disk
I20221220 11:00:15.974112 30417 NebulaStore.cpp:228] Load part 20, 9 from disk
I20221220 11:00:15.974668 30418 NebulaStore.cpp:228] Load part 20, 10 from disk
I20221220 11:00:15.975510 30417 NebulaStore.cpp:228] Load part 20, 13 from disk
I20221220 11:00:15.976521 30418 NebulaStore.cpp:228] Load part 20, 14 from disk
I20221220 11:00:15.978133 30418 NebulaStore.cpp:228] Load part 20, 18 from disk
I20221220 11:00:16.026369 30415 NebulaStore.cpp:228] Load part 20, 3 from disk
I20221220 11:00:16.027838 30415 NebulaStore.cpp:228] Load part 20, 7 from disk
I20221220 11:00:16.029145 30415 NebulaStore.cpp:228] Load part 20, 11 from disk
I20221220 11:00:16.128289 30418 NebulaStore.cpp:228] Load part 20, 22 from disk
I20221220 11:00:16.129981 30418 NebulaStore.cpp:228] Load part 20, 26 from disk
I20221220 11:00:16.131597 30418 NebulaStore.cpp:228] Load part 20, 30 from disk
I20221220 11:00:16.133148 30418 NebulaStore.cpp:228] Load part 20, 34 from disk
I20221220 11:00:16.158293 30417 NebulaStore.cpp:228] Load part 20, 17 from disk
I20221220 11:00:16.174166 30415 NebulaStore.cpp:228] Load part 20, 15 from disk
I20221220 11:00:16.310786 30418 NebulaStore.cpp:228] Load part 20, 38 from disk
I20221220 11:00:16.332096 30417 NebulaStore.cpp:228] Load part 20, 21 from disk
I20221220 11:00:16.346213 30415 NebulaStore.cpp:228] Load part 20, 19 from disk
I20221220 11:00:16.347852 30415 NebulaStore.cpp:228] Load part 20, 23 from disk
I20221220 11:00:16.349437 30415 NebulaStore.cpp:228] Load part 20, 27 from disk
I20221220 11:00:16.351045 30415 NebulaStore.cpp:228] Load part 20, 31 from disk
I20221220 11:00:16.352807 30415 NebulaStore.cpp:228] Load part 20, 35 from disk
I20221220 11:00:16.354445 30415 NebulaStore.cpp:228] Load part 20, 39 from disk
I20221220 11:00:16.356012 30415 NebulaStore.cpp:228] Load part 20, 43 from disk
I20221220 11:00:16.357339 30415 NebulaStore.cpp:228] Load part 20, 47 from disk
I20221220 11:00:16.464453 30416 NebulaStore.cpp:228] Load part 20, 4 from disk
I20221220 11:00:16.466357 30416 NebulaStore.cpp:228] Load part 20, 8 from disk
I20221220 11:00:16.467687 30416 NebulaStore.cpp:228] Load part 20, 12 from disk
I20221220 11:00:16.493134 30418 NebulaStore.cpp:228] Load part 20, 42 from disk
I20221220 11:00:16.494768 30418 NebulaStore.cpp:228] Load part 20, 46 from disk
I20221220 11:00:16.507010 30417 NebulaStore.cpp:228] Load part 20, 25 from disk
I20221220 11:00:16.507834 30415 NebulaStore.cpp:228] Load part 20, 51 from disk
I20221220 11:00:16.508581 30417 NebulaStore.cpp:228] Load part 20, 29 from disk
I20221220 11:00:16.509903 30417 NebulaStore.cpp:228] Load part 20, 33 from disk
I20221220 11:00:16.511435 30417 NebulaStore.cpp:228] Load part 20, 37 from disk
I20221220 11:00:16.512959 30417 NebulaStore.cpp:228] Load part 20, 41 from disk
I20221220 11:00:16.514483 30417 NebulaStore.cpp:228] Load part 20, 45 from disk
I20221220 11:00:16.615429 30416 NebulaStore.cpp:228] Load part 20, 16 from disk
I20221220 11:00:16.659946 30417 NebulaStore.cpp:228] Load part 20, 49 from disk
I20221220 11:00:16.677901 30418 NebulaStore.cpp:228] Load part 20, 50 from disk
I20221220 11:00:16.684715 30415 NebulaStore.cpp:228] Load part 20, 55 from disk
I20221220 11:00:16.790401 30416 NebulaStore.cpp:228] Load part 20, 20 from disk
I20221220 11:00:16.792038 30416 NebulaStore.cpp:228] Load part 20, 24 from disk
I20221220 11:00:16.793618 30416 NebulaStore.cpp:228] Load part 20, 28 from disk
I20221220 11:00:16.795178 30416 NebulaStore.cpp:228] Load part 20, 32 from disk
I20221220 11:00:16.796594 30416 NebulaStore.cpp:228] Load part 20, 36 from disk
I20221220 11:00:16.806174 30417 NebulaStore.cpp:228] Load part 20, 53 from disk
I20221220 11:00:16.830202 30418 NebulaStore.cpp:228] Load part 20, 54 from disk
I20221220 11:00:16.858911 30415 NebulaStore.cpp:228] Load part 20, 59 from disk
I20221220 11:00:16.859035 30399 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as "10.3.2.10":9780
I20221220 11:00:16.859179 30399 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as "10.3.2.17":9780
I20221220 11:00:16.859954 30400 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as "10.3.2.10":9780
I20221220 11:00:16.860071 30400 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as "10.3.2.17":9780
I20221220 11:00:16.860616 30401 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as "10.3.2.10":9780
I20221220 11:00:16.874179 30401 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as "10.3.2.17":9780
I20221220 11:00:16.875370 30402 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as "10.3.2.10":9780
I20221220 11:00:16.875526 30402 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as "10.3.2.17":9780
I20221220 11:00:16.969580 30416 NebulaStore.cpp:228] Load part 20, 40 from disk
I20221220 11:00:16.971280 30416 NebulaStore.cpp:228] Load part 20, 44 from disk
I20221220 11:00:16.981983 30418 NebulaStore.cpp:228] Load part 20, 58 from disk
I20221220 11:00:17.041899 30417 NebulaStore.cpp:228] Load part 20, 57 from disk
I20221220 11:00:17.118444 30403 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.118571 30403 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.119195 30404 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.119349 30404 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.119835 30405 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.119925 30405 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.150358 30416 NebulaStore.cpp:228] Load part 20, 48 from disk
I20221220 11:00:17.163938 30406 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.164043 30406 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.164676 30407 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.164907 30407 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.298995 30408 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.299120 30408 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.299746 30409 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.299835 30409 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.331781 30416 NebulaStore.cpp:228] Load part 20, 52 from disk
I20221220 11:00:17.508608 30416 NebulaStore.cpp:228] Load part 20, 56 from disk
I20221220 11:00:17.686239 30416 NebulaStore.cpp:228] Load part 20, 60 from disk
I20221220 11:00:17.686290 30350 NebulaStore.cpp:262] Load space 20 complete
I20221220 11:00:17.686326 30350 NebulaStore.cpp:92] Scan path "/data1/nebula/data/nebula/1"
I20221220 11:00:17.686367 30410 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as "10.3.2.10":9780
I20221220 11:00:17.686393 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_bytes_for_level_base=268435456
I20221220 11:00:17.686399 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_write_buffer_number=4
I20221220 11:00:17.686404 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option write_buffer_size=67108864
I20221220 11:00:17.686492 30410 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.686517 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option block_size=8192
I20221220 11:00:17.688228 30411 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.688351 30411 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.817745 30412 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.817881 30412 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:17.818478 30413 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:17.818600 30413 ThriftClientManager-inl.h:67] resolve "ngraph03":9780 as 
I20221220 11:00:26.407910 30414 MetaClient.cpp:3108] Load leader of "ngraph01":9779 in 0 space
I20221220 11:00:26.413399 30414 MetaClient.cpp:3108] Load leader of "ngraph02":9779 in 3 space
I20221220 11:00:26.413503 30414 MetaClient.cpp:3108] Load leader of "ngraph03":9779 in 3 space
I20221220 11:00:26.413514 30414 MetaClient.cpp:3114] Load leader ok
I20221220 11:00:29.057096 30421 EventListener.h:21] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I20221220 11:00:29.057176 30421 CompactionFilter.h:88] Do custom minor compaction!
I20221220 11:00:29.078500 30421 EventListener.h:35] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I20221220 11:00:29.090736 30350 RocksEngine.cpp:97] open rocksdb on /data1/nebula/data/nebula/1/data
I20221220 11:00:29.090898 30350 NebulaStore.cpp:196] Load space 1 from disk
I20221220 11:00:29.090907 30350 NebulaStore.cpp:205] Need to open 60 parts of space 1
I20221220 11:00:29.093444 30415 NebulaStore.cpp:228] Load part 1, 2 from disk
I20221220 11:00:29.093822 30418 NebulaStore.cpp:228] Load part 1, 1 from disk
I20221220 11:00:29.093879 30417 NebulaStore.cpp:228] Load part 1, 4 from disk
I20221220 11:00:29.094069 30416 NebulaStore.cpp:228] Load part 1, 3 from disk
I20221220 11:00:29.095715 30415 NebulaStore.cpp:228] Load part 1, 6 from disk
I20221220 11:00:29.096534 30417 NebulaStore.cpp:228] Load part 1, 8 from disk
I20221220 11:00:29.096630 30418 NebulaStore.cpp:228] Load part 1, 5 from disk
I20221220 11:00:29.096745 30416 NebulaStore.cpp:228] Load part 1, 7 from disk
I20221220 11:00:29.098093 30415 NebulaStore.cpp:228] Load part 1, 10 from disk
I20221220 11:00:29.098788 30418 NebulaStore.cpp:228] Load part 1, 9 from disk
I20221220 11:00:29.099390 30416 NebulaStore.cpp:228] Load part 1, 11 from disk
I20221220 11:00:29.099437 30417 NebulaStore.cpp:228] Load part 1, 12 from disk
I20221220 11:00:29.100517 30415 NebulaStore.cpp:228] Load part 1, 14 from disk
I20221220 11:00:29.101078 30418 NebulaStore.cpp:228] Load part 1, 13 from disk
I20221220 11:00:29.101727 30416 NebulaStore.cpp:228] Load part 1, 15 from disk
I20221220 11:00:29.102006 30417 NebulaStore.cpp:228] Load part 1, 16 from disk
I20221220 11:00:29.102967 30415 NebulaStore.cpp:228] Load part 1, 18 from disk
I20221220 11:00:29.103776 30418 NebulaStore.cpp:228] Load part 1, 17 from disk
I20221220 11:00:29.103894 30416 NebulaStore.cpp:228] Load part 1, 19 from disk
I20221220 11:00:29.104703 30417 NebulaStore.cpp:228] Load part 1, 20 from disk
I20221220 11:00:29.105480 30415 NebulaStore.cpp:228] Load part 1, 22 from disk
I20221220 11:00:29.106228 30418 NebulaStore.cpp:228] Load part 1, 21 from disk
I20221220 11:00:29.107548 30417 NebulaStore.cpp:228] Load part 1, 24 from disk
I20221220 11:00:29.254882 30415 NebulaStore.cpp:228] Load part 1, 26 from disk
I20221220 11:00:29.255744 30417 NebulaStore.cpp:228] Load part 1, 28 from disk
I20221220 11:00:29.306653 30416 NebulaStore.cpp:228] Load part 1, 23 from disk
I20221220 11:00:29.335857 30418 NebulaStore.cpp:228] Load part 1, 25 from disk
I20221220 11:00:29.433753 30415 NebulaStore.cpp:228] Load part 1, 30 from disk
I20221220 11:00:29.435535 30417 NebulaStore.cpp:228] Load part 1, 32 from disk
I20221220 11:00:29.479904 30416 NebulaStore.cpp:228] Load part 1, 27 from disk
I20221220 11:00:29.516345 30418 NebulaStore.cpp:228] Load part 1, 29 from disk
I20221220 11:00:29.581388 30415 NebulaStore.cpp:228] Load part 1, 34 from disk
I20221220 11:00:29.608474 30417 NebulaStore.cpp:228] Load part 1, 36 from disk
I20221220 11:00:29.658775 30416 NebulaStore.cpp:228] Load part 1, 31 from disk
I20221220 11:00:29.664760 30418 NebulaStore.cpp:228] Load part 1, 33 from disk
I20221220 11:00:29.730304 30415 NebulaStore.cpp:228] Load part 1, 38 from disk
I20221220 11:00:29.781327 30417 NebulaStore.cpp:228] Load part 1, 40 from disk
I20221220 11:00:29.840297 30416 NebulaStore.cpp:228] Load part 1, 35 from disk
I20221220 11:00:29.874914 30418 NebulaStore.cpp:228] Load part 1, 37 from disk
I20221220 11:00:29.909485 30415 NebulaStore.cpp:228] Load part 1, 42 from disk
I20221220 11:00:29.957742 30417 NebulaStore.cpp:228] Load part 1, 44 from disk
I20221220 11:00:30.018216 30416 NebulaStore.cpp:228] Load part 1, 39 from disk
I20221220 11:00:30.082674 30415 NebulaStore.cpp:228] Load part 1, 46 from disk
I20221220 11:00:30.098131 30418 NebulaStore.cpp:228] Load part 1, 41 from disk
I20221220 11:00:30.109369 30417 NebulaStore.cpp:228] Load part 1, 48 from disk
I20221220 11:00:30.169145 30416 NebulaStore.cpp:228] Load part 1, 43 from disk
I20221220 11:00:30.227772 30415 NebulaStore.cpp:228] Load part 1, 50 from disk
I20221220 11:00:30.257359 30417 NebulaStore.cpp:228] Load part 1, 52 from disk
I20221220 11:00:30.320387 30416 NebulaStore.cpp:228] Load part 1, 47 from disk
I20221220 11:00:30.324051 30418 NebulaStore.cpp:228] Load part 1, 45 from disk
I20221220 11:00:30.326318 30418 NebulaStore.cpp:228] Load part 1, 49 from disk
I20221220 11:00:30.372897 30415 NebulaStore.cpp:228] Load part 1, 54 from disk
I20221220 11:00:30.405725 30417 NebulaStore.cpp:228] Load part 1, 56 from disk
I20221220 11:00:30.499435 30418 NebulaStore.cpp:228] Load part 1, 53 from disk
I20221220 11:00:30.523283 30416 NebulaStore.cpp:228] Load part 1, 51 from disk
I20221220 11:00:30.543773 30415 NebulaStore.cpp:228] Load part 1, 58 from disk
I20221220 11:00:30.580523 30417 NebulaStore.cpp:228] Load part 1, 60 from disk
I20221220 11:00:30.647224 30418 NebulaStore.cpp:228] Load part 1, 57 from disk
I20221220 11:00:30.670369 30416 NebulaStore.cpp:228] Load part 1, 55 from disk
I20221220 11:00:30.865176 30416 NebulaStore.cpp:228] Load part 1, 59 from disk
I20221220 11:00:30.865221 30350 NebulaStore.cpp:262] Load space 1 complete
I20221220 11:00:30.869545 30350 NebulaStore.cpp:271] Init data from partManager for "ngraph01":9779
I20221220 11:00:30.869613 30350 NebulaStore.cpp:369] Data space 20 has existed!
I20221220 11:00:30.874765 30350 NebulaStore.cpp:430] [Space: 20, Part: 1] has existed!
I20221220 11:00:30.874783 30350 NebulaStore.cpp:430] [Space: 20, Part: 2] has existed!
I20221220 11:00:30.874788 30350 NebulaStore.cpp:430] [Space: 20, Part: 3] has existed!
I20221220 11:00:30.874794 30350 NebulaStore.cpp:430] [Space: 20, Part: 4] has existed!
I20221220 11:00:30.874799 30350 NebulaStore.cpp:430] [Space: 20, Part: 5] has existed!
I20221220 11:00:30.874804 30350 NebulaStore.cpp:430] [Space: 20, Part: 6] has existed!
I20221220 11:00:30.874809 30350 NebulaStore.cpp:430] [Space: 20, Part: 7] has existed!
I20221220 11:00:30.874814 30350 NebulaStore.cpp:430] [Space: 20, Part: 8] has existed!
I20221220 11:00:30.874819 30350 NebulaStore.cpp:430] [Space: 20, Part: 9] has existed!
I20221220 11:00:30.874823 30350 NebulaStore.cpp:430] [Space: 20, Part: 10] has existed!
I20221220 11:00:30.874828 30350 NebulaStore.cpp:430] [Space: 20, Part: 11] has existed!
I20221220 11:00:30.874841 30350 NebulaStore.cpp:430] [Space: 20, Part: 12] has existed!
I20221220 11:00:30.874846 30350 NebulaStore.cpp:430] [Space: 20, Part: 13] has existed!
I20221220 11:00:30.874850 30350 NebulaStore.cpp:430] [Space: 20, Part: 14] has existed!
I20221220 11:00:30.874855 30350 NebulaStore.cpp:430] [Space: 20, Part: 15] has existed!
I20221220 11:00:30.874861 30350 NebulaStore.cpp:430] [Space: 20, Part: 16] has existed!
I20221220 11:00:30.874866 30350 NebulaStore.cpp:430] [Space: 20, Part: 17] has existed!
I20221220 11:00:30.874871 30350 NebulaStore.cpp:430] [Space: 20, Part: 18] has existed!
I20221220 11:00:30.874876 30350 NebulaStore.cpp:430] [Space: 20, Part: 19] has existed!
I20221220 11:00:30.874881 30350 NebulaStore.cpp:430] [Space: 20, Part: 20] has existed!
I20221220 11:00:30.874884 30350 NebulaStore.cpp:430] [Space: 20, Part: 21] has existed!
I20221220 11:00:30.874889 30350 NebulaStore.cpp:430] [Space: 20, Part: 22] has existed!
I20221220 11:00:30.874894 30350 NebulaStore.cpp:430] [Space: 20, Part: 23] has existed!
I20221220 11:00:30.874899 30350 NebulaStore.cpp:430] [Space: 20, Part: 24] has existed!
I20221220 11:00:30.874904 30350 NebulaStore.cpp:430] [Space: 20, Part: 25] has existed!
I20221220 11:00:30.874908 30350 NebulaStore.cpp:430] [Space: 20, Part: 26] has existed!
I20221220 11:00:30.874913 30350 NebulaStore.cpp:430] [Space: 20, Part: 27] has existed!
I20221220 11:00:30.874918 30350 NebulaStore.cpp:430] [Space: 20, Part: 28] has existed!
I20221220 11:00:30.874922 30350 NebulaStore.cpp:430] [Space: 20, Part: 29] has existed!
I20221220 11:00:30.874927 30350 NebulaStore.cpp:430] [Space: 20, Part: 30] has existed!
I20221220 11:00:30.874933 30350 NebulaStore.cpp:430] [Space: 20, Part: 31] has existed!
I20221220 11:00:30.874943 30350 NebulaStore.cpp:430] [Space: 20, Part: 32] has existed!
I20221220 11:00:30.874948 30350 NebulaStore.cpp:430] [Space: 20, Part: 33] has existed!
I20221220 11:00:30.874953 30350 NebulaStore.cpp:430] [Space: 20, Part: 34] has existed!
I20221220 11:00:30.874958 30350 NebulaStore.cpp:430] [Space: 20, Part: 35] has existed!
I20221220 11:00:30.874962 30350 NebulaStore.cpp:430] [Space: 20, Part: 36] has existed!
I20221220 11:00:30.874967 30350 NebulaStore.cpp:430] [Space: 20, Part: 37] has existed!
I20221220 11:00:30.874972 30350 NebulaStore.cpp:430] [Space: 20, Part: 38] has existed!
I20221220 11:00:30.874977 30350 NebulaStore.cpp:430] [Space: 20, Part: 39] has existed!
I20221220 11:00:30.874982 30350 NebulaStore.cpp:430] [Space: 20, Part: 40] has existed!
I20221220 11:00:30.874986 30350 NebulaStore.cpp:430] [Space: 20, Part: 41] has existed!
I20221220 11:00:30.874991 30350 NebulaStore.cpp:430] [Space: 20, Part: 42] has existed!
I20221220 11:00:30.874996 30350 NebulaStore.cpp:430] [Space: 20, Part: 43] has existed!
I20221220 11:00:30.875001 30350 NebulaStore.cpp:430] [Space: 20, Part: 44] has existed!
I20221220 11:00:30.875005 30350 NebulaStore.cpp:430] [Space: 20, Part: 45] has existed!
I20221220 11:00:30.875010 30350 NebulaStore.cpp:430] [Space: 20, Part: 46] has existed!
I20221220 11:00:30.875015 30350 NebulaStore.cpp:430] [Space: 20, Part: 47] has existed!
I20221220 11:00:30.875020 30350 NebulaStore.cpp:430] [Space: 20, Part: 48] has existed!
I20221220 11:00:30.875025 30350 NebulaStore.cpp:430] [Space: 20, Part: 49] has existed!
I20221220 11:00:30.875030 30350 NebulaStore.cpp:430] [Space: 20, Part: 50] has existed!
I20221220 11:00:30.875033 30350 NebulaStore.cpp:430] [Space: 20, Part: 51] has existed!
I20221220 11:00:30.875038 30350 NebulaStore.cpp:430] [Space: 20, Part: 52] has existed!
I20221220 11:00:30.875043 30350 NebulaStore.cpp:430] [Space: 20, Part: 53] has existed!
I20221220 11:00:30.875048 30350 NebulaStore.cpp:430] [Space: 20, Part: 54] has existed!
I20221220 11:00:30.875062 30350 NebulaStore.cpp:430] [Space: 20, Part: 55] has existed!
I20221220 11:00:30.875068 30350 NebulaStore.cpp:430] [Space: 20, Part: 56] has existed!
I20221220 11:00:30.875072 30350 NebulaStore.cpp:430] [Space: 20, Part: 57] has existed!
I20221220 11:00:30.875077 30350 NebulaStore.cpp:430] [Space: 20, Part: 58] has existed!
I20221220 11:00:30.875082 30350 NebulaStore.cpp:430] [Space: 20, Part: 59] has existed!
I20221220 11:00:30.875087 30350 NebulaStore.cpp:430] [Space: 20, Part: 60] has existed!
I20221220 11:00:30.875092 30350 NebulaStore.cpp:369] Data space 1 has existed!
I20221220 11:00:30.875102 30350 NebulaStore.cpp:430] [Space: 1, Part: 1] has existed!
I20221220 11:00:30.875108 30350 NebulaStore.cpp:430] [Space: 1, Part: 2] has existed!
I20221220 11:00:30.875113 30350 NebulaStore.cpp:430] [Space: 1, Part: 3] has existed!
I20221220 11:00:30.875116 30350 NebulaStore.cpp:430] [Space: 1, Part: 4] has existed!
I20221220 11:00:30.875121 30350 NebulaStore.cpp:430] [Space: 1, Part: 5] has existed!
I20221220 11:00:30.875126 30350 NebulaStore.cpp:430] [Space: 1, Part: 6] has existed!
I20221220 11:00:30.875130 30350 NebulaStore.cpp:430] [Space: 1, Part: 7] has existed!
I20221220 11:00:30.875135 30350 NebulaStore.cpp:430] [Space: 1, Part: 8] has existed!
I20221220 11:00:30.875140 30350 NebulaStore.cpp:430] [Space: 1, Part: 9] has existed!
I20221220 11:00:30.875145 30350 NebulaStore.cpp:430] [Space: 1, Part: 10] has existed!
I20221220 11:00:30.875149 30350 NebulaStore.cpp:430] [Space: 1, Part: 11] has existed!
I20221220 11:00:30.875154 30350 NebulaStore.cpp:430] [Space: 1, Part: 12] has existed!
I20221220 11:00:30.875159 30350 NebulaStore.cpp:430] [Space: 1, Part: 13] has existed!
I20221220 11:00:30.875164 30350 NebulaStore.cpp:430] [Space: 1, Part: 14] has existed!
I20221220 11:00:30.875169 30350 NebulaStore.cpp:430] [Space: 1, Part: 15] has existed!
I20221220 11:00:30.875173 30350 NebulaStore.cpp:430] [Space: 1, Part: 16] has existed!
I20221220 11:00:30.875178 30350 NebulaStore.cpp:430] [Space: 1, Part: 17] has existed!
I20221220 11:00:30.875186 30350 NebulaStore.cpp:430] [Space: 1, Part: 18] has existed!
I20221220 11:00:30.875191 30350 NebulaStore.cpp:430] [Space: 1, Part: 19] has existed!
I20221220 11:00:30.875196 30350 NebulaStore.cpp:430] [Space: 1, Part: 20] has existed!
I20221220 11:00:30.875200 30350 NebulaStore.cpp:430] [Space: 1, Part: 21] has existed!
I20221220 11:00:30.875205 30350 NebulaStore.cpp:430] [Space: 1, Part: 22] has existed!
I20221220 11:00:30.875211 30350 NebulaStore.cpp:430] [Space: 1, Part: 23] has existed!
I20221220 11:00:30.875214 30350 NebulaStore.cpp:430] [Space: 1, Part: 24] has existed!
I20221220 11:00:30.875219 30350 NebulaStore.cpp:430] [Space: 1, Part: 25] has existed!
I20221220 11:00:30.875224 30350 NebulaStore.cpp:430] [Space: 1, Part: 26] has existed!
I20221220 11:00:30.875228 30350 NebulaStore.cpp:430] [Space: 1, Part: 27] has existed!
I20221220 11:00:31.036170 30350 NebulaStore.cpp:430] [Space: 1, Part: 28] has existed!
I20221220 11:00:31.036203 30350 NebulaStore.cpp:430] [Space: 1, Part: 29] has existed!
I20221220 11:00:31.036213 30350 NebulaStore.cpp:430] [Space: 1, Part: 30] has existed!
I20221220 11:00:31.137226 30350 NebulaStore.cpp:430] [Space: 1, Part: 31] has existed!
I20221220 11:00:31.137254 30350 NebulaStore.cpp:430] [Space: 1, Part: 32] has existed!
I20221220 11:00:31.137260 30350 NebulaStore.cpp:430] [Space: 1, Part: 33] has existed!
I20221220 11:00:31.137265 30350 NebulaStore.cpp:430] [Space: 1, Part: 34] has existed!
I20221220 11:00:31.137270 30350 NebulaStore.cpp:430] [Space: 1, Part: 35] has existed!
I20221220 11:00:31.197703 30350 NebulaStore.cpp:430] [Space: 1, Part: 36] has existed!
I20221220 11:00:31.273610 30392 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 as 
I20221220 11:00:31.336794 30350 NebulaStore.cpp:430] [Space: 1, Part: 37] has existed!
I20221220 11:00:31.336817 30350 NebulaStore.cpp:430] [Space: 1, Part: 38] has existed!
I20221220 11:00:31.336822 30350 NebulaStore.cpp:430] [Space: 1, Part: 39] has existed!
I20221220 11:00:31.336828 30350 NebulaStore.cpp:430] [Space: 1, Part: 40] has existed!
I20221220 11:00:31.336833 30350 NebulaStore.cpp:430] [Space: 1, Part: 41] has existed!
I20221220 11:00:31.336838 30350 NebulaStore.cpp:430] [Space: 1, Part: 42] has existed!
I20221220 11:00:31.336843 30350 NebulaStore.cpp:430] [Space: 1, Part: 43] has existed!
I20221220 11:00:31.336848 30350 NebulaStore.cpp:430] [Space: 1, Part: 44] has existed!
I20221220 11:00:31.336854 30350 NebulaStore.cpp:430] [Space: 1, Part: 45] has existed!
I20221220 11:00:31.336858 30350 NebulaStore.cpp:430] [Space: 1, Part: 46] has existed!
I20221220 11:00:31.336863 30350 NebulaStore.cpp:430] [Space: 1, Part: 47] has existed!
I20221220 11:00:31.336869 30350 NebulaStore.cpp:430] [Space: 1, Part: 48] has existed!
I20221220 11:00:31.336874 30350 NebulaStore.cpp:430] [Space: 1, Part: 49] has existed!
I20221220 11:00:31.336879 30350 NebulaStore.cpp:430] [Space: 1, Part: 50] has existed!
I20221220 11:00:31.336884 30350 NebulaStore.cpp:430] [Space: 1, Part: 51] has existed!
I20221220 11:00:31.336889 30350 NebulaStore.cpp:430] [Space: 1, Part: 52] has existed!
I20221220 11:00:31.336894 30350 NebulaStore.cpp:430] [Space: 1, Part: 53] has existed!
I20221220 11:00:31.336899 30350 NebulaStore.cpp:430] [Space: 1, Part: 54] has existed!
I20221220 11:00:31.336905 30350 NebulaStore.cpp:430] [Space: 1, Part: 55] has existed!
I20221220 11:00:31.336908 30350 NebulaStore.cpp:430] [Space: 1, Part: 56] has existed!
I20221220 11:00:31.336913 30350 NebulaStore.cpp:430] [Space: 1, Part: 57] has existed!
I20221220 11:00:31.336918 30350 NebulaStore.cpp:430] [Space: 1, Part: 58] has existed!
I20221220 11:00:31.336923 30350 NebulaStore.cpp:430] [Space: 1, Part: 59] has existed!
I20221220 11:00:31.336928 30350 NebulaStore.cpp:430] [Space: 1, Part: 60] has existed!
I20221220 11:00:31.336932 30350 NebulaStore.cpp:369] Data space 201 has existed!
I20221220 11:00:31.336942 30350 NebulaStore.cpp:430] [Space: 201, Part: 1] has existed!
I20221220 11:00:31.336947 30350 NebulaStore.cpp:430] [Space: 201, Part: 2] has existed!
I20221220 11:00:31.336959 30350 NebulaStore.cpp:430] [Space: 201, Part: 3] has existed!
I20221220 11:00:31.336966 30350 NebulaStore.cpp:430] [Space: 201, Part: 4] has existed!
I20221220 11:00:31.336969 30350 NebulaStore.cpp:430] [Space: 201, Part: 5] has existed!
I20221220 11:00:31.336974 30350 NebulaStore.cpp:430] [Space: 201, Part: 6] has existed!
I20221220 11:00:31.336979 30350 NebulaStore.cpp:430] [Space: 201, Part: 7] has existed!
I20221220 11:00:31.336983 30350 NebulaStore.cpp:430] [Space: 201, Part: 8] has existed!
I20221220 11:00:31.336988 30350 NebulaStore.cpp:430] [Space: 201, Part: 9] has existed!
I20221220 11:00:31.336993 30350 NebulaStore.cpp:430] [Space: 201, Part: 10] has existed!
I20221220 11:00:31.337040 30350 NebulaStore.cpp:78] Register handler...
I20221220 11:00:31.337046 30350 StorageServer.cpp:228] Init LogMonitor
I20221220 11:00:31.339453 30350 StorageServer.cpp:96] Starting Storage HTTP Service
I20221220 11:00:31.340070 30350 StorageServer.cpp:100] Http Thread Pool started
I20221220 11:00:31.352988 30590 WebService.cpp:124] Web service started on HTTP[19779]
I20221220 11:00:31.353032 30350 TransactionManager.cpp:24] TransactionManager ctor()
I20221220 11:00:31.354763 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_bytes_for_level_base=268435456
I20221220 11:00:31.354779 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option max_write_buffer_number=4
I20221220 11:00:31.354784 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option write_buffer_size=67108864
I20221220 11:00:31.354899 30350 RocksEngineConfig.cpp:366] Emplace rocksdb option block_size=8192
I20221220 11:00:31.360499 30350 RocksEngine.cpp:97] open rocksdb on /data1/nebula/data/nebula/0/data
I20221220 11:00:31.360661 30350 AdminTaskManager.cpp:22] max concurrent subtasks: 10
I20221220 11:00:31.360813 30350 AdminTaskManager.cpp:40] exit AdminTaskManager::init()
I20221220 11:00:31.360831 30612 AdminTaskManager.cpp:227] waiting for incoming task
I20221220 11:00:36.437997 30414 MetaClient.cpp:3108] Load leader of "ngraph01":9779 in 0 space
I20221220 11:00:36.438042 30414 MetaClient.cpp:3108] Load leader of "ngraph02":9779 in 1 space
I20221220 11:00:36.438108 30414 MetaClient.cpp:3108] Load leader of "ngraph03":9779 in 3 space
I20221220 11:00:36.438114 30414 MetaClient.cpp:3114] Load leader ok
I20221220 11:00:46.461961 30414 MetaClient.cpp:3108] Load leader of "ngraph01":9779 in 0 space
I20221220 11:00:46.461982 30414 MetaClient.cpp:3108] Load leader of "ngraph02":9779 in 0 space
I20221220 11:00:46.462044 30414 MetaClient.cpp:3108] Load leader of "ngraph03":9779 in 3 space
I20221220 11:00:46.462047 30414 MetaClient.cpp:3114] Load leader ok
E20221220 11:01:04.037596 30385 Serializer.h:43] Thrift serialization is only defined for structs and unions, not containers thereof. Attemping to deserialize a value of type `nebula::HostAddr`.
I20221220 11:01:04.039644 30400 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.039652 30399 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.039726 30405 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.039644 30403 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.039731 30404 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.039644 30402 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.039839 30401 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.040202 30406 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.040217 30408 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.040228 30407 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.040251 30410 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.040268 30409 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:04.040258 30411 ThriftClientManager-inl.h:67] resolve "ngraph02":9780 
I20221220 11:01:16.499186 30414 MetaClient.cpp:3108] Load leader of "ngraph01":9779 in 3 space
I20221220 11:01:16.499225 30414 MetaClient.cpp:3108] Load leader of "ngraph02":9779 in 3 space
I20221220 11:01:16.499249 30414 MetaClient.cpp:3108] Load leader of "ngraph03":9779 in 3 space
I20221220 11:01:16.499253 30414 MetaClient.cpp:3114] Load leader ok

yee · 2022 年12 月 20 日 03:28

把 filter() 换成 list 表达式试试？

[n in col_user_2nd_v4 WHERE "MOBILE" in labels(n)] as col_mobile_2nd_v4

yee · 2022 年12 月 20 日 03:45

我把 query 做了些改写，你看看是否满足需求，理论上要比原来的写法好些：

match (m:`USER`)-[r1:CALL_TO]-(x:MOBILE),
      (x)-[:APPLY_FOR]->(:APPL)-[:APPLY_ON]-(t1:`TIME`),
      (x)-[r2:CALL_TO]-(n:`USER`) 
where id(m) in ["1510615318"] AND 
      r1.first_callmark_on<=20220102 AND
      t1.`TIME`.`date` < '2022-01-02' AND
      r2.first_callmark_on<=20220102 and 
      id(n)<>'1510615318'
with distinct id(x) as xid, 
              id(n) as nid,
              case when "MOBILE" in labels(n) then 1 else 0 end as mobile
return count(xid) as n_appl_1st_v4, 
       count(nid) as n_user_2nd_v4, 
       sum(mobile) as col_mobile_2nd_v4

yee · 2022 年12 月 20 日 03:48

关于 OOM 的调试再给些建议：

可以分段尝试一下 query 的部分片段 touch 到的数据量，如果中间涉及到的数据特别多，可以考虑手工做些裁剪；
不用属性的地方可以都通过 vid 来表示；

dillon.wang · 2022 年12 月 20 日 03:52

除了graphd 其他是没有水位配置吗

yee · 2022 年12 月 20 日 03:54

storage 侧的内存保护正在开发中，春节后的版本就可以支持

dillon.wang · 2022 年12 月 20 日 03:55

内存保护这个很重要，最起码集群是健康的，只是查询有问题，哈哈期待新版本

dillon.wang · 2022 年12 月 20 日 03:57

还是有问题，没看出来哪里错了
match (m:USER) where id(m) in [“1510615318”] optional match (m)-[r1:CALL_TO]-(x:MOBILE)-[:APPLY_FOR]->(a1:APPL)-[:APPLY_ON]-(t1:TIME) where r1.first_callmark_on<=20220102 and t1.TIME.date < ‘2022-01-02’ with m,collect(distinct x) as col_appl_1st_v4 unwind case when size(col_appl_1st_v4) == 0 then [null] else col_appl_1st_v4 end as x match (x)-[r2:CALL_TO]-(n:USER) where r2.first_callmark_on<=20220102 and id(n)<>‘1510615318’ with m,col_appl_1st_v4,collect(distinct n) as col_user_2nd_v4 with m,col_appl_1st_v4,col_user_2nd_v4, WHERE [n in col_user_2nd_v4 WHERE “MOBILE” in labels(n)] as col_mobile_2nd_v4 return size(col_appl_1st_v4) as n_appl_1st_v4,size(col_user_2nd_v4) as n_user_2nd_v4;

yee · 2022 年12 月 20 日 04:02

试试下面这样：

match (m:`USER`) where id(m) in ["1510615318"]  
optional match (m)-[r1:CALL_TO]-(x:MOBILE)-[:APPLY_FOR]->(a1:APPL)-[:APPLY_ON]-(t1:`TIME`) 
where r1.first_callmark_on<=20220102 and t1.`TIME`.`date` < '2022-01-02'
with m,collect(distinct x) as col_appl_1st_v4 
unwind case when size(col_appl_1st_v4) == 0 then [null] else col_appl_1st_v4 end as x 
match (x)-[r2:CALL_TO]-(n:`USER`) 
where r2.first_callmark_on<=20220102 and id(n)<>'1510615318'
with m,col_appl_1st_v4,collect(distinct n) as col_user_2nd_v4
with m,col_appl_1st_v4,col_user_2nd_v4, [uu in col_user_2nd_v4 WHERE "MOBILE" in labels(n)] as col_mobile_2nd_v4
return size(col_appl_1st_v4) as n_appl_1st_v4,size(col_user_2nd_v4) as n_user_2nd_v4

另外建议你看看我上面的那个改写

dillon.wang · 2022 年12 月 20 日 04:13

yee:

match (m:`USER`) where id(m) in ["1510615318"]  
optional match (m)-[r1:CALL_TO]-(x:MOBILE)-[:APPLY_FOR]->(a1:APPL)-[:APPLY_ON]-(t1:`TIME`) 
where r1.first_callmark_on<=20220102 and t1.`TIME`.`date` < '2022-01-02'
with m,collect(distinct x) as col_appl_1st_v4 
unwind case when size(col_appl_1st_v4) == 0 then [null] else col_appl_1st_v4 end as x 
match (x)-[r2:CALL_TO]-(n:`USER`) 
where r2.first_callmark_on<=20220102 and id(n)<>'1510615318'
with m,col_appl_1st_v4,collect(distinct n) as col_user_2nd_v4
with m,col_appl_1st_v4,col_user_2nd_v4, [n in col_user_2nd_v4 WHERE "MOBILE" in labels(n)] as col_mobile_2nd_v4
return size(col_appl_1st_v4) as n_appl_1st_v4,size(col_user_2nd_v4) as n_user_2nd_v4

嗯嗯 cypher没有问题，但是一查询就oom了
match (m:USER) where id(m) in [“1510615318”] optional match (m)-[r1:CALL_TO]-(x:MOBILE)-[:APPLY_FOR]->(a1:APPL)-[:APPLY_ON]-(t1:TIME) where r1.first_callmark_on<=20220102 and t1.TIME.date < ‘2022-01-02’ with m,collect(distinct x) as col_appl_1st_v4 unwind case when size(col_appl_1st_v4) == 0 then [null] else col_appl_1st_v4 end as x match (x)-[r2:CALL_TO]-(n:USER) where r2.first_callmark_on<=20220102 and id(n)<>‘1510615318’ with m,col_appl_1st_v4,collect(distinct n) as col_user_2nd_v4 with m,col_appl_1st_v4,col_user_2nd_v4, [n in col_user_2nd_v4 WHERE “MOBILE” in labels(n)] as col_mobile_2nd_v4 return size(col_appl_1st_v4) as n_appl_1st_v4,size(col_user_2nd_v4) as n_user_2nd_v4;

yee · 2022 年12 月 20 日 04:21

剩下的就需要针对性的调优了，比如你可以先试试前两个 match 会不会 OOM：

match (m:`USER`) where id(m) in ["1510615318"]  
optional match (m)-[r1:CALL_TO]-(x:MOBILE)-[:APPLY_FOR]->(a1:APPL)-[:APPLY_ON]-(t1:`TIME`) 
where r1.first_callmark_on<=20220102 and t1.`TIME`.`date` < '2022-01-02'
return count(x)

如果不会的话，再进一步的研究一下到底是哪里 touch 的数据量很多，同时也可以参考上面的改写做些优化。

dillon.wang · 2022 年12 月 20 日 05:16

秒出

yee · 2022 年12 月 20 日 05:53

那就需要再进一步的调试了，看看是 query 的哪个部分的数据量多，最后再针对性的优化对应的部分

dillon.wang · 2022 年12 月 20 日 06:05

主要就是这个巨大无比match (x)-[r2:CALL_TO]-(n:USER)

dillon.wang · 2022 年12 月 20 日 06:10

加上这一个就oom了match (x)-[r2:CALL_TO]-(n:USER)

yee · 2022 年12 月 20 日 07:02

你用的这个版本应该还没有对应边的过滤下推，最新的分支的版本才完成的优化，可以考虑截断来防止一下 OOM

dillon.wang · 2022 年12 月 20 日 07:33

这个具体可以帮我看下嘛帮我优化一个，其他的，其他的我仿照这个来改，感觉无从下手我是nebula3.3.0