已针对tag属性创建索引,但match匹配不到数据

  • nebula 版本:2.0.1GA
  • 部署方式(分布式 / 单机 / Docker / DBaaS):分布式
  • 是否为线上版本:N
  • 硬件信息
    • 磁盘( 推荐使用 SSD):SAS
    • CPU、内存信息 8核32G
  • 问题的具体描述
    官方文档里的案例,我创建了player的tag,插入了案例数据,然后针对tag的name属性创建了索引,然后也rebuild了索引,job是finished状态,但是通过lookup和match查询都匹配不出任何数据,返回结果集都是空集合,但确定是有数据的,通过go或者fetch命令是能返回条件数据的
    请问下专家,可能是什么原因导致的?

貌似第一次看到这情况.
之前遇到过 create 索引那句语句跟别的语句放一起执行, 最后就没找到.
逐一执行就好了.

match语句贴一下

lookup on player where player.name == ‘Tim Duncan’

(root@nebula) [basketballplayer]> show job 29
±---------------±--------------------±-----------±------------------------±------------------------+
| Job Id(TaskId) | Command(Dest) | Status | Start Time | Stop Time |
±---------------±--------------------±-----------±------------------------±------------------------+
| 29 | “REBUILD_TAG_INDEX” | “FINISHED” | 2021-06-02T02:14:30.000 | 2021-06-02T02:14:30.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 0 | “10.116.148.15” | “FINISHED” | 2021-06-02T02:14:30.000 | 2021-06-02T02:31:11.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 1 | “10.116.148.22” | “FINISHED” | 2021-06-02T02:14:30.000 | 2021-06-02T02:31:11.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 2 | “10.116.148.114” | “FINISHED” | 2021-06-02T02:14:30.000 | 2021-06-02T02:31:11.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
Got 4 rows (time spent 14076/15233 us)

(root@nebula) [basketballplayer]> show create tag index player_index_1
±-----------------±-------------------------------------------------+
| Tag Index Name | Create Tag Index |
±-----------------±-------------------------------------------------+
| “player_index_1” | “CREATE TAG INDEX player_index_1 ON player ( |
| | name(20) |
| | )” |
±-----------------±-------------------------------------------------+
Got 1 rows (time spent 1036/2176 us)

Wed, 02 Jun 2021 10:12:45 CST

(root@nebula) [basketballplayer]> fetch prop on player ‘player100’
±---------------------------------------------------+
| vertices_ |
±---------------------------------------------------+
| (“player100” :player{age: 42, name: “Tim Duncan”}) |
±---------------------------------------------------+
Got 1 rows (time spent 1029/2152 us)

(root@nebula) [basketballplayer]> lookup on player where player.name == ‘Tim Duncan’
Empty set (time spent 1185/2294 us)

Wed, 02 Jun 2021 10:04:52 CST

试试这个

lookup on player where player.name == “Tim Duncan”
然后对比一下结果


+-------------+
| VertexID    |
+-------------+
| "player100" |
+-------------+
Got 1 rows (time spent 1465/1935 us)

Wed, 02 Jun 2021 11:10:54 CST

(root@nebula) [testindex1]> 

(root@nebula) [basketballplayer]> lookup on player where player.name == “Tim Duncan”
Empty set (time spent 1320/2619 us)

Wed, 02 Jun 2021 10:17:14 CST

(root@nebula) [basketballplayer]> lookup on player where player.name == ‘Tim Duncan’
Empty set (time spent 1111/2240 us)

Wed, 02 Jun 2021 10:17:21 CST

(root@nebula) [basketballplayer]>

不行的,单双引号,我都试了

你现在要用name 做where 查询就必须要在name上建立索引,并且rebuild 了,你目前的问题极有可能是建立了name的属性索引,但是没有rebuild tag index

(root@nebula) [testindex1]> show tag indexes ;
+---------------------+
| Names               |
+---------------------+
| "index_player"      |
+---------------------+
| "index_player_name" |
+---------------------+
| "index_tag"         |
+---------------------+
| "index_team"        |
+---------------------+
| "player"            |
+---------------------+
Got 5 rows (time spent 1102/1606 us)

Wed, 02 Jun 2021 11:14:54 CST

(root@nebula) [testindex1]> show create tag index ^C
(root@nebula) [testindex1]> show create tag index index_player_name
+---------------------+-----------------------------------------------------+
| Tag Index Name      | Create Tag Index                                    |
+---------------------+-----------------------------------------------------+
| "index_player_name" | "CREATE TAG INDEX `index_player_name` ON `player` ( |
|                     |  `name(30)`                                         |
|                     | )"                                                  |
+---------------------+-----------------------------------------------------+
Got 1 rows (time spent 1168/1544 us)

Wed, 02 Jun 2021 11:15:20 CST

(root@nebula) [testindex1]> 

不行就重新建立索引,然后rebuild一下索引。

go或者fetch 如果直接通过vid查询是不需要索引的。所以能返回数据。

(root@nebula) [basketballplayer]> show tag indexes
±-----------------+
| Names |
±-----------------+
| “player_index_0” |
±-----------------+
| “player_index_1” |
±-----------------+
Got 2 rows (time spent 997/2186 us)

Wed, 02 Jun 2021 11:18:40 CST

(root@nebula) [basketballplayer]> show create tag index player_index_0
±-----------------±-------------------------------------------------+
| Tag Index Name | Create Tag Index |
±-----------------±-------------------------------------------------+
| “player_index_0” | “CREATE TAG INDEX player_index_0 ON player ( |
| | )” |
±-----------------±-------------------------------------------------+
Got 1 rows (time spent 1071/2248 us)

Wed, 02 Jun 2021 11:18:58 CST

(root@nebula) [basketballplayer]> show create tag index player_index_1
±-----------------±-------------------------------------------------+
| Tag Index Name | Create Tag Index |
±-----------------±-------------------------------------------------+
| “player_index_1” | “CREATE TAG INDEX player_index_1 ON player ( |
| | name(20) |
| | )” |
±-----------------±-------------------------------------------------+
Got 1 rows (time spent 1124/2272 us)

Wed, 02 Jun 2021 11:19:02 CST

(root@nebula) [basketballplayer]> rebuild tag index player_index_0
±-----------+
| New Job Id |
±-----------+
| 31 |
±-----------+
Got 1 rows (time spent 15221/16508 us)

Wed, 02 Jun 2021 11:19:16 CST

(root@nebula) [basketballplayer]> rebuild tag index player_index_1
±-----------+
| New Job Id |
±-----------+
| 32 |
±-----------+
Got 1 rows (time spent 6773/8014 us)

Wed, 02 Jun 2021 11:19:18 CST

(root@nebula) [basketballplayer]> show job 31
±---------------±--------------------±-----------±------------------------±------------------------+
| Job Id(TaskId) | Command(Dest) | Status | Start Time | Stop Time |
±---------------±--------------------±-----------±------------------------±------------------------+
| 31 | “REBUILD_TAG_INDEX” | “FINISHED” | 2021-06-02T03:19:38.000 | 2021-06-02T03:19:38.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 0 | “10.116.148.15” | “FINISHED” | 2021-06-02T03:19:38.000 | 2021-06-02T03:36:20.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 1 | “10.116.148.22” | “FINISHED” | 2021-06-02T03:19:38.000 | 2021-06-02T03:36:20.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 2 | “10.116.148.114” | “FINISHED” | 2021-06-02T03:19:38.000 | 2021-06-02T03:36:20.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
Got 4 rows (time spent 1201/2451 us)

Wed, 02 Jun 2021 11:19:22 CST

(root@nebula) [basketballplayer]> show job 32
±---------------±--------------------±-----------±------------------------±------------------------+
| Job Id(TaskId) | Command(Dest) | Status | Start Time | Stop Time |
±---------------±--------------------±-----------±------------------------±------------------------+
| 32 | “REBUILD_TAG_INDEX” | “FINISHED” | 2021-06-02T03:19:40.000 | 2021-06-02T03:19:40.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 0 | “10.116.148.15” | “FINISHED” | 2021-06-02T03:19:40.000 | 2021-06-02T03:36:22.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 1 | “10.116.148.22” | “FINISHED” | 2021-06-02T03:19:40.000 | 2021-06-02T03:36:22.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
| 2 | “10.116.148.114” | “FINISHED” | 2021-06-02T03:19:40.000 | 2021-06-02T03:36:22.000 |
±---------------±--------------------±-----------±------------------------±------------------------+
Got 4 rows (time spent 1121/2346 us)

Wed, 02 Jun 2021 11:19:27 CST

(root@nebula) [basketballplayer]>

我对tag和tag的属性name都建立了索引,重新build的了索引,然后重新查询还是不行
(root@nebula) [basketballplayer]> lookup on player where player.name == ‘Tim Duncan’
Empty set (time spent 1232/2490 us)

Wed, 02 Jun 2021 11:21:02 CST

(root@nebula) [basketballplayer]> lookup on player where player.name == “Tim Duncan”
Empty set (time spent 1123/2314 us)

Wed, 02 Jun 2021 11:21:09 CST

1 个赞

你可以通过 profile 来查看执行的结果:

> PROFILE lookup on player where player.name == “Tim Duncan”

看看每个算子涉及到的行数。

看你的描述,觉得应该是 index 是没有生效,具体问题可能需要 @bright-starry-sky 来协助分析一下

(root@nebula) [basketballplayer]> PROFILE lookup on player where player.name == 'Tim Duncan'
Empty set (time spent 1283/2479 us)

Execution Plan (optimize time 29 us)

-----+-----------+--------------+---------------------------------------------------+----------------------------------------
| id | name      | dependencies | profiling data                                    | operator info                         |
-----+-----------+--------------+---------------------------------------------------+----------------------------------------
|  2 | IndexScan | 0            | ver: 0, rows: 0, execTime: 0us, totalTime: 1091us | outputVar: [                          |
|    |           |              |                                                   |   {                                   |
|    |           |              |                                                   |     "colNames": [                     |
|    |           |              |                                                   |       "VertexID"                      |
|    |           |              |                                                   |     ],                                |
|    |           |              |                                                   |     "name": "__IndexScan_1",          |
|    |           |              |                                                   |     "type": "DATASET"                 |
|    |           |              |                                                   |   }                                   |
|    |           |              |                                                   | ]                                     |
|    |           |              |                                                   | inputVar:                             |
|    |           |              |                                                   | space: 16                             |
|    |           |              |                                                   | dedup: false                          |
|    |           |              |                                                   | limit: 9223372036854775807            |
|    |           |              |                                                   | filter:                               |
|    |           |              |                                                   | orderBy: []                           |
|    |           |              |                                                   | schemaId: 17                          |
|    |           |              |                                                   | isEdge: false                         |
|    |           |              |                                                   | returnCols: [                         |
|    |           |              |                                                   |   "_vid"                              |
|    |           |              |                                                   | ]                                     |
|    |           |              |                                                   | indexCtx: [                           |
|    |           |              |                                                   |   {                                   |
|    |           |              |                                                   |     "columnHints": [                  |
|    |           |              |                                                   |       {                               |
|    |           |              |                                                   |         "endValue": "__EMPTY__",      |
|    |           |              |                                                   |         "beginValue": "\"Tim Duncan", |
|    |           |              |                                                   |         "column": "name",             |
|    |           |              |                                                   |         "scanType": "PREFIX"          |
|    |           |              |                                                   |       }                               |
|    |           |              |                                                   |     ],                                |
|    |           |              |                                                   |     "index_id": 33,                   |
|    |           |              |                                                   |     "filter": ""                      |
|    |           |              |                                                   |   }                                   |
|    |           |              |                                                   | ]                                     |
-----+-----------+--------------+---------------------------------------------------+----------------------------------------
|  0 | Start     |              | ver: 0, rows: 0, execTime: 0us, totalTime: 23us   | outputVar: [                          |
|    |           |              |                                                   |   {                                   |
|    |           |              |                                                   |     "colNames": [],                   |
|    |           |              |                                                   |     "name": "__Start_0",              |
|    |           |              |                                                   |     "type": "DATASET"                 |
|    |           |              |                                                   |   }                                   |
|    |           |              |                                                   | ]                                     |
-----+-----------+--------------+---------------------------------------------------+----------------------------------------

Wed, 02 Jun 2021 19:23:53 CST

执行计划,第1步骤返回的就是0行,这个算是索引没有生效吧?

看起来是索引没有生效,具体原因还是要请 @bright-starry-sky 来给定位一下。

PS: 建议你把执行结果使用代码格式显示,这个显示太乱了。

**[quote=“yee, post:13, topic:4242, full:true”]
看起来是索引没有生效,具体原因还是要请 @bright-starry-sky 来给定位一下。

PS: 建议你把执行结果使用代码格式显示,这个显示太乱了。
[/quote]

斜体示例*** 1. 列表条目[quote=“yee, post:13, topic:4242, full:true”]
看起来是索引没有生效,具体原因还是要请 @bright-starry-sky 来给定位一下。

PS: 建议你把执行结果使用代码格式显示,这个显示太乱了。
[/quote]

我这边上传图片格式的会报失败,上传不了,上传文字版的提交后就格式边了,实在不好意思哦

大概已经猜到问题了,lookup语句本身没问题,可否尝试手动insert一个vertex,然后再lookup试一下?

(root@nebula) [basketballplayer]> insert vertex player(name,age) values “player151”:(“T Mac”, 45);
Execution succeeded (time spent 1143/2445 us)

Thu, 03 Jun 2021 11:59:44 CST

(root@nebula) [basketballplayer]>
(root@nebula) [basketballplayer]> lookup on player where player.name = ‘T Mac’;
[ERROR (-7)]: SyntaxError: syntax error near `= ‘T Mac’

Thu, 03 Jun 2021 12:00:04 CST

(root@nebula) [basketballplayer]> lookup on player where player.name == ‘T Mac’;
±------------+
| VertexID |
±------------+
| “player151” |
±------------+
Got 1 rows (time spent 1117/2195 us)

Thu, 03 Jun 2021 12:00:08 CST

(root@nebula) [basketballplayer]>
(root@nebula) [basketballplayer]> MATCH (a:player {name: “T Mac”}) return a;
±----------------------------------------------+
| a |
±----------------------------------------------+
| (“player151” :player{age: 45, name: “T Mac”}) |
±----------------------------------------------+
Got 1 rows (time spent 1985/3110 us)

Thu, 03 Jun 2021 12:00:56 CST

(root@nebula) [basketballplayer]>

按您的方式再插入一条记录,使用loopup和match就都可以查下出来,多谢专家!!
是什么原因呢,还请指导

可否把rebuild那个时间段的 meta和storage的log贴出来看下?

meta的日志如下:

root@dggprunner00015:/usr/local/nebula/logs# cat nebula-metad.dggprunner00015.root.log.INFO.20210526-114113.12438
Log file created at: 2021/05/26 11:41:13
Running on machine: dggprunner00015
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0526 11:41:13.828116 12438 MetaDaemon.cpp:246] identify myself as “10.116.148.15”:9559
I0526 11:41:13.832821 12438 NebulaStore.cpp:47] Start the raft service…
I0526 11:41:13.833160 12438 RaftexService.cpp:65] Init thrift server for raft service, port: 9560
I0526 11:41:13.833230 12483 RaftexService.cpp:98] Starting the Raftex Service
I0526 11:41:13.869204 12483 RaftexService.cpp:86] Starting the Raftex Service on 9560
I0526 11:41:13.869232 12483 RaftexService.cpp:110] Start the Raftex Service successfully
I0526 11:41:13.869275 12438 NebulaStore.cpp:75] Scan the local path, and init the spaces_
I0526 11:41:13.869344 12438 NebulaStore.cpp:81] Scan path “/data/meta/nebula/0”
W0526 11:41:14.049207 12476 RaftexService.cpp:181] Cannot find the part 0 in the graph space 0
I0526 11:41:14.051648 12501 EventListner.h:18] Rocksdb start compaction column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 0, base level is 0, output level is 1
I0526 11:41:14.051774 12438 RocksEngine.cpp:119] open rocksdb on /data/meta/nebula/0/data
I0526 11:41:14.051787 12438 NebulaStore.cpp:111] Load space 0 from disk
I0526 11:41:14.051800 12438 NebulaStore.cpp:146] Need to open 1 parts of space 0
I0526 11:41:14.055378 12501 EventListner.h:30] Rocksdb compaction completed column family: default because of LevelL0FilesNum, status: OK, compacted 5 files into 1, base level is 0, output level is 1
I0526 11:41:14.260120 12479 FileBasedWal.cpp:65] [Port: 9560, Space: 0, Part: 0] lastLogId in wal is 963279, lastLogTerm is 149, path is /data/meta/nebula/0/wal/0/0000000000000804105.wal
I0526 11:41:14.260219 12479 RaftPart.cpp:295] [Port: 9560, Space: 0, Part: 0] There are 2 peer hosts, and total 3 copies. The quorum is 2, as learner 0, lastLogId 963279, lastLogTerm 149, committedLogId 963278, term 149
I0526 11:41:14.260226 12479 RaftPart.cpp:308] [Port: 9560, Space: 0, Part: 0] Add peer “10.116.148.22”:9560
I0526 11:41:14.260243 12479 RaftPart.cpp:308] [Port: 9560, Space: 0, Part: 0] Add peer “10.116.148.114”:9560
I0526 11:41:14.260335 12479 NebulaStore.cpp:177] Load part 0, 0 from disk
I0526 11:41:14.260370 12438 NebulaStore.cpp:192] Load space 0 complete
I0526 11:41:14.260396 12438 NebulaStore.cpp:201] Init data from partManager for “10.116.148.15”:9559
I0526 11:41:14.260406 12438 NebulaStore.cpp:291] Data space 0 has existed!
I0526 11:41:14.260408 12438 NebulaStore.cpp:330] [Space: 0, Part: 0] has existed!
I0526 11:41:14.260429 12438 NebulaStore.cpp:68] Register handler…
I0526 11:41:14.260433 12438 MetaDaemon.cpp:99] Waiting for the leader elected…
I0526 11:41:14.260437 12438 MetaDaemon.cpp:112] Leader has not been elected, sleep 1s
I0526 11:41:14.419728 12480 RaftPart.cpp:1043] [Port: 9560, Space: 0, Part: 0] Start leader election, reason: lastMsgDur 358, term 149
I0526 11:41:14.419766 12480 RaftPart.cpp:1193] [Port: 9560, Space: 0, Part: 0] Sending out an election request (space = 0, part = 0, term = 150, lastLogId = 963279, lastLogTerm = 149, candidateIP = 10.116.148.15, candidatePort = 9560)
I0526 11:41:14.421394 12480 RaftPart.cpp:1138] [Port: 9560, Space: 0, Part: 0] My last log id is less than “10.116.148.22”:9560, double my election interval.
I0526 11:41:14.421418 12480 RaftPart.cpp:1138] [Port: 9560, Space: 0, Part: 0] My last log id is less than “10.116.148.114”:9560, double my election interval.
I0526 11:41:14.421422 12480 RaftPart.cpp:1275] [Port: 9560, Space: 0, Part: 0] No one is elected, continue the election
I0526 11:41:15.260560 12438 MetaDaemon.cpp:112] Leader has not been elected, sleep 1s
I0526 11:41:16.260728 12438 MetaDaemon.cpp:112] Leader has not been elected, sleep 1s
I0526 11:41:16.812916 12476 RaftPart.cpp:1739] [Port: 9560, Space: 0, Part: 0] I dont know who is leader for current term 149, so accept the candidate “10.116.148.114”:9560
I0526 11:41:16.812948 12476 RaftPart.cpp:1761] [Port: 9560, Space: 0, Part: 0] The current role is Candidate. Will follow the new leader 10.116.148.114:9560 [Term: 149]
I0526 11:41:16.813099 12479 Part.cpp:191] [Port: 9560, Space: 0, Part: 0] Find the new leader “10.116.148.114”:9560
I0526 11:41:17.260926 12438 MetaDaemon.cpp:141] Get meta version is 2
I0526 11:41:17.261050 12438 MetaDaemon.cpp:168] Nebula store init succeeded, clusterId 7356165955248333383
I0526 11:41:17.261062 12438 MetaDaemon.cpp:259] Start http service
I0526 11:41:17.275574 12438 MetaDaemon.cpp:176] Starting Meta HTTP Service
I0526 11:41:17.277329 12525 WebService.cpp:131] Web service started on HTTP[19559], HTTP2[19560]
I0526 11:41:17.277454 12438 JobManager.cpp:52] JobManager initialized
I0526 11:41:17.277473 12531 JobManager.cpp:75] JobManager::runJobBackground() enter
I0526 11:41:17.277585 12438 MetaDaemon.cpp:316] The meta deamon start on “10.116.148.15”:9559
I0527 11:05:45.291472 12545 HBProcessor.cpp:47] Set clusterId for new host “10.116.148.15”:9779!
E0527 11:05:45.291528 12545 RaftPart.cpp:367] [Port: 9560, Space: 0, Part: 0] The partition is not a leader
E0527 11:05:45.291689 12545 RaftPart.cpp:687] [Port: 9560, Space: 0, Part: 0] Cannot append logs, clean the buffer
I0527 15:41:14.644043 12480 FileBasedWal.cpp:738] [Port: 9560, Space: 0, Part: 0] Clean wals number 1
I0529 22:31:15.338212 12480 FileBasedWal.cpp:738] [Port: 9560, Space: 0, Part: 0] Clean wals number 1
I0601 05:01:16.131122 12479 FileBasedWal.cpp:738] [Port: 9560, Space: 0, Part: 0] Clean wals number 1
I0603 07:41:16.806901 12480 FileBasedWal.cpp:738] [Port: 9560, Space: 0, Part: 0] Clean wals number 1

storage的日志如下,一直在报错:

E0603 14:08:20.272584 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:22.275190 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:24.276310 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:26.278750 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:28.279893 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:30.281077 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:32.282223 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:34.283336 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:36.284452 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:38.285564 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:40.286654 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:42.287860 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:44.289024 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:46.290134 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:48.291317 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:50.292543 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:52.293669 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:54.294780 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:56.295998 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:08:58.297252 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:00.298393 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:02.299533 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:04.301789 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:06.302997 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:08.304123 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:10.305310 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:12.306397 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:14.307649 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:16.308820 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:18.310058 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:20.311206 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:22.312373 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:24.314402 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:26.315605 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:28.316761 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:30.317986 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:32.319106 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:34.320446 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:36.321676 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:38.322857 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:40.323988 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:42.325078 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:44.326175 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:46.327457 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:48.328677 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:50.329957 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:52.331074 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:54.332238 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:56.333376 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:09:58.334610 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:00.335773 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:02.336931 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:04.338275 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:06.339584 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:08.340726 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:10.341894 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!
E0603 14:10:12.343076 3371 MetaClient.cpp:63] Heartbeat failed, status:Wrong cluster!

storage和meta配置对不上 cluster.id删掉 重启 重新rebuild